<!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <meta name="viewport" content="width=device-width, initial-scale=1.0"> <meta name="generator" content="rustdoc"> <meta name="description" content="Source to the Rust file `src/liballoc/raw_vec.rs`."> <meta name="keywords" content="rust, rustlang, rust-lang"> <title>raw_vec.rs.html -- source</title> <link rel="stylesheet" type="text/css" href="../../normalize.css"> <link rel="stylesheet" type="text/css" href="../../rustdoc.css"> <link rel="stylesheet" type="text/css" href="../../main.css"> <link rel="shortcut icon" href="https://doc.rust-lang.org/favicon.ico"> </head> <body class="rustdoc source"> <!--[if lte IE 8]> <div class="warning"> This old browser is unsupported and will most likely display funky things. </div> <![endif]--> <nav class="sidebar"> <a href='../../alloc/index.html'><img src='https://www.rust-lang.org/logos/rust-logo-128x128-blk-v2.png' alt='logo' width='100'></a> </nav> <nav class="sub"> <form class="search-form js-only"> <div class="search-container"> <input class="search-input" name="search" autocomplete="off" placeholder="Click or press ‘S’ to search, ‘?’ for more options…" type="search"> </div> </form> </nav> <section id='main' class="content"><pre class="line-numbers"><span id="1"> 1</span> <span id="2"> 2</span> <span id="3"> 3</span> <span id="4"> 4</span> <span id="5"> 5</span> <span id="6"> 6</span> <span id="7"> 7</span> <span id="8"> 8</span> <span id="9"> 9</span> <span id="10"> 10</span> <span id="11"> 11</span> <span id="12"> 12</span> <span id="13"> 13</span> <span id="14"> 14</span> <span id="15"> 15</span> <span id="16"> 16</span> <span id="17"> 17</span> <span id="18"> 18</span> <span id="19"> 19</span> <span id="20"> 20</span> <span id="21"> 21</span> <span id="22"> 22</span> <span id="23"> 23</span> <span id="24"> 24</span> <span id="25"> 25</span> <span id="26"> 26</span> <span id="27"> 27</span> <span id="28"> 28</span> <span id="29"> 29</span> <span id="30"> 30</span> <span id="31"> 31</span> <span id="32"> 32</span> <span id="33"> 33</span> <span id="34"> 34</span> <span id="35"> 35</span> <span id="36"> 36</span> <span id="37"> 37</span> <span id="38"> 38</span> <span id="39"> 39</span> <span id="40"> 40</span> <span id="41"> 41</span> <span id="42"> 42</span> <span id="43"> 43</span> <span id="44"> 44</span> <span id="45"> 45</span> <span id="46"> 46</span> <span id="47"> 47</span> <span id="48"> 48</span> <span id="49"> 49</span> <span id="50"> 50</span> <span id="51"> 51</span> <span id="52"> 52</span> <span id="53"> 53</span> <span id="54"> 54</span> <span id="55"> 55</span> <span id="56"> 56</span> <span id="57"> 57</span> <span id="58"> 58</span> <span id="59"> 59</span> <span id="60"> 60</span> <span id="61"> 61</span> <span id="62"> 62</span> <span id="63"> 63</span> <span id="64"> 64</span> <span id="65"> 65</span> <span id="66"> 66</span> <span id="67"> 67</span> <span id="68"> 68</span> <span id="69"> 69</span> <span id="70"> 70</span> <span id="71"> 71</span> <span id="72"> 72</span> <span id="73"> 73</span> <span id="74"> 74</span> <span id="75"> 75</span> <span id="76"> 76</span> <span id="77"> 77</span> <span id="78"> 78</span> <span id="79"> 79</span> <span id="80"> 80</span> <span id="81"> 81</span> <span id="82"> 82</span> <span id="83"> 83</span> <span id="84"> 84</span> <span id="85"> 85</span> <span id="86"> 86</span> <span id="87"> 87</span> <span id="88"> 88</span> <span id="89"> 89</span> <span id="90"> 90</span> <span id="91"> 91</span> <span id="92"> 92</span> <span id="93"> 93</span> <span id="94"> 94</span> <span id="95"> 95</span> <span id="96"> 96</span> <span id="97"> 97</span> <span id="98"> 98</span> <span id="99"> 99</span> <span id="100">100</span> <span id="101">101</span> <span id="102">102</span> <span id="103">103</span> <span id="104">104</span> <span id="105">105</span> <span id="106">106</span> <span id="107">107</span> <span id="108">108</span> <span id="109">109</span> <span id="110">110</span> <span id="111">111</span> <span id="112">112</span> <span id="113">113</span> <span id="114">114</span> <span id="115">115</span> <span id="116">116</span> <span id="117">117</span> <span id="118">118</span> <span id="119">119</span> <span id="120">120</span> <span id="121">121</span> <span id="122">122</span> <span id="123">123</span> <span id="124">124</span> <span id="125">125</span> <span id="126">126</span> <span id="127">127</span> <span id="128">128</span> <span id="129">129</span> <span id="130">130</span> <span id="131">131</span> <span id="132">132</span> <span id="133">133</span> <span id="134">134</span> <span id="135">135</span> <span id="136">136</span> <span id="137">137</span> <span id="138">138</span> <span id="139">139</span> <span id="140">140</span> <span id="141">141</span> <span id="142">142</span> <span id="143">143</span> <span id="144">144</span> <span id="145">145</span> <span id="146">146</span> <span id="147">147</span> <span id="148">148</span> <span id="149">149</span> <span id="150">150</span> <span id="151">151</span> <span id="152">152</span> <span id="153">153</span> <span id="154">154</span> <span id="155">155</span> <span id="156">156</span> <span id="157">157</span> <span id="158">158</span> <span id="159">159</span> <span id="160">160</span> <span id="161">161</span> <span id="162">162</span> <span id="163">163</span> <span id="164">164</span> <span id="165">165</span> <span id="166">166</span> <span id="167">167</span> <span id="168">168</span> <span id="169">169</span> <span id="170">170</span> <span id="171">171</span> <span id="172">172</span> <span id="173">173</span> <span id="174">174</span> <span id="175">175</span> <span id="176">176</span> <span id="177">177</span> <span id="178">178</span> <span id="179">179</span> <span id="180">180</span> <span id="181">181</span> <span id="182">182</span> <span id="183">183</span> <span id="184">184</span> <span id="185">185</span> <span id="186">186</span> <span id="187">187</span> <span id="188">188</span> <span id="189">189</span> <span id="190">190</span> <span id="191">191</span> <span id="192">192</span> <span id="193">193</span> <span id="194">194</span> <span id="195">195</span> <span id="196">196</span> <span id="197">197</span> <span id="198">198</span> <span id="199">199</span> <span id="200">200</span> <span id="201">201</span> <span id="202">202</span> <span id="203">203</span> <span id="204">204</span> <span id="205">205</span> <span id="206">206</span> <span id="207">207</span> <span id="208">208</span> <span id="209">209</span> <span id="210">210</span> <span id="211">211</span> <span id="212">212</span> <span id="213">213</span> <span id="214">214</span> <span id="215">215</span> <span id="216">216</span> <span id="217">217</span> <span id="218">218</span> <span id="219">219</span> <span id="220">220</span> <span id="221">221</span> <span id="222">222</span> <span id="223">223</span> <span id="224">224</span> <span id="225">225</span> <span id="226">226</span> <span id="227">227</span> <span id="228">228</span> <span id="229">229</span> <span id="230">230</span> <span id="231">231</span> <span id="232">232</span> <span id="233">233</span> <span id="234">234</span> <span id="235">235</span> <span id="236">236</span> <span id="237">237</span> <span id="238">238</span> <span id="239">239</span> <span id="240">240</span> <span id="241">241</span> <span id="242">242</span> <span id="243">243</span> <span id="244">244</span> <span id="245">245</span> <span id="246">246</span> <span id="247">247</span> <span id="248">248</span> <span id="249">249</span> <span id="250">250</span> <span id="251">251</span> <span id="252">252</span> <span id="253">253</span> <span id="254">254</span> <span id="255">255</span> <span id="256">256</span> <span id="257">257</span> <span id="258">258</span> <span id="259">259</span> <span id="260">260</span> <span id="261">261</span> <span id="262">262</span> <span id="263">263</span> <span id="264">264</span> <span id="265">265</span> <span id="266">266</span> <span id="267">267</span> <span id="268">268</span> <span id="269">269</span> <span id="270">270</span> <span id="271">271</span> <span id="272">272</span> <span id="273">273</span> <span id="274">274</span> <span id="275">275</span> <span id="276">276</span> <span id="277">277</span> <span id="278">278</span> <span id="279">279</span> <span id="280">280</span> <span id="281">281</span> <span id="282">282</span> <span id="283">283</span> <span id="284">284</span> <span id="285">285</span> <span id="286">286</span> <span id="287">287</span> <span id="288">288</span> <span id="289">289</span> <span id="290">290</span> <span id="291">291</span> <span id="292">292</span> <span id="293">293</span> <span id="294">294</span> <span id="295">295</span> <span id="296">296</span> <span id="297">297</span> <span id="298">298</span> <span id="299">299</span> <span id="300">300</span> <span id="301">301</span> <span id="302">302</span> <span id="303">303</span> <span id="304">304</span> <span id="305">305</span> <span id="306">306</span> <span id="307">307</span> <span id="308">308</span> <span id="309">309</span> <span id="310">310</span> <span id="311">311</span> <span id="312">312</span> <span id="313">313</span> <span id="314">314</span> <span id="315">315</span> <span id="316">316</span> <span id="317">317</span> <span id="318">318</span> <span id="319">319</span> <span id="320">320</span> <span id="321">321</span> <span id="322">322</span> <span id="323">323</span> <span id="324">324</span> <span id="325">325</span> <span id="326">326</span> <span id="327">327</span> <span id="328">328</span> <span id="329">329</span> <span id="330">330</span> <span id="331">331</span> <span id="332">332</span> <span id="333">333</span> <span id="334">334</span> <span id="335">335</span> <span id="336">336</span> <span id="337">337</span> <span id="338">338</span> <span id="339">339</span> <span id="340">340</span> <span id="341">341</span> <span id="342">342</span> <span id="343">343</span> <span id="344">344</span> <span id="345">345</span> <span id="346">346</span> <span id="347">347</span> <span id="348">348</span> <span id="349">349</span> <span id="350">350</span> <span id="351">351</span> <span id="352">352</span> <span id="353">353</span> <span id="354">354</span> <span id="355">355</span> <span id="356">356</span> <span id="357">357</span> <span id="358">358</span> <span id="359">359</span> <span id="360">360</span> <span id="361">361</span> <span id="362">362</span> <span id="363">363</span> <span id="364">364</span> <span id="365">365</span> <span id="366">366</span> <span id="367">367</span> <span id="368">368</span> <span id="369">369</span> <span id="370">370</span> <span id="371">371</span> <span id="372">372</span> <span id="373">373</span> <span id="374">374</span> <span id="375">375</span> <span id="376">376</span> <span id="377">377</span> <span id="378">378</span> <span id="379">379</span> <span id="380">380</span> <span id="381">381</span> <span id="382">382</span> <span id="383">383</span> <span id="384">384</span> <span id="385">385</span> <span id="386">386</span> <span id="387">387</span> <span id="388">388</span> <span id="389">389</span> <span id="390">390</span> <span id="391">391</span> <span id="392">392</span> <span id="393">393</span> <span id="394">394</span> <span id="395">395</span> <span id="396">396</span> <span id="397">397</span> <span id="398">398</span> <span id="399">399</span> <span id="400">400</span> <span id="401">401</span> <span id="402">402</span> <span id="403">403</span> <span id="404">404</span> <span id="405">405</span> <span id="406">406</span> <span id="407">407</span> <span id="408">408</span> <span id="409">409</span> <span id="410">410</span> <span id="411">411</span> <span id="412">412</span> <span id="413">413</span> <span id="414">414</span> <span id="415">415</span> <span id="416">416</span> <span id="417">417</span> <span id="418">418</span> <span id="419">419</span> <span id="420">420</span> <span id="421">421</span> <span id="422">422</span> <span id="423">423</span> <span id="424">424</span> <span id="425">425</span> <span id="426">426</span> <span id="427">427</span> <span id="428">428</span> <span id="429">429</span> <span id="430">430</span> <span id="431">431</span> <span id="432">432</span> <span id="433">433</span> <span id="434">434</span> <span id="435">435</span> <span id="436">436</span> <span id="437">437</span> <span id="438">438</span> <span id="439">439</span> <span id="440">440</span> <span id="441">441</span> <span id="442">442</span> <span id="443">443</span> <span id="444">444</span> <span id="445">445</span> <span id="446">446</span> <span id="447">447</span> <span id="448">448</span> <span id="449">449</span> <span id="450">450</span> <span id="451">451</span> <span id="452">452</span> <span id="453">453</span> <span id="454">454</span> <span id="455">455</span> <span id="456">456</span> <span id="457">457</span> <span id="458">458</span> <span id="459">459</span> <span id="460">460</span> <span id="461">461</span> <span id="462">462</span> <span id="463">463</span> <span id="464">464</span> <span id="465">465</span> <span id="466">466</span> <span id="467">467</span> <span id="468">468</span> <span id="469">469</span> <span id="470">470</span> <span id="471">471</span> <span id="472">472</span> <span id="473">473</span> <span id="474">474</span> <span id="475">475</span> <span id="476">476</span> <span id="477">477</span> <span id="478">478</span> <span id="479">479</span> <span id="480">480</span> <span id="481">481</span> <span id="482">482</span> <span id="483">483</span> <span id="484">484</span> <span id="485">485</span> <span id="486">486</span> <span id="487">487</span> <span id="488">488</span> <span id="489">489</span> <span id="490">490</span> <span id="491">491</span> <span id="492">492</span> <span id="493">493</span> <span id="494">494</span> <span id="495">495</span> <span id="496">496</span> <span id="497">497</span> <span id="498">498</span> <span id="499">499</span> <span id="500">500</span> <span id="501">501</span> <span id="502">502</span> <span id="503">503</span> <span id="504">504</span> <span id="505">505</span> <span id="506">506</span> <span id="507">507</span> <span id="508">508</span> <span id="509">509</span> <span id="510">510</span> <span id="511">511</span> <span id="512">512</span> <span id="513">513</span> <span id="514">514</span> <span id="515">515</span> <span id="516">516</span> <span id="517">517</span> <span id="518">518</span> <span id="519">519</span> <span id="520">520</span> <span id="521">521</span> <span id="522">522</span> <span id="523">523</span> <span id="524">524</span> <span id="525">525</span> <span id="526">526</span> <span id="527">527</span> <span id="528">528</span> <span id="529">529</span> <span id="530">530</span> <span id="531">531</span> <span id="532">532</span> <span id="533">533</span> <span id="534">534</span> <span id="535">535</span> <span id="536">536</span> <span id="537">537</span> <span id="538">538</span> <span id="539">539</span> <span id="540">540</span> <span id="541">541</span> <span id="542">542</span> <span id="543">543</span> <span id="544">544</span> <span id="545">545</span> <span id="546">546</span> <span id="547">547</span> <span id="548">548</span> <span id="549">549</span> <span id="550">550</span> <span id="551">551</span> <span id="552">552</span> <span id="553">553</span> <span id="554">554</span> <span id="555">555</span> <span id="556">556</span> <span id="557">557</span> <span id="558">558</span> <span id="559">559</span> <span id="560">560</span> <span id="561">561</span> <span id="562">562</span> <span id="563">563</span> <span id="564">564</span> <span id="565">565</span> <span id="566">566</span> <span id="567">567</span> <span id="568">568</span> <span id="569">569</span> <span id="570">570</span> <span id="571">571</span> <span id="572">572</span> <span id="573">573</span> <span id="574">574</span> <span id="575">575</span> <span id="576">576</span> <span id="577">577</span> <span id="578">578</span> <span id="579">579</span> <span id="580">580</span> <span id="581">581</span> <span id="582">582</span> <span id="583">583</span> <span id="584">584</span> <span id="585">585</span> <span id="586">586</span> <span id="587">587</span> <span id="588">588</span> <span id="589">589</span> <span id="590">590</span> <span id="591">591</span> <span id="592">592</span> <span id="593">593</span> <span id="594">594</span> <span id="595">595</span> <span id="596">596</span> <span id="597">597</span> <span id="598">598</span> <span id="599">599</span> <span id="600">600</span> <span id="601">601</span> <span id="602">602</span> <span id="603">603</span> <span id="604">604</span> <span id="605">605</span> <span id="606">606</span> <span id="607">607</span> <span id="608">608</span> <span id="609">609</span> <span id="610">610</span> <span id="611">611</span> <span id="612">612</span> <span id="613">613</span> <span id="614">614</span> <span id="615">615</span> <span id="616">616</span> <span id="617">617</span> <span id="618">618</span> <span id="619">619</span> <span id="620">620</span> <span id="621">621</span> <span id="622">622</span> <span id="623">623</span> <span id="624">624</span> <span id="625">625</span> <span id="626">626</span> </pre><pre class="rust "> <span class="comment">// Copyright 2015 The Rust Project Developers. See the COPYRIGHT</span> <span class="comment">// file at the top-level directory of this distribution and at</span> <span class="comment">// http://rust-lang.org/COPYRIGHT.</span> <span class="comment">//</span> <span class="comment">// Licensed under the Apache License, Version 2.0 <LICENSE-APACHE or</span> <span class="comment">// http://www.apache.org/licenses/LICENSE-2.0> or the MIT license</span> <span class="comment">// <LICENSE-MIT or http://opensource.org/licenses/MIT>, at your</span> <span class="comment">// option. This file may not be copied, modified, or distributed</span> <span class="comment">// except according to those terms.</span> <span class="kw">use</span> <span class="ident">core</span>::<span class="ident">ptr</span>::<span class="ident">Unique</span>; <span class="kw">use</span> <span class="ident">core</span>::<span class="ident">mem</span>; <span class="kw">use</span> <span class="ident">core</span>::<span class="ident">slice</span>; <span class="kw">use</span> <span class="ident">heap</span>; <span class="kw">use</span> <span class="kw">super</span>::<span class="ident">oom</span>; <span class="kw">use</span> <span class="kw">super</span>::<span class="ident">boxed</span>::<span class="ident">Box</span>; <span class="kw">use</span> <span class="ident">core</span>::<span class="ident">ops</span>::<span class="ident">Drop</span>; <span class="kw">use</span> <span class="ident">core</span>::<span class="ident">cmp</span>; <span class="doccomment">/// A low-level utility for more ergonomically allocating, reallocating, and deallocating</span> <span class="doccomment">/// a buffer of memory on the heap without having to worry about all the corner cases</span> <span class="doccomment">/// involved. This type is excellent for building your own data structures like Vec and VecDeque.</span> <span class="doccomment">/// In particular:</span> <span class="doccomment">///</span> <span class="doccomment">/// * Produces Unique::empty() on zero-sized types</span> <span class="doccomment">/// * Produces Unique::empty() on zero-length allocations</span> <span class="doccomment">/// * Catches all overflows in capacity computations (promotes them to "capacity overflow" panics)</span> <span class="doccomment">/// * Guards against 32-bit systems allocating more than isize::MAX bytes</span> <span class="doccomment">/// * Guards against overflowing your length</span> <span class="doccomment">/// * Aborts on OOM</span> <span class="doccomment">/// * Avoids freeing Unique::empty()</span> <span class="doccomment">/// * Contains a ptr::Unique and thus endows the user with all related benefits</span> <span class="doccomment">///</span> <span class="doccomment">/// This type does not in anyway inspect the memory that it manages. When dropped it *will*</span> <span class="doccomment">/// free its memory, but it *won't* try to Drop its contents. It is up to the user of RawVec</span> <span class="doccomment">/// to handle the actual things *stored* inside of a RawVec.</span> <span class="doccomment">///</span> <span class="doccomment">/// Note that a RawVec always forces its capacity to be usize::MAX for zero-sized types.</span> <span class="doccomment">/// This enables you to use capacity growing logic catch the overflows in your length</span> <span class="doccomment">/// that might occur with zero-sized types.</span> <span class="doccomment">///</span> <span class="doccomment">/// However this means that you need to be careful when roundtripping this type</span> <span class="doccomment">/// with a `Box<[T]>`: `cap()` won't yield the len. However `with_capacity`,</span> <span class="doccomment">/// `shrink_to_fit`, and `from_box` will actually set RawVec's private capacity</span> <span class="doccomment">/// field. This allows zero-sized types to not be special-cased by consumers of</span> <span class="doccomment">/// this type.</span> <span class="kw">pub</span> <span class="kw">struct</span> <span class="ident">RawVec</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> { <span class="ident">ptr</span>: <span class="ident">Unique</span><span class="op"><</span><span class="ident">T</span><span class="op">></span>, <span class="ident">cap</span>: <span class="ident">usize</span>, } <span class="kw">impl</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> <span class="ident">RawVec</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> { <span class="doccomment">/// Creates the biggest possible RawVec without allocating. If T has positive</span> <span class="doccomment">/// size, then this makes a RawVec with capacity 0. If T has 0 size, then it</span> <span class="doccomment">/// it makes a RawVec with capacity `usize::MAX`. Useful for implementing</span> <span class="doccomment">/// delayed allocation.</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">new</span>() <span class="op">-></span> <span class="self">Self</span> { <span class="comment">// !0 is usize::MAX. This branch should be stripped at compile time.</span> <span class="kw">let</span> <span class="ident">cap</span> <span class="op">=</span> <span class="kw">if</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>() <span class="op">==</span> <span class="number">0</span> { <span class="op">!</span><span class="number">0</span> } <span class="kw">else</span> { <span class="number">0</span> }; <span class="comment">// Unique::empty() doubles as "unallocated" and "zero-sized allocation"</span> <span class="ident">RawVec</span> { <span class="ident">ptr</span>: <span class="ident">Unique</span>::<span class="ident">empty</span>(), <span class="ident">cap</span>: <span class="ident">cap</span>, } } <span class="doccomment">/// Creates a RawVec with exactly the capacity and alignment requirements</span> <span class="doccomment">/// for a `[T; cap]`. This is equivalent to calling RawVec::new when `cap` is 0</span> <span class="doccomment">/// or T is zero-sized. Note that if `T` is zero-sized this means you will *not*</span> <span class="doccomment">/// get a RawVec with the requested capacity!</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if the requested capacity exceeds `usize::MAX` bytes.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Aborts</span> <span class="doccomment">///</span> <span class="doccomment">/// Aborts on OOM</span> <span class="attribute">#[<span class="ident">inline</span>]</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">with_capacity</span>(<span class="ident">cap</span>: <span class="ident">usize</span>) <span class="op">-></span> <span class="self">Self</span> { <span class="ident">RawVec</span>::<span class="ident">allocate</span>(<span class="ident">cap</span>, <span class="bool-val">false</span>) } <span class="doccomment">/// Like `with_capacity` but guarantees the buffer is zeroed.</span> <span class="attribute">#[<span class="ident">inline</span>]</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">with_capacity_zeroed</span>(<span class="ident">cap</span>: <span class="ident">usize</span>) <span class="op">-></span> <span class="self">Self</span> { <span class="ident">RawVec</span>::<span class="ident">allocate</span>(<span class="ident">cap</span>, <span class="bool-val">true</span>) } <span class="kw">fn</span> <span class="ident">allocate</span>(<span class="ident">cap</span>: <span class="ident">usize</span>, <span class="ident">zeroed</span>: <span class="ident">bool</span>) <span class="op">-></span> <span class="self">Self</span> { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">alloc_size</span> <span class="op">=</span> <span class="ident">cap</span>.<span class="ident">checked_mul</span>(<span class="ident">elem_size</span>).<span class="ident">expect</span>(<span class="string">"capacity overflow"</span>); <span class="ident">alloc_guard</span>(<span class="ident">alloc_size</span>); <span class="comment">// handles ZSTs and `cap = 0` alike</span> <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="kw">if</span> <span class="ident">alloc_size</span> <span class="op">==</span> <span class="number">0</span> { <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> <span class="ident">u8</span> } <span class="kw">else</span> { <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="kw">if</span> <span class="ident">zeroed</span> { <span class="ident">heap</span>::<span class="ident">allocate_zeroed</span>(<span class="ident">alloc_size</span>, <span class="ident">align</span>) } <span class="kw">else</span> { <span class="ident">heap</span>::<span class="ident">allocate</span>(<span class="ident">alloc_size</span>, <span class="ident">align</span>) }; <span class="kw">if</span> <span class="ident">ptr</span>.<span class="ident">is_null</span>() { <span class="ident">oom</span>() } <span class="ident">ptr</span> }; <span class="ident">RawVec</span> { <span class="ident">ptr</span>: <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span> <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _), <span class="ident">cap</span>: <span class="ident">cap</span>, } } } <span class="doccomment">/// Reconstitutes a RawVec from a pointer and capacity.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Undefined Behavior</span> <span class="doccomment">///</span> <span class="doccomment">/// The ptr must be allocated, and with the given capacity. The</span> <span class="doccomment">/// capacity cannot exceed `isize::MAX` (only a concern on 32-bit systems).</span> <span class="doccomment">/// If the ptr and capacity come from a RawVec, then this is guaranteed.</span> <span class="kw">pub</span> <span class="kw">unsafe</span> <span class="kw">fn</span> <span class="ident">from_raw_parts</span>(<span class="ident">ptr</span>: <span class="kw-2">*</span><span class="kw-2">mut</span> <span class="ident">T</span>, <span class="ident">cap</span>: <span class="ident">usize</span>) <span class="op">-></span> <span class="self">Self</span> { <span class="ident">RawVec</span> { <span class="ident">ptr</span>: <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span>), <span class="ident">cap</span>: <span class="ident">cap</span>, } } <span class="doccomment">/// Converts a `Box<[T]>` into a `RawVec<T>`.</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">from_box</span>(<span class="kw-2">mut</span> <span class="ident">slice</span>: <span class="ident">Box</span><span class="op"><</span>[<span class="ident">T</span>]<span class="op">></span>) <span class="op">-></span> <span class="self">Self</span> { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">result</span> <span class="op">=</span> <span class="ident">RawVec</span>::<span class="ident">from_raw_parts</span>(<span class="ident">slice</span>.<span class="ident">as_mut_ptr</span>(), <span class="ident">slice</span>.<span class="ident">len</span>()); <span class="ident">mem</span>::<span class="ident">forget</span>(<span class="ident">slice</span>); <span class="ident">result</span> } } } <span class="kw">impl</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> <span class="ident">RawVec</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> { <span class="doccomment">/// Gets a raw pointer to the start of the allocation. Note that this is</span> <span class="doccomment">/// Unique::empty() if `cap = 0` or T is zero-sized. In the former case, you must</span> <span class="doccomment">/// be careful.</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">ptr</span>(<span class="kw-2">&</span><span class="self">self</span>) <span class="op">-></span> <span class="kw-2">*</span><span class="kw-2">mut</span> <span class="ident">T</span> { <span class="self">self</span>.<span class="ident">ptr</span>.<span class="ident">as_ptr</span>() } <span class="doccomment">/// Gets the capacity of the allocation.</span> <span class="doccomment">///</span> <span class="doccomment">/// This will always be `usize::MAX` if `T` is zero-sized.</span> <span class="attribute">#[<span class="ident">inline</span>(<span class="ident">always</span>)]</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">cap</span>(<span class="kw-2">&</span><span class="self">self</span>) <span class="op">-></span> <span class="ident">usize</span> { <span class="kw">if</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>() <span class="op">==</span> <span class="number">0</span> { <span class="op">!</span><span class="number">0</span> } <span class="kw">else</span> { <span class="self">self</span>.<span class="ident">cap</span> } } <span class="doccomment">/// Doubles the size of the type's backing allocation. This is common enough</span> <span class="doccomment">/// to want to do that it's easiest to just have a dedicated method. Slightly</span> <span class="doccomment">/// more efficient logic can be provided for this than the general case.</span> <span class="doccomment">///</span> <span class="doccomment">/// This function is ideal for when pushing elements one-at-a-time because</span> <span class="doccomment">/// you don't need to incur the costs of the more general computations</span> <span class="doccomment">/// reserve needs to do to guard against overflow. You do however need to</span> <span class="doccomment">/// manually check if your `len == cap`.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if T is zero-sized on the assumption that you managed to exhaust</span> <span class="doccomment">/// all `usize::MAX` slots in your imaginary buffer.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Aborts</span> <span class="doccomment">///</span> <span class="doccomment">/// Aborts on OOM</span> <span class="doccomment">///</span> <span class="doccomment">/// # Examples</span> <span class="doccomment">///</span> <span class="doccomment">/// ```ignore</span> <span class="doccomment">/// struct MyVec<T> {</span> <span class="doccomment">/// buf: RawVec<T>,</span> <span class="doccomment">/// len: usize,</span> <span class="doccomment">/// }</span> <span class="doccomment">///</span> <span class="doccomment">/// impl<T> MyVec<T> {</span> <span class="doccomment">/// pub fn push(&mut self, elem: T) {</span> <span class="doccomment">/// if self.len == self.buf.cap() { self.buf.double(); }</span> <span class="doccomment">/// // double would have aborted or panicked if the len exceeded</span> <span class="doccomment">/// // `isize::MAX` so this is safe to do unchecked now.</span> <span class="doccomment">/// unsafe {</span> <span class="doccomment">/// ptr::write(self.buf.ptr().offset(self.len as isize), elem);</span> <span class="doccomment">/// }</span> <span class="doccomment">/// self.len += 1;</span> <span class="doccomment">/// }</span> <span class="doccomment">/// }</span> <span class="doccomment">/// ```</span> <span class="attribute">#[<span class="ident">inline</span>(<span class="ident">never</span>)]</span> <span class="attribute">#[<span class="ident">cold</span>]</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">double</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>) { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// since we set the capacity to usize::MAX when elem_size is</span> <span class="comment">// 0, getting to here necessarily means the RawVec is overfull.</span> <span class="macro">assert</span><span class="macro">!</span>(<span class="ident">elem_size</span> <span class="op">!=</span> <span class="number">0</span>, <span class="string">"capacity overflow"</span>); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> (<span class="ident">new_cap</span>, <span class="ident">ptr</span>) <span class="op">=</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">==</span> <span class="number">0</span> { <span class="comment">// skip to 4 because tiny Vec's are dumb; but not if that would cause overflow</span> <span class="kw">let</span> <span class="ident">new_cap</span> <span class="op">=</span> <span class="kw">if</span> <span class="ident">elem_size</span> <span class="op">></span> (<span class="op">!</span><span class="number">0</span>) <span class="op">/</span> <span class="number">8</span> { <span class="number">1</span> } <span class="kw">else</span> { <span class="number">4</span> }; <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="ident">heap</span>::<span class="ident">allocate</span>(<span class="ident">new_cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">align</span>); (<span class="ident">new_cap</span>, <span class="ident">ptr</span>) } <span class="kw">else</span> { <span class="comment">// Since we guarantee that we never allocate more than isize::MAX bytes,</span> <span class="comment">// `elem_size * self.cap <= isize::MAX` as a precondition, so this can't overflow</span> <span class="kw">let</span> <span class="ident">new_cap</span> <span class="op">=</span> <span class="number">2</span> <span class="op">*</span> <span class="self">self</span>.<span class="ident">cap</span>; <span class="kw">let</span> <span class="ident">new_alloc_size</span> <span class="op">=</span> <span class="ident">new_cap</span> <span class="op">*</span> <span class="ident">elem_size</span>; <span class="ident">alloc_guard</span>(<span class="ident">new_alloc_size</span>); <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="ident">heap</span>::<span class="ident">reallocate</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">new_alloc_size</span>, <span class="ident">align</span>); (<span class="ident">new_cap</span>, <span class="ident">ptr</span>) }; <span class="comment">// If allocate or reallocate fail, we'll get `null` back</span> <span class="kw">if</span> <span class="ident">ptr</span>.<span class="ident">is_null</span>() { <span class="ident">oom</span>() } <span class="self">self</span>.<span class="ident">ptr</span> <span class="op">=</span> <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span> <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _); <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">new_cap</span>; } } <span class="doccomment">/// Attempts to double the size of the type's backing allocation in place. This is common</span> <span class="doccomment">/// enough to want to do that it's easiest to just have a dedicated method. Slightly</span> <span class="doccomment">/// more efficient logic can be provided for this than the general case.</span> <span class="doccomment">///</span> <span class="doccomment">/// Returns true if the reallocation attempt has succeeded, or false otherwise.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if T is zero-sized on the assumption that you managed to exhaust</span> <span class="doccomment">/// all `usize::MAX` slots in your imaginary buffer.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="attribute">#[<span class="ident">inline</span>(<span class="ident">never</span>)]</span> <span class="attribute">#[<span class="ident">cold</span>]</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">double_in_place</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>) <span class="op">-></span> <span class="ident">bool</span> { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// since we set the capacity to usize::MAX when elem_size is</span> <span class="comment">// 0, getting to here necessarily means the RawVec is overfull.</span> <span class="macro">assert</span><span class="macro">!</span>(<span class="ident">elem_size</span> <span class="op">!=</span> <span class="number">0</span>, <span class="string">"capacity overflow"</span>); <span class="comment">// Since we guarantee that we never allocate more than isize::MAX bytes,</span> <span class="comment">// `elem_size * self.cap <= isize::MAX` as a precondition, so this can't overflow</span> <span class="kw">let</span> <span class="ident">new_cap</span> <span class="op">=</span> <span class="number">2</span> <span class="op">*</span> <span class="self">self</span>.<span class="ident">cap</span>; <span class="kw">let</span> <span class="ident">new_alloc_size</span> <span class="op">=</span> <span class="ident">new_cap</span> <span class="op">*</span> <span class="ident">elem_size</span>; <span class="ident">alloc_guard</span>(<span class="ident">new_alloc_size</span>); <span class="kw">let</span> <span class="ident">size</span> <span class="op">=</span> <span class="ident">heap</span>::<span class="ident">reallocate_inplace</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">new_alloc_size</span>, <span class="ident">align</span>); <span class="kw">if</span> <span class="ident">size</span> <span class="op">>=</span> <span class="ident">new_alloc_size</span> { <span class="comment">// We can't directly divide `size`.</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">new_cap</span>; } <span class="ident">size</span> <span class="op">>=</span> <span class="ident">new_alloc_size</span> } } <span class="doccomment">/// Ensures that the buffer contains at least enough space to hold</span> <span class="doccomment">/// `used_cap + needed_extra_cap` elements. If it doesn't already,</span> <span class="doccomment">/// will reallocate the minimum possible amount of memory necessary.</span> <span class="doccomment">/// Generally this will be exactly the amount of memory necessary,</span> <span class="doccomment">/// but in principle the allocator is free to give back more than</span> <span class="doccomment">/// we asked for.</span> <span class="doccomment">///</span> <span class="doccomment">/// If `used_cap` exceeds `self.cap()`, this may fail to actually allocate</span> <span class="doccomment">/// the requested space. This is not really unsafe, but the unsafe</span> <span class="doccomment">/// code *you* write that relies on the behavior of this function may break.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if the requested capacity exceeds `usize::MAX` bytes.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Aborts</span> <span class="doccomment">///</span> <span class="doccomment">/// Aborts on OOM</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">reserve_exact</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>, <span class="ident">used_cap</span>: <span class="ident">usize</span>, <span class="ident">needed_extra_cap</span>: <span class="ident">usize</span>) { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// NOTE: we don't early branch on ZSTs here because we want this</span> <span class="comment">// to actually catch "asking for more than usize::MAX" in that case.</span> <span class="comment">// If we make it past the first branch then we are guaranteed to</span> <span class="comment">// panic.</span> <span class="comment">// Don't actually need any more capacity.</span> <span class="comment">// Wrapping in case they gave a bad `used_cap`.</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span>().<span class="ident">wrapping_sub</span>(<span class="ident">used_cap</span>) <span class="op">>=</span> <span class="ident">needed_extra_cap</span> { <span class="kw">return</span>; } <span class="comment">// Nothing we can really do about these checks :(</span> <span class="kw">let</span> <span class="ident">new_cap</span> <span class="op">=</span> <span class="ident">used_cap</span>.<span class="ident">checked_add</span>(<span class="ident">needed_extra_cap</span>).<span class="ident">expect</span>(<span class="string">"capacity overflow"</span>); <span class="kw">let</span> <span class="ident">new_alloc_size</span> <span class="op">=</span> <span class="ident">new_cap</span>.<span class="ident">checked_mul</span>(<span class="ident">elem_size</span>).<span class="ident">expect</span>(<span class="string">"capacity overflow"</span>); <span class="ident">alloc_guard</span>(<span class="ident">new_alloc_size</span>); <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">==</span> <span class="number">0</span> { <span class="ident">heap</span>::<span class="ident">allocate</span>(<span class="ident">new_alloc_size</span>, <span class="ident">align</span>) } <span class="kw">else</span> { <span class="ident">heap</span>::<span class="ident">reallocate</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">new_alloc_size</span>, <span class="ident">align</span>) }; <span class="comment">// If allocate or reallocate fail, we'll get `null` back</span> <span class="kw">if</span> <span class="ident">ptr</span>.<span class="ident">is_null</span>() { <span class="ident">oom</span>() } <span class="self">self</span>.<span class="ident">ptr</span> <span class="op">=</span> <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span> <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _); <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">new_cap</span>; } } <span class="doccomment">/// Calculates the buffer's new size given that it'll hold `used_cap +</span> <span class="doccomment">/// needed_extra_cap` elements. This logic is used in amortized reserve methods.</span> <span class="doccomment">/// Returns `(new_capacity, new_alloc_size)`.</span> <span class="kw">fn</span> <span class="ident">amortized_new_size</span>(<span class="kw-2">&</span><span class="self">self</span>, <span class="ident">used_cap</span>: <span class="ident">usize</span>, <span class="ident">needed_extra_cap</span>: <span class="ident">usize</span>) <span class="op">-></span> (<span class="ident">usize</span>, <span class="ident">usize</span>) { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// Nothing we can really do about these checks :(</span> <span class="kw">let</span> <span class="ident">required_cap</span> <span class="op">=</span> <span class="ident">used_cap</span>.<span class="ident">checked_add</span>(<span class="ident">needed_extra_cap</span>) .<span class="ident">expect</span>(<span class="string">"capacity overflow"</span>); <span class="comment">// Cannot overflow, because `cap <= isize::MAX`, and type of `cap` is `usize`.</span> <span class="kw">let</span> <span class="ident">double_cap</span> <span class="op">=</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="number">2</span>; <span class="comment">// `double_cap` guarantees exponential growth.</span> <span class="kw">let</span> <span class="ident">new_cap</span> <span class="op">=</span> <span class="ident">cmp</span>::<span class="ident">max</span>(<span class="ident">double_cap</span>, <span class="ident">required_cap</span>); <span class="kw">let</span> <span class="ident">new_alloc_size</span> <span class="op">=</span> <span class="ident">new_cap</span>.<span class="ident">checked_mul</span>(<span class="ident">elem_size</span>).<span class="ident">expect</span>(<span class="string">"capacity overflow"</span>); (<span class="ident">new_cap</span>, <span class="ident">new_alloc_size</span>) } <span class="doccomment">/// Ensures that the buffer contains at least enough space to hold</span> <span class="doccomment">/// `used_cap + needed_extra_cap` elements. If it doesn't already have</span> <span class="doccomment">/// enough capacity, will reallocate enough space plus comfortable slack</span> <span class="doccomment">/// space to get amortized `O(1)` behavior. Will limit this behavior</span> <span class="doccomment">/// if it would needlessly cause itself to panic.</span> <span class="doccomment">///</span> <span class="doccomment">/// If `used_cap` exceeds `self.cap()`, this may fail to actually allocate</span> <span class="doccomment">/// the requested space. This is not really unsafe, but the unsafe</span> <span class="doccomment">/// code *you* write that relies on the behavior of this function may break.</span> <span class="doccomment">///</span> <span class="doccomment">/// This is ideal for implementing a bulk-push operation like `extend`.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if the requested capacity exceeds `usize::MAX` bytes.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Aborts</span> <span class="doccomment">///</span> <span class="doccomment">/// Aborts on OOM</span> <span class="doccomment">///</span> <span class="doccomment">/// # Examples</span> <span class="doccomment">///</span> <span class="doccomment">/// ```ignore</span> <span class="doccomment">/// struct MyVec<T> {</span> <span class="doccomment">/// buf: RawVec<T>,</span> <span class="doccomment">/// len: usize,</span> <span class="doccomment">/// }</span> <span class="doccomment">///</span> <span class="doccomment">/// impl<T> MyVec<T> {</span> <span class="doccomment">/// pub fn push_all(&mut self, elems: &[T]) {</span> <span class="doccomment">/// self.buf.reserve(self.len, elems.len());</span> <span class="doccomment">/// // reserve would have aborted or panicked if the len exceeded</span> <span class="doccomment">/// // `isize::MAX` so this is safe to do unchecked now.</span> <span class="doccomment">/// for x in elems {</span> <span class="doccomment">/// unsafe {</span> <span class="doccomment">/// ptr::write(self.buf.ptr().offset(self.len as isize), x.clone());</span> <span class="doccomment">/// }</span> <span class="doccomment">/// self.len += 1;</span> <span class="doccomment">/// }</span> <span class="doccomment">/// }</span> <span class="doccomment">/// }</span> <span class="doccomment">/// ```</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">reserve</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>, <span class="ident">used_cap</span>: <span class="ident">usize</span>, <span class="ident">needed_extra_cap</span>: <span class="ident">usize</span>) { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// NOTE: we don't early branch on ZSTs here because we want this</span> <span class="comment">// to actually catch "asking for more than usize::MAX" in that case.</span> <span class="comment">// If we make it past the first branch then we are guaranteed to</span> <span class="comment">// panic.</span> <span class="comment">// Don't actually need any more capacity.</span> <span class="comment">// Wrapping in case they give a bad `used_cap`</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span>().<span class="ident">wrapping_sub</span>(<span class="ident">used_cap</span>) <span class="op">>=</span> <span class="ident">needed_extra_cap</span> { <span class="kw">return</span>; } <span class="kw">let</span> (<span class="ident">new_cap</span>, <span class="ident">new_alloc_size</span>) <span class="op">=</span> <span class="self">self</span>.<span class="ident">amortized_new_size</span>(<span class="ident">used_cap</span>, <span class="ident">needed_extra_cap</span>); <span class="comment">// FIXME: may crash and burn on over-reserve</span> <span class="ident">alloc_guard</span>(<span class="ident">new_alloc_size</span>); <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">==</span> <span class="number">0</span> { <span class="ident">heap</span>::<span class="ident">allocate</span>(<span class="ident">new_alloc_size</span>, <span class="ident">align</span>) } <span class="kw">else</span> { <span class="ident">heap</span>::<span class="ident">reallocate</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">new_alloc_size</span>, <span class="ident">align</span>) }; <span class="comment">// If allocate or reallocate fail, we'll get `null` back</span> <span class="kw">if</span> <span class="ident">ptr</span>.<span class="ident">is_null</span>() { <span class="ident">oom</span>() } <span class="self">self</span>.<span class="ident">ptr</span> <span class="op">=</span> <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span> <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _); <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">new_cap</span>; } } <span class="doccomment">/// Attempts to ensure that the buffer contains at least enough space to hold</span> <span class="doccomment">/// `used_cap + needed_extra_cap` elements. If it doesn't already have</span> <span class="doccomment">/// enough capacity, will reallocate in place enough space plus comfortable slack</span> <span class="doccomment">/// space to get amortized `O(1)` behaviour. Will limit this behaviour</span> <span class="doccomment">/// if it would needlessly cause itself to panic.</span> <span class="doccomment">///</span> <span class="doccomment">/// If `used_cap` exceeds `self.cap()`, this may fail to actually allocate</span> <span class="doccomment">/// the requested space. This is not really unsafe, but the unsafe</span> <span class="doccomment">/// code *you* write that relies on the behaviour of this function may break.</span> <span class="doccomment">///</span> <span class="doccomment">/// Returns true if the reallocation attempt has succeeded, or false otherwise.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// * Panics if the requested capacity exceeds `usize::MAX` bytes.</span> <span class="doccomment">/// * Panics on 32-bit platforms if the requested capacity exceeds</span> <span class="doccomment">/// `isize::MAX` bytes.</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">reserve_in_place</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>, <span class="ident">used_cap</span>: <span class="ident">usize</span>, <span class="ident">needed_extra_cap</span>: <span class="ident">usize</span>) <span class="op">-></span> <span class="ident">bool</span> { <span class="kw">unsafe</span> { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// NOTE: we don't early branch on ZSTs here because we want this</span> <span class="comment">// to actually catch "asking for more than usize::MAX" in that case.</span> <span class="comment">// If we make it past the first branch then we are guaranteed to</span> <span class="comment">// panic.</span> <span class="comment">// Don't actually need any more capacity. If the current `cap` is 0, we can't</span> <span class="comment">// reallocate in place.</span> <span class="comment">// Wrapping in case they give a bad `used_cap`</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span>().<span class="ident">wrapping_sub</span>(<span class="ident">used_cap</span>) <span class="op">>=</span> <span class="ident">needed_extra_cap</span> <span class="op">||</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">==</span> <span class="number">0</span> { <span class="kw">return</span> <span class="bool-val">false</span>; } <span class="kw">let</span> (_, <span class="ident">new_alloc_size</span>) <span class="op">=</span> <span class="self">self</span>.<span class="ident">amortized_new_size</span>(<span class="ident">used_cap</span>, <span class="ident">needed_extra_cap</span>); <span class="comment">// FIXME: may crash and burn on over-reserve</span> <span class="ident">alloc_guard</span>(<span class="ident">new_alloc_size</span>); <span class="kw">let</span> <span class="ident">size</span> <span class="op">=</span> <span class="ident">heap</span>::<span class="ident">reallocate_inplace</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">new_alloc_size</span>, <span class="ident">align</span>); <span class="kw">if</span> <span class="ident">size</span> <span class="op">>=</span> <span class="ident">new_alloc_size</span> { <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">new_alloc_size</span> <span class="op">/</span> <span class="ident">elem_size</span>; } <span class="ident">size</span> <span class="op">>=</span> <span class="ident">new_alloc_size</span> } } <span class="doccomment">/// Shrinks the allocation down to the specified amount. If the given amount</span> <span class="doccomment">/// is 0, actually completely deallocates.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Panics</span> <span class="doccomment">///</span> <span class="doccomment">/// Panics if the given amount is *larger* than the current capacity.</span> <span class="doccomment">///</span> <span class="doccomment">/// # Aborts</span> <span class="doccomment">///</span> <span class="doccomment">/// Aborts on OOM.</span> <span class="kw">pub</span> <span class="kw">fn</span> <span class="ident">shrink_to_fit</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>, <span class="ident">amount</span>: <span class="ident">usize</span>) { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="comment">// Set the `cap` because they might be about to promote to a `Box<[T]>`</span> <span class="kw">if</span> <span class="ident">elem_size</span> <span class="op">==</span> <span class="number">0</span> { <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">amount</span>; <span class="kw">return</span>; } <span class="comment">// This check is my waterloo; it's the only thing Vec wouldn't have to do.</span> <span class="macro">assert</span><span class="macro">!</span>(<span class="self">self</span>.<span class="ident">cap</span> <span class="op">>=</span> <span class="ident">amount</span>, <span class="string">"Tried to shrink to a larger capacity"</span>); <span class="kw">if</span> <span class="ident">amount</span> <span class="op">==</span> <span class="number">0</span> { <span class="ident">mem</span>::<span class="ident">replace</span>(<span class="self">self</span>, <span class="ident">RawVec</span>::<span class="ident">new</span>()); } <span class="kw">else</span> <span class="kw">if</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">!=</span> <span class="ident">amount</span> { <span class="kw">unsafe</span> { <span class="comment">// Overflow check is unnecessary as the vector is already at</span> <span class="comment">// least this large.</span> <span class="kw">let</span> <span class="ident">ptr</span> <span class="op">=</span> <span class="ident">heap</span>::<span class="ident">reallocate</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _, <span class="self">self</span>.<span class="ident">cap</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">amount</span> <span class="op">*</span> <span class="ident">elem_size</span>, <span class="ident">align</span>); <span class="kw">if</span> <span class="ident">ptr</span>.<span class="ident">is_null</span>() { <span class="ident">oom</span>() } <span class="self">self</span>.<span class="ident">ptr</span> <span class="op">=</span> <span class="ident">Unique</span>::<span class="ident">new</span>(<span class="ident">ptr</span> <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> _); } <span class="self">self</span>.<span class="ident">cap</span> <span class="op">=</span> <span class="ident">amount</span>; } } <span class="doccomment">/// Converts the entire buffer into `Box<[T]>`.</span> <span class="doccomment">///</span> <span class="doccomment">/// While it is not *strictly* Undefined Behavior to call</span> <span class="doccomment">/// this procedure while some of the RawVec is uninitialized,</span> <span class="doccomment">/// it certainly makes it trivial to trigger it.</span> <span class="doccomment">///</span> <span class="doccomment">/// Note that this will correctly reconstitute any `cap` changes</span> <span class="doccomment">/// that may have been performed. (see description of type for details)</span> <span class="kw">pub</span> <span class="kw">unsafe</span> <span class="kw">fn</span> <span class="ident">into_box</span>(<span class="self">self</span>) <span class="op">-></span> <span class="ident">Box</span><span class="op"><</span>[<span class="ident">T</span>]<span class="op">></span> { <span class="comment">// NOTE: not calling `cap()` here, actually using the real `cap` field!</span> <span class="kw">let</span> <span class="ident">slice</span> <span class="op">=</span> <span class="ident">slice</span>::<span class="ident">from_raw_parts_mut</span>(<span class="self">self</span>.<span class="ident">ptr</span>(), <span class="self">self</span>.<span class="ident">cap</span>); <span class="kw">let</span> <span class="ident">output</span>: <span class="ident">Box</span><span class="op"><</span>[<span class="ident">T</span>]<span class="op">></span> <span class="op">=</span> <span class="ident">Box</span>::<span class="ident">from_raw</span>(<span class="ident">slice</span>); <span class="ident">mem</span>::<span class="ident">forget</span>(<span class="self">self</span>); <span class="ident">output</span> } } <span class="kw">unsafe</span> <span class="kw">impl</span><span class="op"><</span><span class="attribute">#[<span class="ident">may_dangle</span>]</span> <span class="ident">T</span><span class="op">></span> <span class="ident">Drop</span> <span class="kw">for</span> <span class="ident">RawVec</span><span class="op"><</span><span class="ident">T</span><span class="op">></span> { <span class="doccomment">/// Frees the memory owned by the RawVec *without* trying to Drop its contents.</span> <span class="kw">fn</span> <span class="ident">drop</span>(<span class="kw-2">&</span><span class="kw-2">mut</span> <span class="self">self</span>) { <span class="kw">let</span> <span class="ident">elem_size</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">if</span> <span class="ident">elem_size</span> <span class="op">!=</span> <span class="number">0</span> <span class="op">&&</span> <span class="self">self</span>.<span class="ident">cap</span> <span class="op">!=</span> <span class="number">0</span> { <span class="kw">let</span> <span class="ident">align</span> <span class="op">=</span> <span class="ident">mem</span>::<span class="ident">align_of</span>::<span class="op"><</span><span class="ident">T</span><span class="op">></span>(); <span class="kw">let</span> <span class="ident">num_bytes</span> <span class="op">=</span> <span class="ident">elem_size</span> <span class="op">*</span> <span class="self">self</span>.<span class="ident">cap</span>; <span class="kw">unsafe</span> { <span class="ident">heap</span>::<span class="ident">deallocate</span>(<span class="self">self</span>.<span class="ident">ptr</span>() <span class="kw">as</span> <span class="kw-2">*</span><span class="kw-2">mut</span> <span class="ident">u8</span>, <span class="ident">num_bytes</span>, <span class="ident">align</span>); } } } } <span class="comment">// We need to guarantee the following:</span> <span class="comment">// * We don't ever allocate `> isize::MAX` byte-size objects</span> <span class="comment">// * We don't overflow `usize::MAX` and actually allocate too little</span> <span class="comment">//</span> <span class="comment">// On 64-bit we just need to check for overflow since trying to allocate</span> <span class="comment">// `> isize::MAX` bytes will surely fail. On 32-bit and 16-bit we need to add</span> <span class="comment">// an extra guard for this in case we're running on a platform which can use</span> <span class="comment">// all 4GB in user-space. e.g. PAE or x32</span> <span class="attribute">#[<span class="ident">inline</span>]</span> <span class="kw">fn</span> <span class="ident">alloc_guard</span>(<span class="ident">alloc_size</span>: <span class="ident">usize</span>) { <span class="kw">if</span> <span class="ident">mem</span>::<span class="ident">size_of</span>::<span class="op"><</span><span class="ident">usize</span><span class="op">></span>() <span class="op"><</span> <span class="number">8</span> { <span class="macro">assert</span><span class="macro">!</span>(<span class="ident">alloc_size</span> <span class="op"><=</span> ::<span class="ident">core</span>::<span class="ident">isize</span>::<span class="ident">MAX</span> <span class="kw">as</span> <span class="ident">usize</span>, <span class="string">"capacity overflow"</span>); } } <span class="attribute">#[<span class="ident">cfg</span>(<span class="ident">test</span>)]</span> <span class="kw">mod</span> <span class="ident">tests</span> { <span class="kw">use</span> <span class="kw">super</span>::<span class="kw-2">*</span>; <span class="attribute">#[<span class="ident">test</span>]</span> <span class="kw">fn</span> <span class="ident">reserve_does_not_overallocate</span>() { { <span class="kw">let</span> <span class="kw-2">mut</span> <span class="ident">v</span>: <span class="ident">RawVec</span><span class="op"><</span><span class="ident">u32</span><span class="op">></span> <span class="op">=</span> <span class="ident">RawVec</span>::<span class="ident">new</span>(); <span class="comment">// First `reserve` allocates like `reserve_exact`</span> <span class="ident">v</span>.<span class="ident">reserve</span>(<span class="number">0</span>, <span class="number">9</span>); <span class="macro">assert_eq</span><span class="macro">!</span>(<span class="number">9</span>, <span class="ident">v</span>.<span class="ident">cap</span>()); } { <span class="kw">let</span> <span class="kw-2">mut</span> <span class="ident">v</span>: <span class="ident">RawVec</span><span class="op"><</span><span class="ident">u32</span><span class="op">></span> <span class="op">=</span> <span class="ident">RawVec</span>::<span class="ident">new</span>(); <span class="ident">v</span>.<span class="ident">reserve</span>(<span class="number">0</span>, <span class="number">7</span>); <span class="macro">assert_eq</span><span class="macro">!</span>(<span class="number">7</span>, <span class="ident">v</span>.<span class="ident">cap</span>()); <span class="comment">// 97 if more than double of 7, so `reserve` should work</span> <span class="comment">// like `reserve_exact`.</span> <span class="ident">v</span>.<span class="ident">reserve</span>(<span class="number">7</span>, <span class="number">90</span>); <span class="macro">assert_eq</span><span class="macro">!</span>(<span class="number">97</span>, <span class="ident">v</span>.<span class="ident">cap</span>()); } { <span class="kw">let</span> <span class="kw-2">mut</span> <span class="ident">v</span>: <span class="ident">RawVec</span><span class="op"><</span><span class="ident">u32</span><span class="op">></span> <span class="op">=</span> <span class="ident">RawVec</span>::<span class="ident">new</span>(); <span class="ident">v</span>.<span class="ident">reserve</span>(<span class="number">0</span>, <span class="number">12</span>); <span class="macro">assert_eq</span><span class="macro">!</span>(<span class="number">12</span>, <span class="ident">v</span>.<span class="ident">cap</span>()); <span class="ident">v</span>.<span class="ident">reserve</span>(<span class="number">12</span>, <span class="number">3</span>); <span class="comment">// 3 is less than half of 12, so `reserve` must grow</span> <span class="comment">// exponentially. At the time of writing this test grow</span> <span class="comment">// factor is 2, so new capacity is 24, however, grow factor</span> <span class="comment">// of 1.5 is OK too. Hence `>= 18` in assert.</span> <span class="macro">assert</span><span class="macro">!</span>(<span class="ident">v</span>.<span class="ident">cap</span>() <span class="op">>=</span> <span class="number">12</span> <span class="op">+</span> <span class="number">12</span> <span class="op">/</span> <span class="number">2</span>); } } } </pre> </section> <section id='search' class="content hidden"></section> <section class="footer"></section> <aside id="help" class="hidden"> <div> <h1 class="hidden">Help</h1> <div class="shortcuts"> <h2>Keyboard Shortcuts</h2> <dl> <dt>?</dt> <dd>Show this help dialog</dd> <dt>S</dt> <dd>Focus the search field</dd> <dt>⇤</dt> <dd>Move up in search results</dd> <dt>⇥</dt> <dd>Move down in search results</dd> <dt>⏎</dt> <dd>Go to active search result</dd> <dt>+</dt> <dd>Collapse/expand all sections</dd> </dl> </div> <div class="infos"> <h2>Search Tricks</h2> <p> Prefix searches with a type followed by a colon (e.g. <code>fn:</code>) to restrict the search to a given type. </p> <p> Accepted types are: <code>fn</code>, <code>mod</code>, <code>struct</code>, <code>enum</code>, <code>trait</code>, <code>type</code>, <code>macro</code>, and <code>const</code>. </p> <p> Search functions by type signature (e.g. <code>vec -> usize</code> or <code>* -> vec</code>) </p> </div> </div> </aside> <script> window.rootPath = "../../"; window.currentCrate = "alloc"; </script> <script src="../../main.js"></script> <script defer src="../../search-index.js"></script> </body> </html>