Skip to content

Commit

Permalink
Deploying to gh-pages from @ 3fb29cc 🚀
Browse files Browse the repository at this point in the history
  • Loading branch information
EricLBuehler committed Feb 9, 2025
1 parent b54931c commit 8638a6d
Show file tree
Hide file tree
Showing 7 changed files with 192 additions and 184 deletions.
6 changes: 3 additions & 3 deletions mistralrs_quant/struct.ColumnParallelLayer.html

Large diffs are not rendered by default.

10 changes: 5 additions & 5 deletions mistralrs_quant/struct.ReplicatedLayer.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion mistralrs_quant/trait.QuantMethod.html
Original file line number Diff line number Diff line change
Expand Up @@ -45,4 +45,4 @@
This may go via half precision if it is supported.</p>
</div></details><section id="method.unquant_weight_bias" class="method"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#461-463">Source</a><h4 class="code-header">fn <a href="#method.unquant_weight_bias" class="fn">unquant_weight_bias</a>(&amp;self) -&gt; <a class="enum" href="https://doc.rust-lang.org/1.84.1/core/option/enum.Option.html" title="enum core::option::Option">Option</a>&lt;(Tensor, <a class="enum" href="https://doc.rust-lang.org/1.84.1/core/option/enum.Option.html" title="enum core::option::Option">Option</a>&lt;Tensor&gt;)&gt;</h4></section><details class="toggle method-toggle" open><summary><section id="method.begin_track_stats" class="method"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#466-468">Source</a><h4 class="code-header">fn <a href="#method.begin_track_stats" class="fn">begin_track_stats</a>(&amp;mut self) -&gt; Result&lt;<a class="primitive" href="https://doc.rust-lang.org/1.84.1/std/primitive.unit.html">()</a>&gt;</h4></section></summary><div class="docblock"><p>Begin tracking stats into an ImatrixLayerStats</p>
</div></details><details class="toggle method-toggle" open><summary><section id="method.end_track_stats" class="method"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#471-473">Source</a><h4 class="code-header">fn <a href="#method.end_track_stats" class="fn">end_track_stats</a>(&amp;self) -&gt; Result&lt;Tensor&gt;</h4></section></summary><div class="docblock"><p>End tracking stats into an ImatrixLayerStats. Returns the computed imatrix.</p>
</div></details></div><h2 id="trait-implementations" class="section-header">Trait Implementations<a href="#trait-implementations" class="anchor">§</a></h2><div id="trait-implementations-list"><details class="toggle implementors-toggle" open><summary><section id="impl-Module-for-dyn+QuantMethod" class="impl"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#476-480">Source</a><a href="#impl-Module-for-dyn+QuantMethod" class="anchor">§</a><h3 class="code-header">impl Module for dyn <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a></h3></section></summary><div class="impl-items"><section id="method.forward" class="method trait-impl"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#477-479">Source</a><a href="#method.forward" class="anchor">§</a><h4 class="code-header">fn <a class="fn">forward</a>(&amp;self, xs: &amp;Tensor) -&gt; Result&lt;Tensor&gt;</h4></section></div></details></div><h2 id="implementors" class="section-header">Implementors<a href="#implementors" class="anchor">§</a></h2><div id="implementors-list"><section id="impl-QuantMethod-for-BnbLinear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/bitsandbytes/mod.rs.html#201-269">Source</a><a href="#impl-QuantMethod-for-BnbLinear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.BnbLinear.html" title="struct mistralrs_quant::BnbLinear">BnbLinear</a></h3></section><section id="impl-QuantMethod-for-ColumnParallelLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#264-334">Source</a><a href="#impl-QuantMethod-for-ColumnParallelLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.ColumnParallelLayer.html" title="struct mistralrs_quant::ColumnParallelLayer">ColumnParallelLayer</a></h3></section><section id="impl-QuantMethod-for-DummyLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/dummy/mod.rs.html#8-45">Source</a><a href="#impl-QuantMethod-for-DummyLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.DummyLayer.html" title="struct mistralrs_quant::DummyLayer">DummyLayer</a></h3></section><section id="impl-QuantMethod-for-FP8Linear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/fp8/mod.rs.html#34-179">Source</a><a href="#impl-QuantMethod-for-FP8Linear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.FP8Linear.html" title="struct mistralrs_quant::FP8Linear">FP8Linear</a></h3></section><section id="impl-QuantMethod-for-GgufMatMul" class="impl"><a class="src rightside" href="../src/mistralrs_quant/gguf/mod.rs.html#27-152">Source</a><a href="#impl-QuantMethod-for-GgufMatMul" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.GgufMatMul.html" title="struct mistralrs_quant::GgufMatMul">GgufMatMul</a></h3></section><section id="impl-QuantMethod-for-GptqLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/gptq/gptq_cpu.rs.html#14-66">Source</a><a href="#impl-QuantMethod-for-GptqLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.GptqLayer.html" title="struct mistralrs_quant::GptqLayer">GptqLayer</a></h3></section><section id="impl-QuantMethod-for-HqqLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/hqq/mod.rs.html#520-635">Source</a><a href="#impl-QuantMethod-for-HqqLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.HqqLayer.html" title="struct mistralrs_quant::HqqLayer">HqqLayer</a></h3></section><section id="impl-QuantMethod-for-ReplicatedLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#407-464">Source</a><a href="#impl-QuantMethod-for-ReplicatedLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.ReplicatedLayer.html" title="struct mistralrs_quant::ReplicatedLayer">ReplicatedLayer</a></h3></section><section id="impl-QuantMethod-for-RowParallelLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#101-174">Source</a><a href="#impl-QuantMethod-for-RowParallelLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.RowParallelLayer.html" title="struct mistralrs_quant::RowParallelLayer">RowParallelLayer</a></h3></section><section id="impl-QuantMethod-for-UnquantLinear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/unquantized/mod.rs.html#28-287">Source</a><a href="#impl-QuantMethod-for-UnquantLinear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.UnquantLinear.html" title="struct mistralrs_quant::UnquantLinear">UnquantLinear</a></h3></section></div><script src="../trait.impl/mistralrs_quant/trait.QuantMethod.js" async></script></section></div></main></body></html>
</div></details></div><h2 id="trait-implementations" class="section-header">Trait Implementations<a href="#trait-implementations" class="anchor">§</a></h2><div id="trait-implementations-list"><details class="toggle implementors-toggle" open><summary><section id="impl-Module-for-dyn+QuantMethod" class="impl"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#476-480">Source</a><a href="#impl-Module-for-dyn+QuantMethod" class="anchor">§</a><h3 class="code-header">impl Module for dyn <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a></h3></section></summary><div class="impl-items"><section id="method.forward" class="method trait-impl"><a class="src rightside" href="../src/mistralrs_quant/lib.rs.html#477-479">Source</a><a href="#method.forward" class="anchor">§</a><h4 class="code-header">fn <a class="fn">forward</a>(&amp;self, xs: &amp;Tensor) -&gt; Result&lt;Tensor&gt;</h4></section></div></details></div><h2 id="implementors" class="section-header">Implementors<a href="#implementors" class="anchor">§</a></h2><div id="implementors-list"><section id="impl-QuantMethod-for-BnbLinear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/bitsandbytes/mod.rs.html#201-269">Source</a><a href="#impl-QuantMethod-for-BnbLinear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.BnbLinear.html" title="struct mistralrs_quant::BnbLinear">BnbLinear</a></h3></section><section id="impl-QuantMethod-for-ColumnParallelLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#264-338">Source</a><a href="#impl-QuantMethod-for-ColumnParallelLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.ColumnParallelLayer.html" title="struct mistralrs_quant::ColumnParallelLayer">ColumnParallelLayer</a></h3></section><section id="impl-QuantMethod-for-DummyLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/dummy/mod.rs.html#8-45">Source</a><a href="#impl-QuantMethod-for-DummyLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.DummyLayer.html" title="struct mistralrs_quant::DummyLayer">DummyLayer</a></h3></section><section id="impl-QuantMethod-for-FP8Linear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/fp8/mod.rs.html#34-179">Source</a><a href="#impl-QuantMethod-for-FP8Linear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.FP8Linear.html" title="struct mistralrs_quant::FP8Linear">FP8Linear</a></h3></section><section id="impl-QuantMethod-for-GgufMatMul" class="impl"><a class="src rightside" href="../src/mistralrs_quant/gguf/mod.rs.html#27-152">Source</a><a href="#impl-QuantMethod-for-GgufMatMul" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.GgufMatMul.html" title="struct mistralrs_quant::GgufMatMul">GgufMatMul</a></h3></section><section id="impl-QuantMethod-for-GptqLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/gptq/gptq_cpu.rs.html#14-66">Source</a><a href="#impl-QuantMethod-for-GptqLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.GptqLayer.html" title="struct mistralrs_quant::GptqLayer">GptqLayer</a></h3></section><section id="impl-QuantMethod-for-HqqLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/hqq/mod.rs.html#520-635">Source</a><a href="#impl-QuantMethod-for-HqqLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.HqqLayer.html" title="struct mistralrs_quant::HqqLayer">HqqLayer</a></h3></section><section id="impl-QuantMethod-for-ReplicatedLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#411-468">Source</a><a href="#impl-QuantMethod-for-ReplicatedLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.ReplicatedLayer.html" title="struct mistralrs_quant::ReplicatedLayer">ReplicatedLayer</a></h3></section><section id="impl-QuantMethod-for-RowParallelLayer" class="impl"><a class="src rightside" href="../src/mistralrs_quant/distributed/layers.rs.html#101-174">Source</a><a href="#impl-QuantMethod-for-RowParallelLayer" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.RowParallelLayer.html" title="struct mistralrs_quant::RowParallelLayer">RowParallelLayer</a></h3></section><section id="impl-QuantMethod-for-UnquantLinear" class="impl"><a class="src rightside" href="../src/mistralrs_quant/unquantized/mod.rs.html#28-287">Source</a><a href="#impl-QuantMethod-for-UnquantLinear" class="anchor">§</a><h3 class="code-header">impl <a class="trait" href="trait.QuantMethod.html" title="trait mistralrs_quant::QuantMethod">QuantMethod</a> for <a class="struct" href="struct.UnquantLinear.html" title="struct mistralrs_quant::UnquantLinear">UnquantLinear</a></h3></section></div><script src="../trait.impl/mistralrs_quant/trait.QuantMethod.js" async></script></section></div></main></body></html>
Loading

0 comments on commit 8638a6d

Please sign in to comment.