Skip to content

Commit

Permalink
docs: auto generated by furiosa-sdk-private#699
Browse files Browse the repository at this point in the history
  • Loading branch information
furiosa-infra committed Aug 3, 2023
1 parent 4736aee commit 555c6de
Show file tree
Hide file tree
Showing 61 changed files with 289 additions and 166 deletions.
5 changes: 3 additions & 2 deletions v0.10.0/en/_sources/software/cli.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -191,11 +191,12 @@ The following is an example usage of furiosa-bench without an output path option
99th percentile (us): 79874
99th percentile (us): 307568
If an output path is specified, furiosa-bench will save a json document as the following:
If an output path is specified, furiosa-bench will save a JSON document as the following:

.. code-block:: sh
$ furiosa-bench mnist-8.onnx --workload L -n 1000 -w 8 -t 2 -o mnist.json | cat mnist.json
$ furiosa-bench mnist-8.onnx --workload L -n 1000 -w 8 -t 2 -o mnist.json
$ cat mnist.json
{
"model_data": {
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/_sources/software/compiler.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ The usage of ``furiosa-compiler`` is as the following:
``SOURCE`` is the file path of
`TFLite <https://www.tensorflow.org/lite>`_ or `Onnx <https://onnx.ai/>`_.
`TFLite <https://www.tensorflow.org/lite>`_ or `ONNX <https://onnx.ai/>`_.
You have to use quantized models through :ref:`ModelQuantization` for NPU accleration.

You can omit the option `-o OUTPUT`, and you can also choose to designate the output file name.
Expand Down
6 changes: 3 additions & 3 deletions v0.10.0/en/_sources/software/profiler.rst.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
.. _Profiling:

***********************************
Performance profiling
Performance Profiling
***********************************

Low latency and high throughput performance are critical factors in many DNN applications.
Expand All @@ -19,7 +19,7 @@ It is thus not enabled by default. You can create trace by using one of the foll

.. _ProfilerEnabledByEnv:

Tracing Enabled by Environmet Variable
Tracing via Environment Variable
============================================================
You can enable trace generation by setting the path of the file to which the trace result will be written in ``FURIOSA_PROFILER_OUTPUT_PATH``. The advantage of this method is that the code remains unchanged. The downside is that you cannot set a specific section or category for measurement.

Expand Down Expand Up @@ -51,7 +51,7 @@ If you enter ``chrome://tracing`` in Chrome's address bar, the trace viewer will

.. _ProfilerEnabledByContext:

Tracing Enabled by Profiler Context
Tracing via Profiler Context
============================================================
You can also trace a model inference performance by using a Profiler Context in your Python code. The advantages of this method, in comparison to the tracing by environment variable, are as follows:

Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.common.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.common.transport.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.optimizer.frontend.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.optimizer.frontend.onnx.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.optimizer.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.optimizer.interfaces.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.quantizer.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.runtime.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.api.cli.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.api.grpc.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.api.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.api.rest.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.handlers.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
2 changes: 1 addition & 1 deletion v0.10.0/en/api/python/furiosa.server.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
<li class="toctree-l1"><a class="reference internal" href="../../software/cli.html">Command Line Tools</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/compiler.html">Compiler</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/quantization.html">Model Quantization</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance profiling</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/profiler.html">Performance Profiling</a></li>
<li class="toctree-l1"><a class="reference external" href="https://furiosa-ai.github.io/furiosa-models/latest/">FuriosaAI Model Zoo</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/serving.html">Model Server (Serving Framework)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../../software/kubernetes_support.html">Kubernetes Support</a></li>
Expand Down
Loading

0 comments on commit 555c6de

Please sign in to comment.