diff --git a/.github/workflows/test_turnkey.yml b/.github/workflows/test_turnkey.yml index ac4712c3..85497367 100644 --- a/.github/workflows/test_turnkey.yml +++ b/.github/workflows/test_turnkey.yml @@ -65,8 +65,7 @@ jobs: rm -rf ~/.cache/turnkey turnkey examples/cli/scripts/two_models.py rm -rf ~/.cache/turnkey - # TODO: sample.onnx test is commented because it throws an error in CI - # turnkey examples/cli/onnx/sample.onnx + turnkey examples/cli/onnx/hello_world.onnx # E2E tests cd test/ diff --git a/examples/cli/onnx/hello_world.onnx b/examples/cli/onnx/hello_world.onnx new file mode 100644 index 00000000..fb7d8781 Binary files /dev/null and b/examples/cli/onnx/hello_world.onnx differ diff --git a/examples/cli/onnx/sample.onnx b/examples/cli/onnx/sample.onnx deleted file mode 100644 index fd3676d3..00000000 --- a/examples/cli/onnx/sample.onnx +++ /dev/null @@ -1,3 +0,0 @@ -version https://git-lfs.github.com/spec/v1 -oid sha256:83fa7cc9761867250a047c13fcb65d83289382ad16b42ac2f2915774234a7afb -size 572 diff --git a/examples/cli/readme.md b/examples/cli/readme.md index 3787a86b..a181b3c6 100644 --- a/examples/cli/readme.md +++ b/examples/cli/readme.md @@ -214,28 +214,26 @@ multiple_invocations.py: ## ONNX Benchmarking -If you already happen to have an ONNX file, `turnkey` can benchmark it for you. We can demonstrate this with the ONNX file in `examples/cli/onnx/sample.onnx`. +If you already happen to have an ONNX file, `turnkey` can benchmark it for you. We can demonstrate this with the ONNX file in `examples/cli/onnx/hello_world.onnx`. Run the following command: ``` -turnkey onnx/sample.onnx +turnkey onnx/hello_world.onnx ``` To get a result like: ``` -Building "sample" - ✓ Receiving ONNX Model - ✓ Finishing up - -Woohoo! Saved to ~/turnkeyml/examples/cli/onnx/tmp_cache/sample - -Info: Benchmarking on local x86... - -Info: Performance of build sample on x86 device Intel(R) Xeon(R) CPU @ 2.20GHz is: - Mean Latency: 0.042 milliseconds (ms) - Throughput: 23921.9 inferences per second (IPS) +hello_world.onnx: + Model Type: ONNX File (.onnx) + Parameters: 60 (240.0 B) + Input Shape: 'x': (11,) + Hash: 17ecd07e + Build dir: /home/jfowers/.cache/turnkey/hello_world_17ecd07e + Status: Successfully benchmarked on AMD Ryzen 9 7940HS w/ Radeon 780M Graphics (ort v1.15.1) + Mean Latency: 0.007 milliseconds (ms) + Throughput: 152240.4 inferences per second (IPS) ``` # Thanks!