-
Notifications
You must be signed in to change notification settings - Fork 428
Performance Metrics
Dimitrii Voronin edited this page Jun 27, 2024
·
9 revisions
All speed test were run on AMD Ryzen Threadripper 3960X using only 1 thread and batch size equal to 1, 16000 sampling rate:
torch.set_num_threads(1) # JIT
session.intra_op_num_threads = 1 # ONNX
session.inter_op_num_threads = 1 # ONNX
RTS - seconds of audio processed per second, real time speed, or inverse RTF
Single chunk (31.25 ms) processing speed, μs | RTS | Model |
---|---|---|
830 | 36 | V4 JIT |
207 | 151 | V4 ONNX |
325 | 96 | V5 JIT |
189 | 165 | V5 ONNX |
This represents the most common use case, but with batch size > 1 metrics can be even more impressive.