Skip to content

Commit

Permalink
[Benchmark] Add async throughput benchmark
Browse files Browse the repository at this point in the history 
Like benchmark_throughput but using AsyncLLMEngine rather than LLM
  • Loading branch information
@njhill
njhill committed Aug 28, 2024
1 parent ef9baee commit a7a6e43
Show file tree
Hide file tree
Showing 2 changed files with 505 additions and 9 deletions.
Loading

0 comments on commit a7a6e43

Please sign in to comment.