Memory usage profiling support, code reduction refactor#158

Closed

Anindyadeep wants to merge 3 commits intomainfrom feat/memory-modular

Commits on Mar 11, 2024

moved bench_vllm under benchmark package
Anindyadeep
committed
LlamaBenchmarkBase class which will be inherited by all other implementations
Anindyadeep
committed
utils contain decorator functions to profile memory usage and latency
Anindyadeep
committed