Is is possible to run text-generation-benchmark using docker?

[swapnil3597]

Please provide the command to run text-generation-benchmark using docker if possible to do so.

[swapnil3597]

Figured out a way to do it,

Once you have docker container for TGI running in detach mode, exec bash inside the container using command,

docker exec -it <CONTAINER ID> bash

Once you are inside the container, run text generation benchmark using command,

text-generation-benchmark --tokenizer-name <TOKENIZER_NAME>