feat: Add OpenAI-Compatible Server to NGC Container#7894

Closed

rmccorm4 wants to merge 10 commits intor24.12from rmccormick/openai/container

+74-29

Commits on Dec 9, 2024

fix: gRPC segfault due to Low Request Cancellation Timeout (#7840 )
yinggeh
authored

Commits on Dec 10, 2024

ci: RHEL8 L0_backend_python Support (#7859 )

fpetrini15
and
nv-kmcgill53
authored

Commits on Dec 11, 2024

installing openai frontend in the base, vllm, trt-llm container
nv-kmcgill53
committed
identifying the correct directory to copy in the container
nv-kmcgill53
committed

Commits on Dec 12, 2024

remove installing openai frontend as it should already be installed
nv-kmcgill53
committed