File tree Expand file tree Collapse file tree 1 file changed +10
-0
lines changed
ChatQnA/docker_compose/intel/hpu/gaudi Expand file tree Collapse file tree 1 file changed +10
-0
lines changed Original file line number Diff line number Diff line change @@ -45,6 +45,12 @@ To set up environment variables for deploying ChatQnA services, follow these ste
4545docker compose up -d
4646```
4747
48+ To enable Open Telemetry Tracing, compose_telemetry.yaml file need to be merged along with default compose.yaml file.
49+
50+ ``` bash
51+ docker compose -f compose.yaml -f compose_telemetry.yaml up -d
52+ ```
53+
4854It will automatically download the docker image on ` docker hub ` :
4955
5056``` bash
@@ -259,12 +265,16 @@ If use vLLM as the LLM serving backend.
259265docker compose -f compose.yaml up -d
260266# Start ChatQnA without Rerank Pipeline
261267docker compose -f compose_without_rerank.yaml up -d
268+ # Start ChatQnA with Rerank Pipeline and Open Telemetry Tracing
269+ docker compose -f compose.yaml -f compose_telemetry.yaml up -d
262270` ` `
263271
264272If use TGI as the LLM serving backend.
265273
266274` ` ` bash
267275docker compose -f compose_tgi.yaml up -d
276+ # Start ChatQnA with Open Telemetry Tracing
277+ docker compose -f compose_tgi.yaml -f compose_tgi_telemetry.yaml up -d
268278` ` `
269279
270280If you want to enable guardrails microservice in the pipeline, please follow the below command instead:
You can’t perform that action at this time.
0 commit comments