Skip to content

Commit

Permalink
Update port in set_env.sh for TGI endpoint (#649)
Browse files Browse the repository at this point in the history
  • Loading branch information
srinarayan-srikanthan authored Sep 3, 2024
1 parent 4c78f8c commit e5ec38c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion ChatQnA/docker/gaudi/set_env.sh
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ export RERANK_MODEL_ID="BAAI/bge-reranker-base"
export LLM_MODEL_ID="Intel/neural-chat-7b-v3-3"
export TEI_EMBEDDING_ENDPOINT="http://${host_ip}:8090"
export TEI_RERANKING_ENDPOINT="http://${host_ip}:8808"
export TGI_LLM_ENDPOINT="http://${host_ip}:8008"
export TGI_LLM_ENDPOINT="http://${host_ip}:8005"
export REDIS_URL="redis://${host_ip}:6379"
export INDEX_NAME="rag-redis"
export MEGA_SERVICE_HOST_IP=${host_ip}
Expand Down

0 comments on commit e5ec38c

Please sign in to comment.