-
Notifications
You must be signed in to change notification settings - Fork 327
[ChatQnA] Enable Prometheus and Grafana with telemetry docker compose file. #1623
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
louie-tsai
merged 3 commits into
opea-project:main
from
intel-ai-tce:grafana_prometheus_docker
Mar 14, 2025
Merged
[ChatQnA] Enable Prometheus and Grafana with telemetry docker compose file. #1623
louie-tsai
merged 3 commits into
opea-project:main
from
intel-ai-tce:grafana_prometheus_docker
Mar 14, 2025
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Dependency Review✅ No vulnerabilities or license issues found.Scanned Files |
d8ca008 to
70a23ee
Compare
9 tasks
70a23ee to
2864f3c
Compare
7 tasks
Spycsh
reviewed
Mar 10, 2025
Spycsh
reviewed
Mar 10, 2025
Collaborator
Author
|
also faced an issue for ChatQnA megaservice Dashboard. |
939b40e to
94a431e
Compare
lvliang-intel
approved these changes
Mar 12, 2025
94a431e to
4a70432
Compare
yinghu5
approved these changes
Mar 13, 2025
Collaborator
yinghu5
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM,thank you!
Collaborator
Author
|
@chensuyue |
lianhao
reviewed
Mar 14, 2025
4c7bf3d to
186e549
Compare
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
186e549 to
7903678
Compare
Collaborator
has been fixed in the main branch. |
Merged
4 tasks
Yongbozzz
pushed a commit
to Yongbozzz/GenAIExamples
that referenced
this pull request
Mar 18, 2025
… file. (opea-project#1623) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Zhu, Yongbo <yongbo.zhu@intel.com>
chyundunovDatamonsters
pushed a commit
to chyundunovDatamonsters/OPEA-GenAIExamples
that referenced
this pull request
Mar 21, 2025
… file. (opea-project#1623) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters
pushed a commit
to chyundunovDatamonsters/OPEA-GenAIExamples
that referenced
this pull request
Apr 1, 2025
… file. (opea-project#1623) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters
pushed a commit
to chyundunovDatamonsters/OPEA-GenAIExamples
that referenced
this pull request
Apr 1, 2025
… file. (opea-project#1623) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters
pushed a commit
to chyundunovDatamonsters/OPEA-GenAIExamples
that referenced
this pull request
May 16, 2025
… file. (opea-project#1623) Signed-off-by: Tsai, Louie <louie.tsai@intel.com> Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
letonghan
added a commit
that referenced
this pull request
Sep 17, 2025
Signed-off-by: letonghan <letong.han@intel.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.


Description
Even with this PR, all Dashboard are disabled by default.
Good to have Prometheus and Grafana for open telemetry metrics analysis.
Enabled those docker images under Telemetry features.
once users enable telemetry by below command, they will have all grafana and prometheus setup for them.
docker compose -f compose.yaml -f compose.telemetry.yaml up -dBy checking the http://host_ip:9090/targets, users will know how many telemetry services are exported to prometheus.

Then, users could see all the supported Dashboard in Grafana UI by checking http://host_ip:3000

The DashBoards including vLLM dashboard to help users understand all LLM serving performance details.

Also node exporter will give you the system information for system wise perf analysis.

Issues
n/a.Type of change
List the type of change like below. Please delete options that are not relevant.
Dependencies
grafana and prometheus
Tests
manually test on both Gaudi2 and Xeon