Skip to content

Conversation

@louie-tsai
Copy link
Collaborator

@louie-tsai louie-tsai commented Mar 6, 2025

Description

Even with this PR, all Dashboard are disabled by default.
Good to have Prometheus and Grafana for open telemetry metrics analysis.
Enabled those docker images under Telemetry features.
once users enable telemetry by below command, they will have all grafana and prometheus setup for them.
docker compose -f compose.yaml -f compose.telemetry.yaml up -d

By checking the http://host_ip:9090/targets, users will know how many telemetry services are exported to prometheus.
Screenshot 2025-03-05 235801

Then, users could see all the supported Dashboard in Grafana UI by checking http://host_ip:3000
Screenshot 2025-03-05 175423

The DashBoards including vLLM dashboard to help users understand all LLM serving performance details.
Screenshot 2025-03-05 181826

Also node exporter will give you the system information for system wise perf analysis.
Screenshot 2025-03-05 181914

Issues

n/a.

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)
  • Others (enhancement, documentation, validation, etc.)

Dependencies

grafana and prometheus

Tests

manually test on both Gaudi2 and Xeon

@github-actions
Copy link

github-actions bot commented Mar 6, 2025

Dependency Review

✅ No vulnerabilities or license issues found.

Scanned Files

@louie-tsai louie-tsai requested a review from Spycsh March 10, 2025 19:05
@louie-tsai
Copy link
Collaborator Author

also faced an issue for ChatQnA megaservice Dashboard.
opea-project/GenAIEval#247

@louie-tsai louie-tsai force-pushed the grafana_prometheus_docker branch 5 times, most recently from 939b40e to 94a431e Compare March 12, 2025 04:27
@louie-tsai louie-tsai force-pushed the grafana_prometheus_docker branch from 94a431e to 4a70432 Compare March 13, 2025 05:00
Copy link
Collaborator

@yinghu5 yinghu5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM,thank you!

@yinghu5 yinghu5 added the A1 high prority label Mar 14, 2025
@louie-tsai
Copy link
Collaborator Author

@chensuyue
also need your help on this strange CI/CD issue
image

@louie-tsai louie-tsai force-pushed the grafana_prometheus_docker branch from 4c7bf3d to 186e549 Compare March 14, 2025 04:01
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
@louie-tsai louie-tsai force-pushed the grafana_prometheus_docker branch from 186e549 to 7903678 Compare March 14, 2025 04:19
@chensuyue
Copy link
Collaborator

@chensuyue also need your help on this strange CI/CD issue image

has been fixed in the main branch.

@louie-tsai louie-tsai merged commit 671dff7 into opea-project:main Mar 14, 2025
18 checks passed
Yongbozzz pushed a commit to Yongbozzz/GenAIExamples that referenced this pull request Mar 18, 2025
… file. (opea-project#1623)

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Zhu, Yongbo <yongbo.zhu@intel.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Mar 21, 2025
… file. (opea-project#1623)

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
… file. (opea-project#1623)

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request Apr 1, 2025
… file. (opea-project#1623)

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
chyundunovDatamonsters pushed a commit to chyundunovDatamonsters/OPEA-GenAIExamples that referenced this pull request May 16, 2025
… file. (opea-project#1623)

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: Chingis Yundunov <c.yundunov@datamonsters.com>
letonghan added a commit that referenced this pull request Sep 17, 2025
Signed-off-by: letonghan <letong.han@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A1 high prority

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants