Monitoring metrics in Dapr self-hosted mode

[MernaMustafa]

I'm trying to monitor metrics using Prometheus and Grafana in self-hosted mode, but I encountered some unexpected behaviors

What I did:

1. Ran the application in self-hosted mode as described in the readme.md file, with adding --metrics-port for each service to a specific port
2. Included the Dapr metrics ports used in the Prometheus configuration.
3. Imported the JSON files for dashboards into Grafana.

Result

1. Most charts appear empty, with only four displaying data
2. The VehicleRegistrationService is not recognized within the metrics.
3. The count of initialized components does not match the count of loaded components

Any idea what I've done wrong or what I'm missing?

Screenshots:

Prometheus

Dapr Sidecar Dashboard

Dapr System Services Dashboard

[EdwinVW]

Hi @MernaMustafa. Thanks for your interest in the sample app!

First question I have is whether you have imported the Grafana dashboard definitions (.JSON files) from the repository. These files change over time, and you need to get the ones that belong to the release of Dapr you are running. You need to click the 'Show all assets' link below the assets list. If not, please make sure you have used the correct dashboard definitions and try again. I will remove them from the repo and add a readme to clarify this.

If services do not show up in the dashboards, please make sure they are receiving traffic. If they don't receive any traffic, no metrics will be available for the service and it will not show up in the dashboards.

I hope this helps.