Labels not discovered from Prometheus -> Grafana

[sebastian-gott]

Hi!

I am having an issue with labels defined in the Confluent Platform example dashboard being discoverable in Prometheus, but not in Grafana. The example in this repo.

We are running CFK on AKS where Prometheus scrapes the metrics that gets picked up by Grafana.

The specific labels that can not be found in Grafana are "platform_confluent_io_type" and "app". These labels however are discoverable if I search for them in Prometheus and they are defined in the Kubernetes resource definition. I noticed in another issue someone mentioned changing "kubernetes_namespace" to just "namespace" which works.