Grafana alerting infrastructure

[GeorgianaElena]

Context

After we decide upon some metrics to setup alerting for and we create Grafana plots for them #1281, #1282 we will need to setup the actual alerting infrastructure, so that we get notified on a @2i2c.org address.

Ref: #328

Proposal

I suggest we setup the alerting infra as code, using grafonnet and upstream this work to jupyterhub/grafana-dashboards if the metrics we come up to, are of relevance outside of 2i2c. Also, we should decide what to do for the ones that would be only 2i2c-relevant, or not common enough for them to be in the jupyterhub org.

Updates and actions

No response

[GeorgianaElena]

Closing in favor of more specific issues about alerting.