[Alerting] Phase 4 of AoA: Visualize and alert on available data

[chrisronline]

Meta: #120542

Once the data is available in Stack Monitoring indices, we need to decide how we want to use that data - what charts/UIs we want to build as well as deciding what out-of-the-box rules should exist to let users know when performance problems arise. We also need to figure out where this data can live - we need to be concerned with how Stack Monitoring data is stored and how it currently doesn’t leverage Kibana security and privileges. The best place is going to be the Stack Monitoring UI itself but other options are something we should consider.

Here is some sample screenshots from a PoC PR:

We should also add out of the box alerts within the Stack Monitoring system to automatically notify users when various thresholds are reached.

[elasticmachine]

Pinging @elastic/kibana-alerting-services (Team:Alerting Services)

[elasticmachine]

Pinging @elastic/response-ops (Team:ResponseOps)