[Reporting] more data on reports generated in Kibana to help identify bottlenecks and failures

[AlonaNadler]

Requested by a customer who uses reporting extensively,
Currently, they have a difficult time to understand how long the report processing tooka and how many reports failed.
In addition in a per report aspect, they will like to be able to tell who is the user who submitted the job, which Kibana instance generated the job, and/or IP address/hostname (for report generation requested through Watcher). This information will help admins pin-point where requests for reporting are coming from.
we had a lot of trouble understanding from the limited log messages, what was happening with reporting. It would be better if we didn't need to dig into the logs and could simply view success/failure counts and processing latency to understand if there are any issues/bottlenecks with reporting.

[elasticmachine]

Pinging @elastic/kibana-reporting-services (Team:Reporting Services)

[tsullivan]

Hi, I hope the customer feels that these pain points are being noticeably improved on :)

We have done a lot of troubleshooting ourselves and found a few categories of common problems, which led us to putting in a lot of logging improvements, and self-checks at startup to warn or self-correct for any known issues. I can link to specific examples if you like.

In addition in a per report aspect, they will like to be able to tell who is the user who submitted the job, which Kibana instance generated the job, and/or IP address/hostname (for report generation requested through Watcher). This information will help admins pin-point where requests for reporting are coming from.

This request isn't something we've considered yet. I think what will get us there is having report jobs handled in Kibana as its own type of saved object, and have all saved objects in Kibana get these capabilities. Related: #21689

[elasticmachine]

Pinging @elastic/kibana-app-services (Team:AppServices)

[tsullivan]

Duplicate of #79793 - the first step towards providing monitoring of Reporting.