Include all the metricsets to Metricbeat collected monitoring data

[fdartayre]

When shipping metrics with Stack monitoring, include all the metricsets in the Elasticsearch module of Metricbeat.

Today only a subset is configured. As a result, the ingest pipelines view in Stack monitoring is empty for example.

[pebrc]

We need to make this version specific as this metricset seems to exist only since 8.7

[gui-elastic]

Hello,

I have a question. Should this be considered a bug or an enhancement request? I am asking that because this problem really impacts any attempt to monitor Ingest Pipeline if you use an ECK cluster monitored using the ECK Stack Monitoring.

The workaround I found for this situation was to configure custom args for the Metricbeat container by following the steps described here.

The final workaround would be as in the example below:

    podTemplate:
      spec:
        containers:
        - name: metricbeat
          args: 
          - "-c"
          - "/etc/metricbeat-config/metricbeat.yml"
          - "-E" 
          - "metricbeat.modules=[{module: elasticsearch, metricsets: ['node', 'node_stats', 'ccr', 'cluster_stats', 'enrich', 'index', 'index_recovery', 'index_summary', 'ml_job', 'shard', 'ingest_pipeline']}]"
          - "-e"