[ILM] ILM configuration overwrite

[kuisathaverat]

I have detected that the ILM configuration is overwritten many times without modification by a user.

For confirmed bugs, please report:

• Version: 7.0.0-rc1, 7.0.0-rc2
• Operating System: Linus on k8s
• Steps to Reproduce:

• Starts a k8s cluster with Metricbeat and Packetbeat as daemonset, with the following output configuration

    output.elasticsearch:
      hosts: ['${ELASTICSEARCH_PROTO}://${ELASTICSEARCH_HOST:elasticsearch}:${ELASTICSEARCH_PORT:9200}']
      username: ${ELASTICSEARCH_USERNAME}
      password: ${ELASTICSEARCH_PASSWORD}
      index: "metricbeat-%{[agent.version]}-%{+yyyy.MM.dd}"
      ssl.enabled: true
      ssl.verification_mode: none
    xpack.monitoring.enabled: true
    setup.kibana.host: ${KIBANA_PROTO}://${KIBANA_HOST}:${KIBANA_PORT:5601}
    setup.kibana.username: ${KIBANA_USERNAME}
    setup.kibana.password: ${KIBANA_PASSWORD}
    setup.template.name: "metricbeat"
    setup.template.pattern: "metricbeat-*"
    setup.template.enabled: true
    setup.template.overwrite: true

    setup.template.overwrite: true
    xpack.monitoring.enabled: true
    queue.mem:
      events: 20000
    output.elasticsearch:
      hosts: ['${ELASTICSEARCH_PROTO}://${ELASTICSEARCH_HOST:elasticsearch}:${ELASTICSEARCH_PORT:9200}']
      username: ${ELASTICSEARCH_USERNAME}
      password: ${ELASTICSEARCH_PASSWORD}
      index: "packetbeat-%{[agent.version]}-%{+yyyy.MM.dd}"
      ssl.enabled: true
      ssl.verification_mode: none
      bulk_max_size: 2000
      worker: 2
      compression_level: 5
    xpack.monitoring.enabled: true
    setup.kibana.host: ${KIBANA_PROTO}://${KIBANA_HOST}:${KIBANA_PORT:5601}
    setup.kibana.username: ${KIBANA_USERNAME}
    setup.kibana.password: ${KIBANA_PASSWORD}
    setup.template.name: "packetbeat"
    setup.template.pattern: "packetbeat-*"
    setup.template.enabled: true
    setup.template.overwrite: true

[urso]

This was a bug in the release candidates. It should be fixed in the final 7.0.0 release.

[kuisathaverat]

@urso on 7.0.0 works as expected, but on 8.0.0-SNAPSHOT the issue is still there and Packetbeat overwrites the ILM configuration, Metricbeat works correctly on both versions.

[kuisathaverat]

Filebeat has the same issue

[Tsuweiquan]

Winlogbeat 7.0.1 has the same issue.

setup.ilm.overwrite: false overwrites the existing ilm policy.