Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change "filebeat.config.modules.enabled" to "true" #28769

Merged
merged 2 commits into from
Nov 23, 2021

Conversation

hubbleview
Copy link
Contributor

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is true.

Having it as false in filebeat.reference.yml is confusing.

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.
@hubbleview hubbleview added the docs label Nov 2, 2021
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Nov 2, 2021
@mergify
Copy link
Contributor

mergify bot commented Nov 2, 2021

This pull request does not have a backport label. Could you fix it @hubbleview? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-v./d./d./d is the label to automatically backport to the 7./d branch. /d is the digit

NOTE: backport-skip has been added to this pull request.

@mergify mergify bot added the backport-skip Skip notification from the automated backport with mergify label Nov 2, 2021
@hubbleview hubbleview added backport-v7.15.0 Automated backport with mergify backport-v7.16.0 Automated backport with mergify backport-v8.0.0 Automated backport with mergify labels Nov 2, 2021
@mergify mergify bot removed the backport-skip Skip notification from the automated backport with mergify label Nov 2, 2021
@hubbleview hubbleview added backport-skip Skip notification from the automated backport with mergify Team:Docs Label for the Observability docs team labels Nov 2, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/obs-docs (Team:Docs)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Nov 2, 2021
@mergify mergify bot removed the backport-skip Skip notification from the automated backport with mergify label Nov 2, 2021
@elasticmachine
Copy link
Collaborator

elasticmachine commented Nov 2, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2021-11-23T18:38:52.722+0000

  • Duration: 105 min 54 sec

  • Commit: 9eb4b6f

Test stats 🧪

Test Results
Failed 0
Passed 9517
Skipped 1275
Total 10792

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

  • /package : Generate the packages and run the E2E tests.

  • /beats-tester : Run the installation tests with beats-tester.

  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@bplies-ATX
Copy link

Similar for

#filebeat.config:
  #inputs:
    #enabled: false

for that matter? enabled should be true also?

@bmorelli25 bmorelli25 requested a review from a team November 3, 2021 20:16
@dedemorton
Copy link
Contributor

I know why the CI is broken here. I will fix it and make sure this PR gets merged.

@dedemorton
Copy link
Contributor

I'm checking with the development team to see what the rule is for commented-out lines in the reference.yml. I think they might be setting up the file so that it's easier for users to disable config loading for modules by uncommenting the line (rather than having to uncomment and change the value to false). I can see where this would be confusing to users, though!

Let's wait to hear back, but it might be better just to remove enabled: true from the example in the docs rather than changing the yaml file.

@dedemorton
Copy link
Contributor

@adriansr Can you comment on this change. I think the default in versions prior to 8.0 is still true, no? What would you recommend to fix the confusion this is causing for users?

@adriansr
Copy link
Contributor

@dedemorton this PR refers to the filebeat.config.modules.enabled flag, which is a global flag to disable module loading completely, and it's different to what we have recently changed.

Both in 8.x and in 7.x, the filebeat.config.modules.enabled defaults to true. What has changed is each individual fileset enabled flag, which in 8.x defaults to false so that users explicitly select the filesets they want to use.

I think it makes sense for the reference configuration (commented-out or not) to mirror the actual default values.

@hubbleview , this PR is modifying an autogenerated file. You should apply this change to filebeat/_meta/beat.reference.yml and then $ mage update in filebeat/ and x-pack/filebeat/.

@dedemorton
Copy link
Contributor

@hubbleview I can fix the PR if you don't already have a beats development environment set up. Just let me know. Thanks!

@dedemorton
Copy link
Contributor

I've pushed changes that should fix the CI failure.

@dedemorton dedemorton merged commit 3e84736 into master Nov 23, 2021
@dedemorton dedemorton deleted the hubbleview-filebeat-2 branch November 23, 2021 22:32
mergify bot pushed a commit that referenced this pull request Nov 23, 2021
* Change filebeat.config.modules.enabled to true

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.

* Fix build error

Co-authored-by: dedemorton <dede.morton@elastic.co>
(cherry picked from commit 3e84736)
mergify bot pushed a commit that referenced this pull request Nov 23, 2021
* Change filebeat.config.modules.enabled to true

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.

* Fix build error

Co-authored-by: dedemorton <dede.morton@elastic.co>
(cherry picked from commit 3e84736)
mergify bot pushed a commit that referenced this pull request Nov 23, 2021
* Change filebeat.config.modules.enabled to true

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.

* Fix build error

Co-authored-by: dedemorton <dede.morton@elastic.co>
(cherry picked from commit 3e84736)
@hubbleview
Copy link
Contributor Author

Thank you @dedemorton for fixing this, sorry I missed out this PR for long time.

@ruflin
Copy link
Member

ruflin commented Nov 24, 2021

Do we really need to backport this to 7.15? Doesn't look like an urgent bugfix.

v1v added a commit to v1v/beats that referenced this pull request Nov 24, 2021
…ws-on-file-changes

* upstream/master:
  override host on statsd metricset (elastic#29103)
  Skip config check in autodiscover for duplicated configurations (elastic#29048)
  Change "filebeat.config.modules.enabled" to "true" (elastic#28769)
  Remove deprecated spool queue from Beats (elastic#28869)
  Add `beat` field back to beat.stats (elastic#29094)
  Revert "Move labels and annotations under kubernetes.namespace. (elastic#27917)" (elastic#29069)
  heartbeat: remove w2008 in the CI (elastic#29093)
  Remove deprecated `--template` and `--index-policy` flags (elastic#28870)
  Fix parsing of apache trace log levels (elastic#28717)
  [Elastic-Agent] IUse itnernal port for local fleet server (elastic#28993)
  [Heartbeat] Log error on dupe monitor ID instead of strict req (elastic#29041)
  Enable pprof for elastic-agent and beats (elastic#28983)
@hubbleview hubbleview removed the backport-v7.15.0 Automated backport with mergify label Nov 24, 2021
@hubbleview
Copy link
Contributor Author

Not necessary to backport to 7.15.0, I just removed that label. @ruflin

dedemorton pushed a commit that referenced this pull request Nov 24, 2021
* Change filebeat.config.modules.enabled to true

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.

* Fix build error

Co-authored-by: dedemorton <dede.morton@elastic.co>
(cherry picked from commit 3e84736)

Co-authored-by: Xiaohui Wen <35361142+hubbleview@users.noreply.github.com>
dedemorton pushed a commit that referenced this pull request Nov 24, 2021
* Change filebeat.config.modules.enabled to true

As per https://www.elastic.co/guide/en/beats/filebeat/current/filebeat-configuration-reloading.html#load-module-config, the default value of filebeat.config.modules.enabled is `true`. Having it as `false` in filebeat.reference.yml would bring in confusion.

* Fix build error

Co-authored-by: dedemorton <dede.morton@elastic.co>
(cherry picked from commit 3e84736)

Co-authored-by: Xiaohui Wen <35361142+hubbleview@users.noreply.github.com>
v1v added a commit to v1v/beats that referenced this pull request Nov 30, 2021
* upstream/master: (577 commits)
  Remove Journalbeat (elastic#29131)
  Add note that there is no warranty or support for generator code (elastic#28797)
  packetbeat: preparation for npcap addition (elastic#29017)
  Use the generic helper for opening file to read in filestream (elastic#29180)
  Workflow for macos (elastic#29174)
  Fix `decode_json_fields` processor to always add error key (elastic#29107)
  Workflow for macos (elastic#29156)
  Fix agent download timeout values in yaml files (elastic#29039)
  Added workflow file for builds with macos (elastic#29148)
  CI: enable AWS cloud testing on a PR basis if changes in certain files (elastic#29047)
  Remove links to Journalbeat (elastic#29134)
  Fix rds metadata in cloudwatch metricset (elastic#29106)
  [mergify]: notify conflicts in PRs that are still open (elastic#29122)
  Use NamedWatcher in Agent's k8s provider (elastic#29095)
  override host on statsd metricset (elastic#29103)
  Skip config check in autodiscover for duplicated configurations (elastic#29048)
  Change "filebeat.config.modules.enabled" to "true" (elastic#28769)
  Remove deprecated spool queue from Beats (elastic#28869)
  Add `beat` field back to beat.stats (elastic#29094)
  Revert "Move labels and annotations under kubernetes.namespace. (elastic#27917)" (elastic#29069)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-v7.16.0 Automated backport with mergify backport-v8.0.0 Automated backport with mergify docs Team:Docs Label for the Observability docs team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants