Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove suricata.eve.timestamp alias #22095

Merged

Conversation

andrewkroh
Copy link
Member

What does this PR do?

Remove the suricata.eve.timestamp alias field from the Suricata module.

This is a breaking change for anything that we dependent upon the field, but its
presence caused issue in Kibana since it was always displayed in Discover.

Fixes #10535

Why is it important?

It's confusing to see suricata fields in Discover for all events.

Checklist

  • My code follows the style guidelines of this project
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

@andrewkroh andrewkroh added Filebeat Filebeat breaking change release-note:breaking The content should be included as a breaking change Team:Security-External Integrations labels Oct 22, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Oct 22, 2020
Remove the suricata.eve.timestamp alias field from the Suricata module.

This is a breaking change for anything that we dependent upon the field, but its
presence caused issue in Kibana since it was always displayed in Discover.

Fixes elastic#10535
@andrewkroh andrewkroh force-pushed the bugfix/fb/suricata-eve-timestamp-removal branch from 8231118 to 74cf951 Compare October 22, 2020 14:15
Copy link
Contributor

@webmat webmat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this Andrew.

If folks worry about this "breaking change", we could always just duplicate the value, too.

But plain removal makes more sense, IMO.

@andrewkroh
Copy link
Member Author

I didn't copy the value because that could cause its own issues (if a new index is not used) like trying to write a concrete value to an alias field.

@elasticmachine
Copy link
Collaborator

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #22095 updated]

  • Start Time: 2020-10-22T14:16:44.683+0000

  • Duration: 63 min 55 sec

Test stats 🧪

Test Results
Failed 0
Passed 4474
Skipped 561
Total 5035

@andrewkroh andrewkroh merged commit daed8f9 into elastic:master Oct 22, 2020
andrewkroh added a commit to andrewkroh/beats that referenced this pull request Oct 22, 2020
Remove the suricata.eve.timestamp alias field from the Suricata module.

This is a breaking change for anything that we dependent upon the field, but its
presence caused issue in Kibana since it was always displayed in Discover.

Fixes elastic#10535

(cherry picked from commit daed8f9)
v1v added a commit to v1v/beats that referenced this pull request Oct 26, 2020
…beats into feature/support-flaky-test-analyser

* 'feature/support-flaky-test-analyser' of github.com:v1v/beats: (40 commits)
  [CI] support windows-10 (elastic#19804)
  Use default config when creating the input (elastic#22126)
  Change x509 mappings from file. to tls.server. (elastic#22097)
  Add fleet settings image (elastic#22065)
  Edit 7.9.3 changelog (elastic#22117)
  Edit 6.8.13 release notes (elastic#22120)
  Incorporate librpm fix feedback (elastic#22098)
  [libbeat] Add more disk queue unit tests and fix a size-check bug (elastic#22107)
  docs: move kerberos include (elastic#22109)
  Check context.Canceled and fix s3 input config (elastic#22036)
  Add max_number_of_messages into aws filebeat fileset vars (elastic#22057)
  Remove suricata.eve.timestamp alias (elastic#22095)
  [Ingest Manager] Use symlink path for reexecutions (elastic#21835)
  chore: use ubuntu 18 as linux agent (elastic#22084)
  docs: Prepare Changelog for 7.9.3 (elastic#22073) (elastic#22075)
  docs: Prepare Changelog for 6.8.13 (elastic#22072) (elastic#22079)
  [build][packaging] Add resilience when docker build (elastic#22050)
  Fix the url of reviewdog (elastic#21981)
  revert WSS process reporting for windows (elastic#22055)
  Fix typo (elastic#19585) (elastic#22061)
  ...
v1v added a commit to v1v/beats that referenced this pull request Oct 26, 2020
…ter-commit

* upstream/master: (25 commits)
  [CI] set env variable for the params (elastic#22143)
  Fix zeek connection pipeline (elastic#22151)
  Fix Google Cloud Function configuration file issues (elastic#22156)
  Remove old TODO on kubernetes node update (elastic#22074)
  [CI] Enable winlogbeat (elastic#22142)
  [CI] support windows-10 (elastic#19804)
  Use default config when creating the input (elastic#22126)
  Change x509 mappings from file. to tls.server. (elastic#22097)
  Add fleet settings image (elastic#22065)
  Edit 7.9.3 changelog (elastic#22117)
  Edit 6.8.13 release notes (elastic#22120)
  Incorporate librpm fix feedback (elastic#22098)
  [libbeat] Add more disk queue unit tests and fix a size-check bug (elastic#22107)
  docs: move kerberos include (elastic#22109)
  Check context.Canceled and fix s3 input config (elastic#22036)
  Add max_number_of_messages into aws filebeat fileset vars (elastic#22057)
  Remove suricata.eve.timestamp alias (elastic#22095)
  [Ingest Manager] Use symlink path for reexecutions (elastic#21835)
  chore: use ubuntu 18 as linux agent (elastic#22084)
  docs: Prepare Changelog for 7.9.3 (elastic#22073) (elastic#22075)
  ...
andrewkroh added a commit that referenced this pull request Oct 27, 2020
Remove the suricata.eve.timestamp alias field from the Suricata module.

This is a breaking change for anything that we dependent upon the field, but its
presence caused issue in Kibana since it was always displayed in Discover.

Fixes #10535

(cherry picked from commit daed8f9)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
breaking change Filebeat Filebeat release-note:breaking The content should be included as a breaking change v7.11.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Filebeat] Field aliases yield confusing Kibana Discovery results
3 participants