Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update python3 fix auditbeat and dashboards #15807

Conversation

jsoriano
Copy link
Member

Update python3 branch with master to bring the fixes for auditbeat tests
and for versions in x-pack dashboards.

ycombinator and others added 30 commits January 17, 2020 08:55
* Mask password is string representation of config

* Rename method

* Adding unit test

* Use const for module config password setting name

* Using common.DebugString

* Simplifying

* Removing now-invalid unit test

* Removing now-unnecessary const

* Refactoring: moving debug-related var and func to common file

* Refactoring: rename from black list to mask list

* Implement fmt.Formatter for common.MapStr

* Reintroduce debug statement

* Make MarshalLogObject always filter MapStr object for logging purposes

* Refactoring: renaming to be bit more generic

* Forgot to add license header to new file

* Fixing verb syntax
* Adding monitoring.cloud.* settings to reference files

* Missed winlogbeat somehow

* Missed x-pack/winlogbeat
* Fix panic: don't send events if client is nil

* Use mutex

* Add CHANGELOG entry

* Rename changelog entry

* Fix: changelog

* Temporarily use specific logstash release
it uses APM pipeline library configured in the instance
* AWS Lambda: downgrade Kibana dashboard

* Downgrade other AWS dashboards

* Log command error if setup dashboards fails

* Another downgrade
From the README of goracle:

> Goracle is deprecated because of naming (trademark) issues.

From now on we are using github.com/godror/godror instead.
… to reuse (elastic#15503)

* Move pdh query to shared location

* Update changelog

* Fix make update

* mage fmt

* fix changelog
Remove datasource option from SQL module. This option was
intended to set the DSN of a database connection, and we were
ignoring the hosts setting. In other SQL modules we are using
the values in hosts as DSNs, do here the same for consistency.
Host is redacted when we cannot parse it as it can contain passwords.

StandardizeEvent is exposed in mbtest.Fetcher interface so we can
more easily check contents of events in tests.

Add integration tests of the module with MySQL and PostgreSQL.

Add real data.json with data from MySQL and PostgreSQL.
…c#15643)

* add service metricset to ref docs

* update xpack docs
since 7.0 elasticsearch is using java.time style patterns.
YYYY becomes yyyy
* [DOCS] Add missing config options to shared file

* Add fixes from review

* Run mage fmt update to fix build error
## What does this PR do?

This PR updates the dependency `github.com/godror/godror` to v0.10.4.

## Why is it important?

Packaging of Metricbeat fails due to the issue in the `godror` version we are currently using. See more about the problem: godror/godror#8
* Collect normalized CPU percentages by default

* Adding CHANGELOG entry

* Updating x-pack/metricbeat
* Add optional AWS shared_credential_file to all s3 input modules
* Made AWS credential_profile_name optional for all s3 input modules

Fixes elastic#15652
Mapping was defined at the metricset level, but it should be defined at
the module level.

Add system test to earlier detect this kind of issues.

Also add validation so driver and sql_query options cannot be empty.

Fetch was reusing some maps when building the event, what was
causing mixed data in events and panics on queries with lots of rows.

Fixes elastic#15736
…c#15586)

* Building functionbeat providers with specific GOOS and GOARCH

* Fix: os changed to linux for aws functionbeat provider

* Disabling CGO in functionbeat because it is not used
Remove spurious strings in fields definitions of generic modules
caused by how these yaml files are indented and concatenated.
…5639)

* [Heartbeat] Fix excessive memory usage when parsing bodies

In 7.5 we introduced a regression where we would allocate a 100MiB
buffer per HTTP request. This change fixes that to stream data instead.
* Set event.outcome based on googlecloud audit log output
kuisathaverat and others added 6 commits January 23, 2020 09:37
* ci: add apm beats update pipeline multibranch job

* fix: force execution on comment trigger

* Update .ci/apm-beats-update.groovy

* Update .ci/apm-beats-update.groovy

* Update .ci/apm-beats-update.groovy

* Delete apm-server-update-beats.sh
* add redis and kafka out

* add cloud output

* add changelog
Documentation and sample reference configuration still states that the
agent version is appended to the default policy name configured via
setup.ilm.policy_name. With 7.6 the version is removed from the default.
…ic#15771)

This is a tentative workaround for the problems in Auditbeat's
system/socket dataset when run under 5.x kernels.

On older kernels, we could rely on dereferencing a NULL or invalid
pointer returning zeroed memory. However, seems that in the tested 5.x
kernels is not the case. Dereferencing a NULL pointer returns bogus
memory, which causes some wrong codepaths to be taken in a couple of
kprobes defined by the dataset.

This so far seems only to affect udp_sendmsg and udpv6_sendmsg, which
caused it to attribute traffic to bogus IP addresses. In turn this
caused the test-connected-udp system tests to fail.
@jsoriano jsoriano merged commit f4e0187 into elastic:feature/python3 Jan 24, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.