Skip to content

Commit

Permalink
[Filebeat] Add ecs:false to user_agent processor
Browse files Browse the repository at this point in the history
To make sure the same data structure is ingested in Elasticsearch 6.7 and 7.0 when running Filebeat 6.7, the user_agent processor flag `ecs: false` must be set. Otherwise the data structure would change and data structure conflicts would happen (see elastic#10650).

This change requires Elasticsearch to support the `ecs: false` flag in 7.x.

Adding the `ecs: flag` will mean Filebeat 6.7 stops working with Elasticsearch 6.5 or older as the flag is not supported.
  • Loading branch information
ruflin committed Feb 12, 2019
1 parent b9689a5 commit 9d83a55
Show file tree
Hide file tree
Showing 5 changed files with 9 additions and 4 deletions.
3 changes: 2 additions & 1 deletion filebeat/module/apache2/access/ingest/default.json
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,8 @@
"user_agent": {
"field": "apache2.access.agent",
"target_field": "apache2.access.user_agent",
"ignore_failure": true
"ignore_failure": true,
"ecs": false
}
}, {
"rename": {
Expand Down
3 changes: 2 additions & 1 deletion filebeat/module/iis/access/ingest/default.json
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,8 @@
}, {
"user_agent": {
"field": "iis.access.agent",
"target_field": "iis.access.user_agent"
"target_field": "iis.access.user_agent",
"ecs": false
}
}, {
"rename": {
Expand Down
3 changes: 2 additions & 1 deletion filebeat/module/nginx/access/ingest/default.json
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,8 @@
{
"user_agent": {
"field": "nginx.access.agent",
"target_field": "nginx.access.user_agent"
"target_field": "nginx.access.user_agent",
"ecs": false
}
},
{
Expand Down
3 changes: 2 additions & 1 deletion filebeat/module/traefik/access/ingest/pipeline.json
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,8 @@
"user_agent": {
"field": "traefik.access.agent",
"target_field": "traefik.access.user_agent",
"ignore_failure": true
"ignore_failure": true,
"ecs": false
}
},
{
Expand Down
1 change: 1 addition & 0 deletions x-pack/filebeat/module/suricata/eve/ingest/pipeline.json
Original file line number Diff line number Diff line change
Expand Up @@ -207,6 +207,7 @@
{ "field": "user_agent.original"
, "target_field": "user_agent"
, "ignore_missing": true
, "ecs": false
}
}
, { "rename":
Expand Down

0 comments on commit 9d83a55

Please sign in to comment.