Cherry-pick #20751 to 7.x: [Filebeat][httpjson] Make httpjson use cursor input when using date cursor #21384

marc-gr · 2020-09-29T14:28:22Z

Cherry-pick of PR #20751 to 7.x branch. Original message:

What does this PR do?

Creates a custom input manager that will initialize a cursor input manager whenever a date cursor is configured.

Why is it important?

It is a recurrent requirement to keep state between beat restarts for the httpjson input. With this change, whenever a cursor is set up, the state will be kept.

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
~~- [ ] I have made corresponding changes to the documentation~~
~~- [ ] I have made corresponding change to the default configuration files~~
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

Relates to #19071 #19486

elasticmachine · 2020-09-29T14:28:25Z

Pinging @elastic/siem (Team:SIEM)

elasticmachine · 2020-09-29T15:55:09Z

💔 Tests Failed

Expand to view the summary

Build stats

Build Cause: [Started by user Marc Guasch, Replayed #3]
Start Time: 2020-10-01T08:27:05.613+0000
Duration: 85 min 0 sec

Test stats 🧪

Test	Results
Failed	319
Passed	3967
Skipped	564
Total	4850

Test errors

Expand to view the tests failures

Name: Build&Test / filebeat-build / test_stdin_eof – filebeat.tests.system.test_stdin.Test
- Age: 1
- Duration: 10.125
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_002_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 90.004
- Error Details: Failed: Timeout >90.0s
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_003_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.247
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_004_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.233
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_005_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.239
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_006_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.229
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_007_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.203
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_008_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.181
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_009_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.174
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_010_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.178
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_011_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.166
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_012_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.232
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_013_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.191
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_014_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.163
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_015_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.169
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_016_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.161
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_017_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.158
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_018_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.159
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_019_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.171
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_020_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.179
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_021_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.208
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_022_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.182
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_023_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.182
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_024_mssql – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.17
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_025_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.176
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_026_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.184
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_027_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.171
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_028_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.171
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_029_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.184
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_030_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.196
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_031_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.155
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_032_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.148
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_033_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.162
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_034_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.153
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_035_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.216
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_036_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.16
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_037_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.173
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_038_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.137
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_039_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.143
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_040_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.148
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_041_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.151
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_042_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.143
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_043_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.139
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_044_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.137
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_045_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.129
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_046_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.131
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_047_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.224
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_048_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.132
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_049_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.125
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_050_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.133
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_051_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.136
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_052_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.127
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_053_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.14
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_054_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.23
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_055_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.224
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_056_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.226
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_057_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.221
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_058_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.135
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_059_zeek – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.134
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_060_netscout – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.225
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_061_proofpoint – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.248
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_062_okta – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.238
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_063_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.232
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_064_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.13
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_065_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.126
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_066_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.251
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_067_iptables – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.137
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_068_citrix – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.14
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_069_ibmmq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.227
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_070_ibmmq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.128
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_071_ibmmq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.23
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_072_cef – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.124
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_073_cef – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.221
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_074_cef – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.249
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_075_infoblox – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.288
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_076_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.2
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_077_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.227
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_078_bluecoat – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.226
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_079_squid – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.128
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_080_cyberark – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.224
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_081_coredns – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.222
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_082_coredns – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.248
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_083_zscaler – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.264
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_084_zscaler – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.251
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_085_sonicwall – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.224
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_086_sonicwall – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.229
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_087_juniper – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.224
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_088_barracuda – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.132
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_089_barracuda – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.223
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_090_fortinet – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.223
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_091_fortinet – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.226
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_092_fortinet – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.216
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_093_fortinet – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.179
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_094_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.228
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_095_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.226
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_096_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.131
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_097_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.253
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_098_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.301
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_099_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.244
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build&Test / x-pack/filebeat-build / test_fileset_file_100_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
- Age: 1
- Duration: 10.227
- Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

Steps errors

Expand to view the steps failures

Name: mage build test
- Description: mage build test
- Duration: 42 min 38 sec
- Start Time: 2020-10-01T08:54:16.011+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 1 sec
- Start Time: 2020-10-01T09:36:16.269+0000
- log
Name: mage build test
- Description: mage build test
- Duration: 55 min 7 sec
- Start Time: 2020-10-01T08:54:15.415+0000
- log
Name: Notifies GitHub of the status of a Pull Request
- Description: script returned exit code 1
- Duration: 0 min 1 sec
- Start Time: 2020-10-01T09:50:13.463+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-10-01T09:49:24.273Z] c1e54eec4b57: Download complete
[2020-10-01T09:49:24.552Z] c1e54eec4b57: Pull complete
[2020-10-01T09:49:24.552Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2020-10-01T09:49:24.552Z] Status: Downloaded newer image for alpine:3.4
[2020-10-01T09:49:26.809Z] + python .ci/scripts/pre_archive_test.py
[2020-10-01T09:49:28.788Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2020-10-01T09:49:28.800Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/build
[2020-10-01T09:49:28.812Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-01T09:49:28.815Z] Recording test results
[2020-10-01T09:49:31.223Z] Stashed 4 file(s)
[2020-10-01T09:49:31.234Z] Archiving artifacts
[2020-10-01T09:49:32.017Z] + python .ci/scripts/search_system_tests.py
[2020-10-01T09:49:32.040Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2020-10-01T09:49:32.408Z] + tar --version
[2020-10-01T09:49:32.725Z] + tar --exclude=x-pack-filebeat--system-tests-linux.tgz -czf x-pack-filebeat--system-tests-linux.tgz build/x-pack/filebeat/build/system-tests
[2020-10-01T09:49:54.841Z] Archiving artifacts
[2020-10-01T09:50:06.488Z] Client: Docker Engine - Community
[2020-10-01T09:50:06.489Z]  Version:           19.03.13
[2020-10-01T09:50:06.489Z]  API version:       1.40
[2020-10-01T09:50:06.489Z]  Go version:        go1.13.15
[2020-10-01T09:50:06.489Z]  Git commit:        4484c46d9d
[2020-10-01T09:50:06.489Z]  Built:             Wed Sep 16 17:02:36 2020
[2020-10-01T09:50:06.489Z]  OS/Arch:           linux/amd64
[2020-10-01T09:50:06.489Z]  Experimental:      false
[2020-10-01T09:50:06.489Z] 
[2020-10-01T09:50:06.489Z] Server: Docker Engine - Community
[2020-10-01T09:50:06.489Z]  Engine:
[2020-10-01T09:50:06.489Z]   Version:          19.03.13
[2020-10-01T09:50:06.489Z]   API version:      1.40 (minimum version 1.12)
[2020-10-01T09:50:06.489Z]   Go version:       go1.13.15
[2020-10-01T09:50:06.489Z]   Git commit:       4484c46d9d
[2020-10-01T09:50:06.489Z]   Built:            Wed Sep 16 17:01:06 2020
[2020-10-01T09:50:06.489Z]   OS/Arch:          linux/amd64
[2020-10-01T09:50:06.489Z]   Experimental:     false
[2020-10-01T09:50:06.489Z]  containerd:
[2020-10-01T09:50:06.489Z]   Version:          1.3.7
[2020-10-01T09:50:06.489Z]   GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
[2020-10-01T09:50:06.489Z]  runc:
[2020-10-01T09:50:06.489Z]   Version:          1.0.0-rc10
[2020-10-01T09:50:06.489Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-01T09:50:06.489Z]  docker-init:
[2020-10-01T09:50:06.489Z]   Version:          0.18.0
[2020-10-01T09:50:06.489Z]   GitCommit:        fec3683
[2020-10-01T09:50:14.585Z] Failed in branch x-pack/filebeat-build
[2020-10-01T09:50:19.631Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-01T09:50:19.644Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-01T09:50:19.725Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21384-4/source/source.tgz
[2020-10-01T09:50:19.746Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21384-4/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21384/source.tgz
[2020-10-01T09:50:30.449Z] + tar --version
[2020-10-01T09:50:30.741Z] + tar -xpf source.tgz
[2020-10-01T09:50:41.102Z] + rm source.tgz
[2020-10-01T09:50:41.209Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats
[2020-10-01T09:50:41.217Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/uncategorized-1601542236637
[2020-10-01T09:50:41.335Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1601543354767
[2020-10-01T09:50:41.374Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/filebeat-windows-windows-2019-1601543419916
[2020-10-01T09:50:41.412Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/filebeat-build-1601544959955
[2020-10-01T09:50:41.464Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats/x-pack-filebeat-build-1601545770652
[2020-10-01T09:50:41.802Z] + cat
[2020-10-01T09:50:41.802Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-01T09:50:41.802Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-01T09:50:48.389Z] runbld>>> runbld started
[2020-10-01T09:50:48.389Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-01T09:50:49.329Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-01T09:50:49.329Z] runbld>>> Matches in the system config:
[2020-10-01T09:50:49.329Z] runbld>>> - Matched ^elastic\+beats
[2020-10-01T09:50:49.329Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-01T09:50:50.711Z] runbld>>> Debug logging enabled.
[2020-10-01T09:50:50.711Z] runbld>>> Storing result
[2020-10-01T09:50:50.973Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-01T09:50:50.973Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201001095050-06D0D490
[2020-10-01T09:50:50.973Z] runbld>>> Adding system facts.
[2020-10-01T09:50:52.356Z] runbld>>> Adding vcs info for the latest commit:  7c34e38fe9158d9513db402e47256bd7072ff141
[2020-10-01T09:50:52.356Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-01T09:50:52.356Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-01T09:50:52.356Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-01T09:50:52.356Z] Processing JUnit reports with runbld...
[2020-10-01T09:50:52.616Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-01T09:50:52.616Z] runbld>>> DURATION: 57ms
[2020-10-01T09:50:52.616Z] runbld>>> STDOUT: 40 bytes
[2020-10-01T09:50:52.616Z] runbld>>> STDERR: 49 bytes
[2020-10-01T09:50:52.616Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-01T09:50:52.616Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21384
[2020-10-01T09:50:53.556Z] runbld>>> Storing build metadata: 
[2020-10-01T09:50:53.556Z] runbld>>> Adding test report.
[2020-10-01T09:50:53.556Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21384/src/github.com/elastic/beats
[2020-10-01T09:50:54.126Z] runbld>>> Found 12 test output files
[2020-10-01T09:50:56.036Z] runbld>>> Test output logs contained: Errors: 0 Failures: 319 Tests: 4850 Skipped: 545
[2020-10-01T09:50:56.036Z] runbld>>> Storing result
[2020-10-01T09:50:56.036Z] runbld>>> FAILURES: 319
[2020-10-01T09:52:03.779Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-01T09:52:03.779Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201001095050-06D0D490
[2020-10-01T09:52:03.779Z] runbld>>> Email notification disabled by environment variable.
[2020-10-01T09:52:03.779Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-01T09:52:04.885Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats_PR-21384
[2020-10-01T09:52:04.972Z] [INFO] getVaultSecret: Getting secrets
[2020-10-01T09:52:05.052Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-01T09:52:07.338Z] + chmod 755 generate-build-data.sh
[2020-10-01T09:52:07.338Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21384/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21384/runs/4 FAILURE 5099951
[2020-10-01T09:52:07.338Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21384/runs/4/steps/?limit=10000 -o steps-info.json
[2020-10-01T09:52:11.456Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21384/runs/4/tests/?status=FAILED -o tests-errors.json

…ursor (elastic#20751) * Fix duplicate import * Move config to its own package * Minor improvements * Fix tests * Create input manager * Change requester to accept and store a cursor * Modify input to be embedded * Create stateless and cursor inputs * Initialize new input manager on publish * Add changelog entry and format files * Move test data folder * Change tests * Apply requested changes (cherry picked from commit 8f9d54b)

marc-gr added [zube]: In Review backport Team:SIEM labels Sep 29, 2020

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Sep 29, 2020

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Sep 29, 2020

marc-gr force-pushed the backport_20751_7.x branch from aa65c6c to d16b6d8 Compare September 30, 2020 07:26

adriansr approved these changes Sep 30, 2020

View reviewed changes

marc-gr force-pushed the backport_20751_7.x branch from d16b6d8 to 7c34e38 Compare October 1, 2020 07:17

andrewkroh approved these changes Oct 1, 2020

View reviewed changes

marc-gr merged commit df102bd into elastic:7.x Oct 2, 2020

marc-gr deleted the backport_20751_7.x branch October 2, 2020 07:39

zube bot added [zube]: Done and removed [zube]: In Review labels Oct 2, 2020

zube bot removed the [zube]: Done label Dec 31, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick #20751 to 7.x: [Filebeat][httpjson] Make httpjson use cursor input when using date cursor #21384

Cherry-pick #20751 to 7.x: [Filebeat][httpjson] Make httpjson use cursor input when using date cursor #21384

marc-gr commented Sep 29, 2020 •

edited by zube bot

Loading

elasticmachine commented Sep 29, 2020

elasticmachine commented Sep 29, 2020 •

edited by jenkins-beats-ci bot

Loading

Build stats

Test stats 🧪

Cherry-pick #20751 to 7.x: [Filebeat][httpjson] Make httpjson use cursor input when using date cursor #21384

Cherry-pick #20751 to 7.x: [Filebeat][httpjson] Make httpjson use cursor input when using date cursor #21384

Conversation

marc-gr commented Sep 29, 2020 • edited by zube bot Loading

What does this PR do?

Why is it important?

Checklist

Related issues

elasticmachine commented Sep 29, 2020

elasticmachine commented Sep 29, 2020 • edited by jenkins-beats-ci bot Loading

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

marc-gr commented Sep 29, 2020 •

edited by zube bot

Loading

elasticmachine commented Sep 29, 2020 •

edited by jenkins-beats-ci bot

Loading