Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[7.x](backport #26158) [FIlebeat] add strict_date_optional_time_nanos date format to PanOS module #26491

Closed
wants to merge 3 commits into from

Conversation

mergify[bot]
Copy link
Contributor

@mergify mergify bot commented Jun 24, 2021

This is an automatic backport of pull request #26158 done by Mergify.
Cherry-pick of 7742fda has failed:

On branch mergify/bp/7.x/pr-26158
Your branch is up to date with 'origin/7.x'.

You are currently cherry-picking commit 7742fda0e.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	modified:   CHANGELOG.next.asciidoc
	new file:   x-pack/filebeat/module/panw/panos/test/traffic_nanos_time.log
	new file:   x-pack/filebeat/module/panw/panos/test/traffic_nanos_time.log-expected.json

Unmerged paths:
  (use "git add/rm <file>..." as appropriate to mark resolution)
	both modified:   x-pack/filebeat/module/panw/panos/ingest/pipeline.yml
	both modified:   x-pack/filebeat/module/panw/panos/test/global_protect.log-expected.json
	deleted by us:   x-pack/filebeat/module/panw/panos/test/hipmatch.log-expected.json

To fix up this pull request, you can check it out locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/


Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

  • @Mergifyio refresh will re-evaluate the rules
  • @Mergifyio rebase will rebase this PR on its base branch
  • @Mergifyio update will merge the base branch into this PR
  • @Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

  • look at your merge queues
  • generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.io/

…odule (#26158)

* #26033: add strict_date_optional_time_nanos format

* update changelog

* added new sample log, need to check CSV parsing

* update sample data

Co-authored-by: Marius Iversen <marius.iversen@elastic.co>
(cherry picked from commit 7742fda)

# Conflicts:
#	x-pack/filebeat/module/panw/panos/ingest/pipeline.yml
#	x-pack/filebeat/module/panw/panos/test/global_protect.log-expected.json
#	x-pack/filebeat/module/panw/panos/test/hipmatch.log-expected.json
@mergify mergify bot added backport conflicts There is a conflict in the backported pull request labels Jun 24, 2021
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jun 24, 2021
@botelastic
Copy link

botelastic bot commented Jun 24, 2021

This pull request doesn't have a Team:<team> label.

@elasticmachine
Copy link
Collaborator

elasticmachine commented Jun 24, 2021

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #26491 updated

  • Start Time: 2021-06-28T10:28:43.752+0000

  • Duration: 73 min 7 sec

  • Commit: 73f2f7d

Test stats 🧪

Test Results
Failed 70
Passed 2654
Skipped 301
Total 3025

Trends 🧪

Image of Build Times

Image of Tests

Test errors 70

Expand to view the tests failures

> Show only the first 10 test failures

Build&Test / x-pack/filebeat-build / test_fileset_file_335_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_335_panw>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_335_panw>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f66273bf378>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_336_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_336_panw>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_336_panw>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f66273bf158>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_337_mysqlenterprise – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_337_mysqlenterprise>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_337_mysqlenterprise>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f66273bf510>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_390_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_390_aws>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_390_aws>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f6623a2eb70>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_391_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_391_aws>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_391_aws>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f661e5242f0>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_392_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_392_activemq>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_392_activemq>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f6623a59598>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_393_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_393_activemq>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_393_activemq>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f6625d0ba60>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_396_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_396_gcp>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_396_gcp>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f6623adb2f0>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_397_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds. 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_397_gcp>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:167: in run_on_file
        self.wait_until(lambda: self.es.indices.exists(self.index_name))
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <test_xpack_modules.XPackTest testMethod=test_fileset_file_397_gcp>
    cond = <function Test.run_on_file.<locals>.<lambda> at 0x7f661e4d9c80>
    max_timeout = 10, poll_interval = 0.1, name = 'cond'
    
        def wait_until(self, cond, max_timeout=10, poll_interval=0.1, name="cond"):
            """
            Waits until the cond function returns true,
            or until the max_timeout is reached. Calls the cond
            function every poll_interval seconds.
        
            If the max_timeout is reached before cond() returns
            true, an exception is raised.
            """
            start = datetime.now()
            while not cond():
                if datetime.now() - start > timedelta(seconds=max_timeout):
                    raise TimeoutError("Timeout waiting for '{}' to be true. ".format(name) +
    >                                  "Waited {} seconds.".format(max_timeout))
    E               beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.
    
    ../../libbeat/tests/system/beat/beat.py:363: TimeoutError 
    

Build&Test / x-pack/filebeat-build / test_fileset_file_328_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
    Expand to view the error details

     Failed: Timeout >90.0s 
    

    Expand to view the stacktrace

     a = (<test_xpack_modules.XPackTest testMethod=test_fileset_file_328_panw>,)
    
        @wraps(func)
        def standalone_func(*a):
    >       return func(*(a + p.args), **p.kwargs)
    
    ../../build/ve/docker/lib/python3.7/site-packages/parameterized/parameterized.py:518: 
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    ../../filebeat/tests/system/test_modules.py:107: in test_fileset_file
        cfgfile=cfgfile)
    ../../filebeat/tests/system/test_modules.py:158: in run_on_file
        bufsize=0).wait()
    /usr/lib/python3.7/subprocess.py:990: in wait
        return self._wait(timeout=timeout)
    /usr/lib/python3.7/subprocess.py:1624: in _wait
        (pid, sts) = self._try_wait(0)
    _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
    
    self = <subprocess.Popen object at 0x7f6627839b70>, wait_flags = 0
    
        def _try_wait(self, wait_flags):
            """All callers to this function MUST hold self._waitpid_lock."""
            try:
    >           (pid, sts) = os.waitpid(self.pid, wait_flags)
    E           Failed: Timeout >90.0s
    
    /usr/lib/python3.7/subprocess.py:1582: Failed 
    

Steps errors 2

Expand to view the steps failures

x-pack/filebeat-build - mage build test
  • Took 48 min 9 sec . View more details on here
  • Description: mage build test
Error signal
  • Took 0 min 0 sec . View more details on here
  • Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2021-06-28T11:39:26.019Z]  Context:           default
[2021-06-28T11:39:26.019Z]  Experimental:      true
[2021-06-28T11:39:26.019Z] 
[2021-06-28T11:39:26.019Z] Server: Docker Engine - Community
[2021-06-28T11:39:26.019Z]  Engine:
[2021-06-28T11:39:26.019Z]   Version:          20.10.3
[2021-06-28T11:39:26.019Z]   API version:      1.41 (minimum version 1.12)
[2021-06-28T11:39:26.019Z]   Go version:       go1.13.15
[2021-06-28T11:39:26.019Z]   Git commit:       46229ca
[2021-06-28T11:39:26.019Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-06-28T11:39:26.019Z]   OS/Arch:          linux/amd64
[2021-06-28T11:39:26.019Z]   Experimental:     false
[2021-06-28T11:39:26.019Z]  containerd:
[2021-06-28T11:39:26.019Z]   Version:          1.4.3
[2021-06-28T11:39:26.019Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-06-28T11:39:26.019Z]  runc:
[2021-06-28T11:39:26.019Z]   Version:          1.0.0-rc92
[2021-06-28T11:39:26.019Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-06-28T11:39:26.019Z]  docker-init:
[2021-06-28T11:39:26.019Z]   Version:          0.19.0
[2021-06-28T11:39:26.019Z]   GitCommit:        de40ad0
[2021-06-28T11:39:26.019Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-06-28T11:39:26.019Z] Unable to find image 'alpine:3.4' locally
[2021-06-28T11:39:26.588Z] 3.4: Pulling from library/alpine
[2021-06-28T11:39:26.846Z] c1e54eec4b57: Pulling fs layer
[2021-06-28T11:39:27.105Z] c1e54eec4b57: Verifying Checksum
[2021-06-28T11:39:27.105Z] c1e54eec4b57: Download complete
[2021-06-28T11:39:27.365Z] c1e54eec4b57: Pull complete
[2021-06-28T11:39:27.365Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-06-28T11:39:27.365Z] Status: Downloaded newer image for alpine:3.4
[2021-06-28T11:39:29.273Z] Change permissions with write access of all files inside the specific folder
[2021-06-28T11:39:30.228Z] Running in /var/lib/jenkins/workspace/PR-26491-2-9b495ec2-8c16-4005-a2a8-d63968707ab7/src/github.com/elastic/beats/build
[2021-06-28T11:39:30.521Z] + rm -rf ve
[2021-06-28T11:39:30.521Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-06-28T11:39:30.831Z] + python .ci/scripts/pre_archive_test.py
[2021-06-28T11:39:33.368Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-06-28T11:39:33.379Z] Running in /var/lib/jenkins/workspace/PR-26491-2-9b495ec2-8c16-4005-a2a8-d63968707ab7/src/github.com/elastic/beats/build
[2021-06-28T11:39:33.394Z] Recording test results
[2021-06-28T11:39:34.186Z] [Checks API] No suitable checks publisher found.
[2021-06-28T11:39:34.503Z] + tar --version
[2021-06-28T11:39:34.828Z] + tar --exclude=test-build-artifacts-x-pack-filebeat-build-tgz -czf test-build-artifacts-x-pack-filebeat-build-tgz .
[2021-06-28T11:40:42.914Z] + gsutil --version
[2021-06-28T11:40:46.263Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-06-28T11:40:46.929Z] + gcloud auth activate-service-account --key-file ****
[2021-06-28T11:40:48.102Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-06-28T11:40:48.503Z] + gsutil -m -q cp -a public-read test-build-artifacts-x-pack-filebeat-build-tgz gs://beats-ci-temp/Beats/beats/PR-26491-2
[2021-06-28T11:40:54.137Z] + python .ci/scripts/search_system_tests.py
[2021-06-28T11:40:54.161Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2021-06-28T11:40:54.486Z] + tar --version
[2021-06-28T11:40:54.796Z] + tar --exclude=x-pack-filebeat--system-tests-linux-tgz -czf x-pack-filebeat--system-tests-linux-tgz build/x-pack/filebeat/build/system-tests
[2021-06-28T11:41:33.881Z] + gsutil --version
[2021-06-28T11:41:35.298Z] Masking supported pattern matches of $FILE_CREDENTIAL
[2021-06-28T11:41:35.606Z] + gcloud auth activate-service-account --key-file ****
[2021-06-28T11:41:36.177Z] Activated service account credentials for: [beats-ci-gcs-plugin@elastic-ci-prod.iam.gserviceaccount.com]
[2021-06-28T11:41:36.756Z] + gsutil -m -q cp -a public-read x-pack-filebeat--system-tests-linux-tgz gs://beats-ci-temp/Beats/beats/PR-26491-2
[2021-06-28T11:41:41.434Z] + go clean -modcache
[2021-06-28T11:41:44.298Z] Cleaning up /var/lib/jenkins/workspace/PR-26491-2-9b495ec2-8c16-4005-a2a8-d63968707ab7
[2021-06-28T11:41:44.298Z] Client: Docker Engine - Community
[2021-06-28T11:41:44.298Z]  Version:           20.10.3
[2021-06-28T11:41:44.298Z]  API version:       1.41
[2021-06-28T11:41:44.298Z]  Go version:        go1.13.15
[2021-06-28T11:41:44.298Z]  Git commit:        48d30b5
[2021-06-28T11:41:44.298Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-06-28T11:41:44.298Z]  OS/Arch:           linux/amd64
[2021-06-28T11:41:44.298Z]  Context:           default
[2021-06-28T11:41:44.298Z]  Experimental:      true
[2021-06-28T11:41:44.298Z] 
[2021-06-28T11:41:44.298Z] Server: Docker Engine - Community
[2021-06-28T11:41:44.298Z]  Engine:
[2021-06-28T11:41:44.298Z]   Version:          20.10.3
[2021-06-28T11:41:44.298Z]   API version:      1.41 (minimum version 1.12)
[2021-06-28T11:41:44.298Z]   Go version:       go1.13.15
[2021-06-28T11:41:44.298Z]   Git commit:       46229ca
[2021-06-28T11:41:44.298Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-06-28T11:41:44.298Z]   OS/Arch:          linux/amd64
[2021-06-28T11:41:44.298Z]   Experimental:     false
[2021-06-28T11:41:44.298Z]  containerd:
[2021-06-28T11:41:44.298Z]   Version:          1.4.3
[2021-06-28T11:41:44.298Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-06-28T11:41:44.298Z]  runc:
[2021-06-28T11:41:44.298Z]   Version:          1.0.0-rc92
[2021-06-28T11:41:44.298Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-06-28T11:41:44.298Z]  docker-init:
[2021-06-28T11:41:44.298Z]   Version:          0.19.0
[2021-06-28T11:41:44.298Z]   GitCommit:        de40ad0
[2021-06-28T11:41:44.298Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-06-28T11:41:45.681Z] Change permissions with write access of all files inside the specific folder
[2021-06-28T11:41:45.967Z] Running in /var/lib/jenkins/workspace/PR-26491-2-9b495ec2-8c16-4005-a2a8-d63968707ab7
[2021-06-28T11:41:50.237Z] Failed in branch x-pack/filebeat-build
[2021-06-28T11:41:50.293Z] Stage "Extended" skipped due to earlier failure(s)
[2021-06-28T11:41:50.320Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-06-28T11:41:50.348Z] Stage "Packaging-Pipeline" skipped due to earlier failure(s)
[2021-06-28T11:41:50.395Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-26491/src/github.com/elastic/beats
[2021-06-28T11:41:50.808Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-26491
[2021-06-28T11:41:50.845Z] [INFO] getVaultSecret: Getting secrets
[2021-06-28T11:41:50.880Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-06-28T11:41:51.512Z] + chmod 755 generate-build-data.sh
[2021-06-28T11:41:51.512Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26491/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26491/runs/2 FAILURE 4387499
[2021-06-28T11:41:51.512Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26491/runs/2/steps/?limit=10000 -o steps-info.json
[2021-06-28T11:41:52.063Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-26491/runs/2/tests/?status=FAILED -o tests-errors.json

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test Results
Failed 70
Passed 2654
Skipped 301
Total 3025

Genuine test errors 70

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_335_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_336_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_337_mysqlenterprise – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_390_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_391_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_392_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_393_activemq – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_396_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_397_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_328_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_329_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_330_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_331_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_332_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_333_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_334_panw – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_338_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_339_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_340_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_341_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_342_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_343_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_344_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_345_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_346_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_347_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_348_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_349_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_350_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_351_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_352_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_353_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_354_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_355_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_356_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_357_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_358_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_359_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_360_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_361_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_362_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_363_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_364_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_365_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_366_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_367_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_368_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_369_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_370_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_371_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_372_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_373_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_374_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_375_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_376_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_377_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_378_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_379_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_380_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_381_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_382_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_383_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_384_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_385_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_386_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_387_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_388_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_389_aws – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_394_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest
  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_395_gcp – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

@P1llus P1llus self-assigned this Jun 25, 2021
@mergify
Copy link
Contributor Author

mergify bot commented Jun 27, 2021

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b mergify/bp/7.x/pr-26158 upstream/mergify/bp/7.x/pr-26158
git merge upstream/7.x
git push upstream mergify/bp/7.x/pr-26158

@P1llus P1llus closed this Jun 28, 2021
@mergify mergify bot deleted the mergify/bp/7.x/pr-26158 branch June 28, 2021 11:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport conflicts There is a conflict in the backported pull request needs_team Indicates that the issue/PR needs a Team:* label
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants