Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] 2.0 pipeline for 6.8 #21859

Merged
merged 53 commits into from
Oct 30, 2020
Merged

[CI] 2.0 pipeline for 6.8 #21859

merged 53 commits into from
Oct 30, 2020

Conversation

v1v
Copy link
Member

@v1v v1v commented Oct 15, 2020

What does this PR do?

Transform elastic+beats+6.8 to 2.0 pipeline for the 6.8 branch. For such I've cherry-picked a few PRs that contains the 2.0 implementation. I've disabled all the stages that are failing and reported those build/test errors as GitHub issues, for the record, those build/test errors are also happening in the existing 1.0 pipeline.

Why is it important?

Avoid JJB and use the same CI pipeline that's used for the master and other release branches.

Status

Beat Stage Command Platforms Status CI
auditbeat build RACE_DETECTOR=1 make -C auditbeat check testsuite integration-tests-environment ['linux && ubuntu-16']
auditbeat crosscompile make -C auditbeat crosscompile ['linux && ubuntu-16']
auditbeat windows mage fields build goTestUnit ['windows-2008-r2'] 🔴 (see #21958)
filebeat build RACE_DETECTOR=1 make -C filebeat check testsuite integration-tests-environment ['linux && ubuntu-16']
filebeat windows mage fields build goTestUnit ['windows-2008-r2']
generator generator-test make -C generator/ test ['linux && ubuntu-16']
heartbeat build RACE_DETECTOR=1 make -C heartbeat check testsuite integration-tests-environment ['linux && ubuntu-16']
heartbeat windows mage fields build goTestUnit ['windows-2008-r2']
journalbeat build RACE_DETECTOR=1 make -C journalbeat check testsuite ['linux && ubuntu-16']
journalbeat windows mage fields build goTestUnit ['windows-2008-r2']
libbeat build RACE_DETECTOR=1 make -C libbeat check testsuite integration-tests-environment ['linux && ubuntu-16'] 🔴 (see #21959)
libbeat crosscompile make -C libbeat crosscompile ['linux && ubuntu-16']
libbeat windows mage fields build goTestUnit ['windows-2008-r2']
metricbeat build RACE_DETECTOR=1 make -C metricbeat check testsuite integration-tests-environment ['linux && ubuntu-16'] 🔴 (see #21961)
metricbeat crosscompile make -C metricbeat crosscompile ['linux && ubuntu-16']
metricbeat windows mage fields build goTestUnit ['windows-2008-r2'] 🔴 (see #22257)
packetbeat build RACE_DETECTOR=1 make -C packetbeat check testsuite ['linux && ubuntu-16'] 🔴 (see #22266)
packetbeat windows mage fields build goTestUnit ['windows-2008-r2']
winlogbeat build RACE_DETECTOR=1 make -C winlogbeat check testsuite ['linux && ubuntu-16'] 🔴 (see #22265)
winlogbeat crosscompile make -C winlogbeat crosscompile ['linux && ubuntu-16']
winlogbeat windows mage fields build goTestUnit ['windows-2008-r2']
x-pack/auditbeat build RACE_DETECTOR=1 make -C auditbeat check testsuite integration-tests-environment ['linux && ubuntu-16']
x-pack/auditbeat windows mage fields build goTestUnit ['windows-2008-r2']
x-pack/filebeat build RACE_DETECTOR=1 make -C x-pack/filebeat check testsuite ['linux && ubuntu-16']
x-pack/filebeat windows dev-tools/jenkins_ci.ps1 ['windows-2008-r2'] 🔴 (see #21963)
x-pack/functionbeat build RACE_DETECTOR=1 make -C x-pack/functionbeat check testsuite integration-tests-environment ['linux && ubuntu-16']
x-pack/functionbeat windows mage fields build goTestUnit ['windows-2008-r2']
x-pack/libbeat build RACE_DETECTOR=1 make -C x-pack/libbeat check testsuite integration-tests-environment ['linux && ubuntu-16']
x-pack/libbeat windows mage fields build goTestUnit ['windows-2008-r2']
x-pack/metricbeat build RACE_DETECTOR=1 make -C x-pack/metricbeat check testsuite integration-tests-environment ['linux && ubuntu-16'] 🔴 (see #21962)
x-pack/metricbeat windows mage fields build goTestUnit ['windows-2008-r2'] 🔴 (see #22269 )
x-pack/winlogbeat windows mage fields build goTestUnit ['windows-2008-r2'] 🔴 (see #22263)

Further details

[2020-10-19T10:28:30.560Z] E1019 10:28:30.342021    2980 start.go:159] Error starting host: Error getting state for host: sudo: no tty present and no askpass program specified

Issues

cherry-pick from https://github.com/elastic/beats/commits/master/Jenkinsfile

@v1v v1v added automation ci Team:Automation Label for the Observability productivity team labels Oct 15, 2020
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Oct 15, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Oct 15, 2020

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21859 updated]

  • Start Time: 2020-10-29T16:01:17.132+0000

  • Duration: 33 min 7 sec

Test stats 🧪

Test Results
Failed 0
Passed 3471
Skipped 130
Total 3601

kuisathaverat and others added 10 commits October 16, 2020 15:21
This copies the build process that we have in Travis. Every module has its own stage that runs in parallel with the other modules stages, modules are only built and test if there are changes in the module or in libbeat, this is a start point to build only the things that we need.
* fix: avoid to modify go.mod file

* test: do we need govendor?

* fix: disable modules also when install mage

* Update .ci/scripts/install-tools.bat

* remove govendor code

* Update .ci/scripts/install-tools.bat
* Ensure install scripts only install once

* Add unmet dep str
based on the file dev-tools/jenkins_ci.ps1
@v1v v1v self-assigned this Oct 16, 2020
kuisathaverat and others added 12 commits October 16, 2020 16:48
* feat: run test on Windows

* chore: parameter to enable/disable windows test

* deleteDir before of the checkout

* Update Jenkinsfile

* Update Jenkinsfile

* Update Jenkinsfile

* Update Jenkinsfile

* Update Jenkinsfile

* Apply suggestions from code review

* feat: apply dependency hierarchies

* fit: use isChanged for all matches, and add the libbeat match where it is needed

* feat: add x-pack/winlogbeat windows unit tests

* fix: duplicate when condition

* Update Jenkinsfile

Co-Authored-By: Andrew Kroh <andrew.kroh@elastic.co>

Co-authored-by: Andrew Kroh <andrew.kroh@elastic.co>
v1v added 18 commits October 22, 2020 15:00
* upstream/6.8:
  Fix linting (elastic#22087)
  docs: Prepare Changelog for 6.8.13 (elastic#22072)
  chore: update version (elastic#21928)
  docs: update docs (elastic#21925)
  chore: update test environment (elastic#21926)
* upstream/6.8:
  Edit 6.8.13 release notes (elastic#22108)
  Cherry-pick elastic#21981 to 6.8: fix the url of reviewdog (elastic#22071)
@v1v v1v requested review from andrewkroh, jsoriano, urso and a team October 29, 2020 16:39
@v1v v1v marked this pull request as ready for review October 29, 2020 16:39
@v1v v1v merged commit 62f1115 into elastic:6.8 Oct 30, 2020
@v1v v1v deleted the feature/ci-2.0-6.8 branch October 30, 2020 09:13
@v1v v1v mentioned this pull request Oct 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automation ci Team:Automation Label for the Observability productivity team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants