-
Notifications
You must be signed in to change notification settings - Fork 4.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CI] 2.0 pipeline for 6.8 #21859
Merged
Merged
[CI] 2.0 pipeline for 6.8 #21859
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
v1v
added
automation
ci
Team:Automation
Label for the Observability productivity team
labels
Oct 15, 2020
botelastic
bot
added
needs_team
Indicates that the issue/PR needs a Team:* label
and removed
needs_team
Indicates that the issue/PR needs a Team:* label
labels
Oct 15, 2020
Collaborator
This copies the build process that we have in Travis. Every module has its own stage that runs in parallel with the other modules stages, modules are only built and test if there are changes in the module or in libbeat, this is a start point to build only the things that we need.
* fix: avoid to modify go.mod file * test: do we need govendor? * fix: disable modules also when install mage * Update .ci/scripts/install-tools.bat * remove govendor code * Update .ci/scripts/install-tools.bat
* Ensure install scripts only install once * Add unmet dep str
based on the file dev-tools/jenkins_ci.ps1
based on the file dev-tools/jenkins_ci.sh
* feat: run test on Windows * chore: parameter to enable/disable windows test * deleteDir before of the checkout * Update Jenkinsfile * Update Jenkinsfile * Update Jenkinsfile * Update Jenkinsfile * Update Jenkinsfile * Apply suggestions from code review * feat: apply dependency hierarchies * fit: use isChanged for all matches, and add the libbeat match where it is needed * feat: add x-pack/winlogbeat windows unit tests * fix: duplicate when condition * Update Jenkinsfile Co-Authored-By: Andrew Kroh <andrew.kroh@elastic.co> Co-authored-by: Andrew Kroh <andrew.kroh@elastic.co>
v1v
commented
Oct 22, 2020
* upstream/6.8: Fix linting (elastic#22087) docs: Prepare Changelog for 6.8.13 (elastic#22072) chore: update version (elastic#21928) docs: update docs (elastic#21925) chore: update test environment (elastic#21926)
* upstream/6.8: Edit 6.8.13 release notes (elastic#22108) Cherry-pick elastic#21981 to 6.8: fix the url of reviewdog (elastic#22071)
kuisathaverat
approved these changes
Oct 29, 2020
cachedout
approved these changes
Oct 30, 2020
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Transform elastic+beats+6.8 to 2.0 pipeline for the 6.8 branch. For such I've cherry-picked a few PRs that contains the 2.0 implementation. I've disabled all the stages that are failing and reported those build/test errors as GitHub issues, for the record, those build/test errors are also happening in the existing 1.0 pipeline.
Why is it important?
Avoid JJB and use the same CI pipeline that's used for the master and other release branches.
Status
RACE_DETECTOR=1 make -C auditbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
make -C auditbeat crosscompile
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C filebeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
make -C generator/ test
['linux && ubuntu-16']
RACE_DETECTOR=1 make -C heartbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C journalbeat check testsuite
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C libbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
make -C libbeat crosscompile
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C metricbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
make -C metricbeat crosscompile
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C packetbeat check testsuite
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C winlogbeat check testsuite
['linux && ubuntu-16']
make -C winlogbeat crosscompile
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C auditbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C x-pack/filebeat check testsuite
['linux && ubuntu-16']
dev-tools/jenkins_ci.ps1
['windows-2008-r2']
RACE_DETECTOR=1 make -C x-pack/functionbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C x-pack/libbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
RACE_DETECTOR=1 make -C x-pack/metricbeat check testsuite integration-tests-environment
['linux && ubuntu-16']
mage fields build goTestUnit
['windows-2008-r2']
mage fields build goTestUnit
['windows-2008-r2']
Further details
Test failures for
auditbeat
-> [auditbeat][6.8][windows] TestEventReader #21958Ingtest for
libbeat
-> [libbeat][6.8] libbeat integration-tests-environment is broken #21959Ingtests for
metricbeat
-> [metricbeat][6.8] metricbeat integration-tests-environment is broken #21961x-pack/metricbeat
-> [x-pack/metricbeat][6.8] x-pack/metricbeat build does not work #21962System testing for
x-pack/filebeat
on Windows -> [x-pack/filebeat][6.8][windows] System testing is broken #21963System testing for
x-pack/auditbeat
on Windows -> [x-pack/auditbeat][6.8][windows] System testing is broken #21964System testing for
winlogbeat
on Windows -> [winlogbeat][6.8][windows] System testing is broken #21966System testing for
hearbeat
on Windows -> [heartbeat][6.8][windows] System testing is broken #21967System testing for
filebeat
on Windows ->[filebeat][6.8][windows] System testing is broken #21968clean
goal is not workingdeploy/kubernetes is not enable in Jenkins but in Travis (in Jenkins does not work since it requires sudo)
Issues
cherry-pick from https://github.com/elastic/beats/commits/master/Jenkinsfile