Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[packaging][beats-tester] use commit id binaries #22027

Merged
merged 17 commits into from
Oct 30, 2020

Conversation

v1v
Copy link
Member

@v1v v1v commented Oct 20, 2020

What does this PR do?

#21903 in place therefore let's consume those artifacts/binaries, for such, the parentstream will store their build data to be consumed by the downstream jobs.

More context

Packaging

  • for branches/tags then the beats pipeline triggers the packaging pipeline, therefore this approach will ensure the packaging will happen for that particular commit id.
  • for PRs, the packaging pipeline only happens with a /packaging comment, therefore it will use the latest commit.

Beats tester

Beats tester pipeline that has been triggered by the packaging pipeline then the commit id used for the packaging will be the one used for.

Why is it important?

Avoid known issues when the beats-tester and end2end pipelines consume artifacts that don't match with the upstream build that caused the package generation.

Related issues

Relates #21903
Blocked by elastic/beats-tester#185

Tests

image

image

  • commit id and URLs are passed between the three pipelines packaging -> beats-tester

image

image

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 20, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented Oct 20, 2020

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [v1v commented: Jenkins run the tests please]

  • Start Time: 2020-10-29T11:50:20.208+0000

  • Duration: 73 min 23 sec

Test stats 🧪

Test Results
Failed 0
Passed 16374
Skipped 1344
Total 17718

@andresrc andresrc added [zube]: Inbox [zube]: In Review Team:Automation Label for the Observability productivity team Team:Services (Deprecated) Label for the former Integrations-Services team and removed [zube]: Inbox labels Oct 20, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 20, 2020
@zube zube bot added [zube]: Inbox needs_team Indicates that the issue/PR needs a Team:* label [zube]: In Review and removed Team:Automation Label for the Observability productivity team Team:Services (Deprecated) Label for the former Integrations-Services team [zube]: In Review [zube]: Inbox labels Oct 20, 2020
@andresrc andresrc added [zube]: In Progress Team:Automation Label for the Observability productivity team Team:Services (Deprecated) Label for the former Integrations-Services team and removed [zube]: In Review labels Oct 20, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 20, 2020
@v1v
Copy link
Member Author

v1v commented Oct 21, 2020

/packaging

…ter-commit

* upstream/master:
  feat: package aliases for snapshots (elastic#21960)
  [DOC] Add firewall as possible troubleshooting issue (elastic#21743)
  [Filebeat] Add max_number_of_messages config parameter for S3 input (elastic#21993)
  [Elastic Agent] Fix missing elastic_agent event data  (elastic#21994)
  Document auditbeat system process module config (elastic#21766)
  Update links (elastic#22012)
@v1v
Copy link
Member Author

v1v commented Oct 21, 2020

/packaging

1 similar comment
@v1v
Copy link
Member Author

v1v commented Oct 21, 2020

/packaging

@v1v
Copy link
Member Author

v1v commented Oct 21, 2020

/package

…ter-commit

* upstream/master:
  [Ingest Manager] Use ML_SYSTEM to detect if agent is running as a service (elastic#21884)
  Prevent log input from sending duplicate messages due to file renaming (elastic#21911)
@v1v v1v requested a review from a team October 28, 2020 15:36
@v1v v1v self-assigned this Oct 28, 2020
@v1v v1v marked this pull request as ready for review October 28, 2020 15:39
@elasticmachine
Copy link
Collaborator

Pinging @elastic/integrations-services (Team:Services)

gitCheckout(basedir: "${BASE_DIR}", branch: props.COMMIT)
} catch(err) {
// Fallback to the head of the branch as used to be.
gitCheckout(basedir: "${BASE_DIR}")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

in case of error getting the artifact the build will continue, Is that correct?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, just wanted to keep the backward compatibility with the existing behaviour, which it's not ideal, but just in case something bad happens when fetching the artifacts from the upstream build, at least the behaviour will remain working

@elasticmachine
Copy link
Collaborator

elasticmachine commented Oct 28, 2020

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 16374
Skipped 1344
Total 17718

.ci/packaging.groovy Outdated Show resolved Hide resolved
Co-authored-by: cachedout <mike.place@elastic.co>
@v1v
Copy link
Member Author

v1v commented Oct 29, 2020

Jenkins run the tests please

@v1v
Copy link
Member Author

v1v commented Oct 29, 2020

/package

@v1v v1v merged commit 2ad0b88 into elastic:master Oct 30, 2020
@v1v v1v deleted the feature/beats-tester-commit branch October 30, 2020 13:25
v1v added a commit to v1v/beats that referenced this pull request Oct 30, 2020
* upstream/master:
  [JJBB] Add 6.8+ branches (elastic#22321)
  [CI] Support Windows-8 (elastic#22307)
  Change cloud.provider from googlecloud to gcp in billing metricset (elastic#22287)
  [packaging][beats-tester] use commit id binaries (elastic#22027)
  [CI] Report error in the catch section (elastic#22297)
v1v added a commit to v1v/beats that referenced this pull request Oct 30, 2020
* upstream/master:
  [JJBB] Add 6.8+ branches (elastic#22321)
  [CI] Support Windows-8 (elastic#22307)
  Change cloud.provider from googlecloud to gcp in billing metricset (elastic#22287)
  [packaging][beats-tester] use commit id binaries (elastic#22027)
  [CI] Report error in the catch section (elastic#22297)
v1v added a commit to v1v/beats that referenced this pull request Nov 2, 2020
# Conflicts:
#	.ci/packaging.groovy
#	Jenkinsfile
v1v added a commit to v1v/beats that referenced this pull request Nov 6, 2020
v1v added a commit to v1v/beats that referenced this pull request Nov 6, 2020
@zube zube bot removed the [zube]: Done label Jan 29, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Automation Label for the Observability productivity team Team:Services (Deprecated) Label for the former Integrations-Services team
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants