[ci] migrate extended runtime leak tests to buildkite #7931

pkoutsovasilis · 2025-04-22T21:02:44Z

What does this PR do?

This PR migrates the Extended Runtime Leak Tests to Buildkite, where all other integration and Kubernetes tests now reside. The new setup runs these tests on Windows 2022, Windows 2025, and Ubuntu 24.04 using existing prebuilt VM images. The old step is removed to avoid duplication and eliminate the dependency on OGC.

Proof that we run the same tests:

Why is it important?

This resolves reliability issues in the old extended testing setup, aligning them with our current CI strategy and infrastructure.

Checklist

I have read and understood the pull request guidelines of this project.
My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in ./changelog/fragments using the changelog tool
I have added an integration test or an E2E test

Disruptive User Impact

None. This change only affects internal CI configuration.

How to test this PR locally

Open a PR 🙂

Related issues

Closes https://github.com/elastic/ingest-dev/issues/5269

elastic-sonarqube · 2025-04-25T08:41:15Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

elasticmachine · 2025-04-25T09:28:25Z

💚 Build Succeeded

Buildkite Build
Commit: 6b2bf11

cc @pkoutsovasilis

v1v

LGTM.

I think we are reaching a point where we copy&paste groups/steps is becoming a burden. I'll start a conversation internally about tit

pkoutsovasilis · 2025-04-25T11:51:25Z

LGTM.

I think we are reaching a point where we copy&paste groups/steps is becoming a burden. I'll start a conversation internally about tit

I agree 100% with this and I will be happy to join any discussions about it 🙂

pkoutsovasilis · 2025-04-25T11:52:37Z

I will kindly also request a review from you @ycombinator (a control-plane team member) just to have an extra pair of 👀 here from the product PoV 🙏

mergify · 2025-04-25T15:24:40Z

This pull request is now in conflicts. Could you fix it? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

git fetch upstream
git checkout -b ci/migrate_extended_runtime_leak_to_buildkite upstream/ci/migrate_extended_runtime_leak_to_buildkite
git merge upstream/main
git push upstream ci/migrate_extended_runtime_leak_to_buildkite

elastic-sonarqube · 2025-05-29T09:09:41Z

Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

pkoutsovasilis · 2025-06-02T12:51:26Z

@v1v @dliappis gentle reminder

dliappis

LGTM thank you!

.buildkite/bk.integration.pipeline.yml

pazone

LGTM.
The TEST_NAME_PATTERN reminds me that we are about to reach the maintainability threshold. Let's consider a follow-up simplification and refactoring

pchila

LGTM

github-actions · 2025-06-03T14:14:52Z

@Mergifyio backport 8.17 8.18 8.19 9.0

mergify · 2025-06-03T14:15:04Z

backport 8.17 8.18 8.19 9.0

✅ Backports have been created

#8307 [8.17] (backport #7931) [ci] migrate extended runtime leak tests to buildkite has been created for branch 8.17 but encountered conflicts
#8308 [8.18] (backport #7931) [ci] migrate extended runtime leak tests to buildkite has been created for branch 8.18
#8309 [8.19] (backport #7931) [ci] migrate extended runtime leak tests to buildkite has been created for branch 8.19
#8310 [9.0] (backport #7931) [ci] migrate extended runtime leak tests to buildkite has been created for branch 9.0

(cherry picked from commit f108618) # Conflicts: # .buildkite/scripts/buildkite-integration-tests.sh # .buildkite/scripts/integration-tests.ps1

(cherry picked from commit f108618)

…uildkite (#8307) * ci: migrate extended runtime leak tests to buildkite (#7931) (cherry picked from commit f108618) # Conflicts: # .buildkite/scripts/buildkite-integration-tests.sh # .buildkite/scripts/integration-tests.ps1 * fix: resolve conflicts * fix: remove --junitfile-hide-skipped-tests from gotestsum --------- Co-authored-by: Panos Koutsovasilis <panos.koutsovasilis@elastic.co>

(cherry picked from commit f108618) Co-authored-by: Panos Koutsovasilis <panos.koutsovasilis@elastic.co>

pkoutsovasilis added skip-changelog backport-active-all Automated backport with mergify to all the active branches labels Apr 22, 2025

pkoutsovasilis self-assigned this Apr 22, 2025

pkoutsovasilis force-pushed the ci/migrate_extended_runtime_leak_to_buildkite branch 2 times, most recently from 3d63b2b to 6b2bf11 Compare April 25, 2025 07:36

pkoutsovasilis marked this pull request as ready for review April 25, 2025 11:41

pkoutsovasilis requested review from a team as code owners April 25, 2025 11:41

v1v previously approved these changes Apr 25, 2025

View reviewed changes

pkoutsovasilis requested a review from ycombinator April 25, 2025 11:51

pkoutsovasilis marked this pull request as draft April 25, 2025 15:05

ci: migrate extended runtime leak tests to buildkite

4e1a561

pkoutsovasilis dismissed v1v’s stale review via 4e1a561 May 29, 2025 08:02

pkoutsovasilis force-pushed the ci/migrate_extended_runtime_leak_to_buildkite branch from 6b2bf11 to 4e1a561 Compare May 29, 2025 08:02

pkoutsovasilis requested a review from dliappis May 29, 2025 10:08

pkoutsovasilis marked this pull request as ready for review May 29, 2025 10:08

pkoutsovasilis requested a review from v1v May 29, 2025 10:36

dliappis approved these changes Jun 3, 2025

View reviewed changes

.buildkite/bk.integration.pipeline.yml Show resolved Hide resolved

.buildkite/bk.integration.pipeline.yml Show resolved Hide resolved

pazone self-requested a review June 3, 2025 11:24

pazone approved these changes Jun 3, 2025

View reviewed changes

v1v approved these changes Jun 3, 2025

View reviewed changes

pchila approved these changes Jun 3, 2025

View reviewed changes

pkoutsovasilis merged commit f108618 into elastic:main Jun 3, 2025
11 checks passed

mergify bot pushed a commit that referenced this pull request Jun 3, 2025

ci: migrate extended runtime leak tests to buildkite (#7931)

2982a40

(cherry picked from commit f108618) # Conflicts: # .buildkite/scripts/buildkite-integration-tests.sh # .buildkite/scripts/integration-tests.ps1

mergify bot pushed a commit that referenced this pull request Jun 3, 2025

ci: migrate extended runtime leak tests to buildkite (#7931)

5a9346a

(cherry picked from commit f108618)

mergify bot pushed a commit that referenced this pull request Jun 3, 2025

ci: migrate extended runtime leak tests to buildkite (#7931)

8eb49b3

(cherry picked from commit f108618)

mergify bot pushed a commit that referenced this pull request Jun 3, 2025

ci: migrate extended runtime leak tests to buildkite (#7931)

48ede3b

(cherry picked from commit f108618)

mergify bot mentioned this pull request Jun 3, 2025

[9.0] (backport #7931) [ci] migrate extended runtime leak tests to buildkite #8310

Merged

8 tasks

pkoutsovasilis added a commit that referenced this pull request Jun 4, 2025

ci: migrate extended runtime leak tests to buildkite (#7931) (#8309)

0e2439c

(cherry picked from commit f108618) Co-authored-by: Panos Koutsovasilis <panos.koutsovasilis@elastic.co>

pkoutsovasilis added a commit that referenced this pull request Jun 4, 2025

ci: migrate extended runtime leak tests to buildkite (#7931) (#8310)

68f86d5

(cherry picked from commit f108618) Co-authored-by: Panos Koutsovasilis <panos.koutsovasilis@elastic.co>

pkoutsovasilis mentioned this pull request Jun 4, 2025

ci: update all n1-standard-8 type runners to n2-standard-8 #8320

Merged

8 tasks

pkoutsovasilis added a commit that referenced this pull request Jun 5, 2025

ci: migrate extended runtime leak tests to buildkite (#7931) (#8308)

3f64041

(cherry picked from commit f108618) Co-authored-by: Panos Koutsovasilis <panos.koutsovasilis@elastic.co>

pkoutsovasilis mentioned this pull request Jun 5, 2025

ci: update all n1-standard-4 type runners to n2-standard-4 #8340

Merged

8 tasks

[ci] migrate extended runtime leak tests to buildkite #7931

[ci] migrate extended runtime leak tests to buildkite #7931

Uh oh!

Conversation

pkoutsovasilis commented Apr 22, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Why is it important?

Checklist

Disruptive User Impact

How to test this PR locally

Related issues

Uh oh!

elastic-sonarqube bot commented Apr 25, 2025

Quality Gate passed

Uh oh!

elasticmachine commented Apr 25, 2025

💚 Build Succeeded

Uh oh!

v1v left a comment

Choose a reason for hiding this comment

Uh oh!

pkoutsovasilis commented Apr 25, 2025

Uh oh!

pkoutsovasilis commented Apr 25, 2025

Uh oh!

mergify bot commented Apr 25, 2025

Uh oh!

elastic-sonarqube bot commented May 29, 2025

Quality Gate passed

Uh oh!

pkoutsovasilis commented Jun 2, 2025

Uh oh!

dliappis left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

pazone left a comment

Choose a reason for hiding this comment

Uh oh!

pchila left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot commented Jun 3, 2025

Uh oh!

mergify bot commented Jun 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Backports have been created

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

pkoutsovasilis commented Apr 22, 2025 •

edited

Loading

mergify bot commented Jun 3, 2025 •

edited

Loading