[CI] [6.8] Pipeline backports

[brianseeders]

Closes #69964

I checked out 6.8, copied over all of the Pipeline-related files from master, and then removed the tasks and such not relevant for 6.8. All of the pipeline files are really close to what they are in master now, which should make backporting easier.

The test results in Jenkins for the PR match the base branch, and GCS uploads look good.

This should bring a bunch of fixes, some big and some small, e.g. slack notifications not working at all for 6.8.

If you want to actually review the changes, my recommendation would be to diff vars/, Jenkinsfile, and .ci/es-snapshots against master. The changes are really minimal.

Here's vars/:

--- a/vars/kibanaPipeline.groovy
+++ b/vars/kibanaPipeline.groovy
@@ -2,9 +2,10 @@ def withPostBuildReporting(Closure closure) {
   try {
     closure()
   } finally {
-    catchErrors {
-      runErrorReporter()
-    }
+    // disabled in 6.8
+    // catchErrors {
+    //   runErrorReporter()
+    // }

     catchErrors {
       runbld.junit()
@@ -25,6 +26,7 @@ def functionalTestProcess(String name, Closure closure) {

     withEnv([
       "CI_PARALLEL_PROCESS_NUMBER=${processNumber}",
+      "PARALLEL_PIPELINE_WORKER_INDEX=${processNumber}",
       "TEST_KIBANA_HOST=localhost",
       "TEST_KIBANA_PORT=${kibanaPort}",
       "TEST_KIBANA_URL=http://elastic:changeme@localhost:${kibanaPort}",
@@ -203,13 +205,10 @@ def buildXpack() {
 }

 def runErrorReporter() {
-  def status = buildUtils.getBuildStatus()
-  def dryRun = status != "ABORTED" ? "" : "--no-github-update"
-
   bash(
     """
       source src/dev/ci_setup/setup_env.sh
-      node scripts/report_failed_tests ${dryRun} target/junit/**/*.xml
+      node src/dev/failed_tests/cli
     """,
     "Report failed tests, if necessary"
   )

[brianseeders]

@elasticmachine merge upstream

[brianseeders]

@elasticmachine merge upstream

[spalger]

One minor request, but LGTM

[kibanamachine]

💚 Build Succeeded

• continuous-integration/kibana-ci/pull-request
• Commit: e2ec237

History

• 💚 Build #63935 succeeded 0bc3255
• 💚 Build #63385 succeeded 3f0584d
• 💔 Build #63032 failed 8234fa4
• 💔 Build #62768 failed 04a9fc7
• 💔 Build #62667 failed 94aa158

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream