feat(pingcap/tiflow): tiflow split release 8.2 jobs (#3008)

### **User description** tiflow split release 8.2 jobs ___ ### **PR Type** Enhancement, Tests ___ ### **Description** - Created new folders and pipeline jobs for `pingcap/tiflow` release 8.2. - Implemented pipeline scripts for various integration tests including Kafka, MySQL, Pulsar, Storage, DM compatibility, and DM integration. - Defined Kubernetes pod templates for the new pipeline jobs. - Updated kustomization to include the new presubmits for release 8.2. ___ ### **Changes walkthrough** 📝 <table><thead><tr><th></th><th align="left">Relevant files</th></tr></thead><tbody><tr><td><strong>Enhancement </strong></td><td><details><summary>25 files</summary><table> <tr> <td> <details> <summary><strong>aa_folder.groovy</strong><dd><code>Create folder for `pingcap/tiflow` release 8.2 pipelines</code>  </dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/aa_folder.groovy <li>Created a new folder for <code>pingcap/tiflow</code> release 8.2 pipelines.<br> <li> Added a description for the folder.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-339e55b201ef3e23cc6c0963253830b8cbb24d58fd46276b7edb6478e56b844a">+3/-0</a>      </td> </tr> <tr> <td> <details> <summary><strong>ghpr_verify.groovy</strong><dd><code>Define `ghpr_verify` pipeline job for release 8.2</code>                </dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/ghpr_verify.groovy <li>Defined a new pipeline job for <code>ghpr_verify</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-c56cc93573763bd5f6ae2ee4a79b4c5ecdb33cf3c0484c9d101fd9a0e89d6f76">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_kafka_test.groovy</strong><dd><code>Define `pull_cdc_integration_kafka_test` pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test.groovy <li>Defined a new pipeline job for <code>pull_cdc_integration_kafka_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-bca3e7098af36868af0b99be6e605341ab6f990a3174f9f14450b197f39305ef">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_mysql_test.groovy</strong><dd><code>Define `pull_cdc_integration_mysql_test` pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test.groovy <li>Defined a new pipeline job for <code>pull_cdc_integration_mysql_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-6f848498210cad8b95bf75651632b36be34ca2f2aff37ff54d381b0f0eca8080">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_pulsar_test.groovy</strong><dd><code>Define <code>pull_cdc_integration_pulsar_test</code> pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test.groovy <li>Defined a new pipeline job for <code>pull_cdc_integration_pulsar_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-c8d141f33aab8ea5bcfa46ca36808469e764b77c1c57ab6098adc5e4419bd0fd">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_storage_test.groovy</strong><dd><code>Define <code>pull_cdc_integration_storage_test</code> pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test.groovy <li>Defined a new pipeline job for <code>pull_cdc_integration_storage_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-ac26bcfd0e593c87a437582a49f0de2fa15ebce018650eb387278b60448511f2">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_dm_compatibility_test.groovy</strong><dd><code>Define `pull_dm_compatibility_test` pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_dm_compatibility_test.groovy <li>Defined a new pipeline job for <code>pull_dm_compatibility_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-0dcf03e1a5ddaf4f73bc919731a5ae46c4c9d271cdc0d9b28b8744c5326a1753">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_dm_integration_test.groovy</strong><dd><code>Define `pull_dm_integration_test` pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_dm_integration_test.groovy <li>Defined a new pipeline job for <code>pull_dm_integration_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-84c1e789459390c72eab99ea792faf0287dc68875481a2b705d51eb99bf9cba7">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pull_engine_integration_test.groovy</strong><dd><code>Define `pull_engine_integration_test` pipeline job for release 8.2</code></dd></summary> <hr> jobs/pingcap/tiflow/release-8.2/pull_engine_integration_test.groovy <li>Defined a new pipeline job for <code>pull_engine_integration_test</code>.<br> <li> Configured GitHub project URL and SCM settings.<br> <li> Added parameters and log rotation settings.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-d4e91c22cdcbcdb88f3dbc38bfb64b2d845e402dbf9a0670bc30ef609ed3151a">+37/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>ghpr_verify.groovy</strong><dd><code>Implement `ghpr_verify` pipeline script for release 8.2</code>    </dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/ghpr_verify.groovy <li>Implemented the <code>ghpr_verify</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-fa77977d938fde84b37bd1716c30159c0b8560463f05f67502db45fcade75f18">+114/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_kafka_test.groovy</strong><dd><code>Implement <code>pull_cdc_integration_kafka_test</code> pipeline script for release <br>8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test.groovy <li>Implemented the <code>pull_cdc_integration_kafka_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-beed5a839362dc58691be662a4bdc0118cfacfff2121015157ff67c0a9854091">+186/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_mysql_test.groovy</strong><dd><code>Implement <code>pull_cdc_integration_mysql_test</code> pipeline script for release <br>8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test.groovy <li>Implemented the <code>pull_cdc_integration_mysql_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-a15b792c17fe4b7e2e325fa7189acee5ce5bb153b0d99759b6ba0d49fe07431a">+174/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_pulsar_test.groovy</strong><dd><code>Implement <code>pull_cdc_integration_pulsar_test</code> pipeline script for release <br>8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test.groovy <li>Implemented the <code>pull_cdc_integration_pulsar_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-f2a506647a81220597db1b49119559fb2b4a65d2466332659e9c92a451d792f1">+169/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_cdc_integration_storage_test.groovy</strong><dd><code>Implement <code>pull_cdc_integration_storage_test</code> pipeline script for <br>release 8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test.groovy <li>Implemented the <code>pull_cdc_integration_storage_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-8f8b408b2662f478885ddf9b96b8a158699c94968767a1f17588b9b348f086c0">+174/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_dm_compatibility_test.groovy</strong><dd><code>Implement <code>pull_dm_compatibility_test</code> pipeline script for release 8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_dm_compatibility_test.groovy <li>Implemented the <code>pull_dm_compatibility_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-a8beaffa40b2c4d132c0ece04ab902b7b40355b5d03f6d30825b295bcee1a15c">+155/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_dm_integration_test.groovy</strong><dd><code>Implement `pull_dm_integration_test` pipeline script for release 8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_dm_integration_test.groovy <li>Implemented the <code>pull_dm_integration_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-06c105db3145c66697deee88427d598bac8d0e5e8fbe29aaa3b747896a1dba0a">+212/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pull_engine_integration_test.groovy</strong><dd><code>Implement <code>pull_engine_integration_test</code> pipeline script for release 8.2</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pull_engine_integration_test.groovy <li>Implemented the <code>pull_engine_integration_test</code> pipeline script.<br> <li> Configured Kubernetes agent, environment variables, and stages.<br> <li> Added stages for debug info, checkout, preparation, and tests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-e70ee44c4b7a09a9fe447b46e2e236287a36fabd6079d0fa9308162e709efb33">+220/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pod-ghpr_verify.yaml</strong><dd><code>Define Kubernetes pod template for `ghpr_verify`</code>                  </dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-ghpr_verify.yaml <li>Defined Kubernetes pod template for <code>ghpr_verify</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-d4ac1ac9be9043bd54d199bcdb5ef68534663daeb99d755117501d8bd0cbcbf0">+44/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_cdc_integration_kafka_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_cdc_integration_kafka_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_cdc_integration_kafka_test.yaml <li>Defined Kubernetes pod template for <code>pull_cdc_integration_kafka_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-dcb12d5f5cddde39f79c4e5efb25aa96430e82f84c6b156f15b779bdd3f37130">+160/-0</a>  </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_cdc_integration_mysql_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_cdc_integration_mysql_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_cdc_integration_mysql_test.yaml <li>Defined Kubernetes pod template for <code>pull_cdc_integration_mysql_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-ddc37e3972c48417012d2378f1f887d718a01efe11c70bd72c6522fdbe96314a">+32/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_cdc_integration_pulsar_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_cdc_integration_pulsar_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_cdc_integration_pulsar_test.yaml <li>Defined Kubernetes pod template for <code>pull_cdc_integration_pulsar_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-146c19d00dd779fd61647c1b3a99650838f89fcc4497e028480e8c29a9fbfd06">+32/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_cdc_integration_storage_test.yaml</strong><dd><code>Define Kubernetes pod template for <code>pull_cdc_integration_storage_test</code></code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_cdc_integration_storage_test.yaml <li>Defined Kubernetes pod template for <code>pull_cdc_integration_storage_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-73db5bc2fcfa6d8224e78195cdfded4c263157bb69077095bd1b1319283e2427">+32/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_dm_compatibility_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_dm_compatibility_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_dm_compatibility_test.yaml <li>Defined Kubernetes pod template for <code>pull_dm_compatibility_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-3ef2e5c31019b0aa9e4d49f3b5c3abdde0a35a97e65ae85b9be7ec9f023355c8">+70/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_dm_integration_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_dm_integration_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_dm_integration_test.yaml <li>Defined Kubernetes pod template for <code>pull_dm_integration_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-c1b12c7f4df060468037f9e599b7f85beb2ba2aaf18a2ccd128f0892ba9fa5f4">+70/-0</a>    </td> </tr> <tr> <td> <details> <summary><strong>pod-pull_engine_integration_test.yaml</strong><dd><code>Define Kubernetes pod template for `pull_engine_integration_test`</code></dd></summary> <hr> pipelines/pingcap/tiflow/release-8.2/pod-pull_engine_integration_test.yaml <li>Defined Kubernetes pod template for <code>pull_engine_integration_test</code>.<br> <li> Configured containers and volume mounts.<br> <li> Set resource limits and requests.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-6976b5a895091afaf1ee4d87bfa45567401f0fc061faa680463b1746b2e159b1">+80/-0</a>    </td> </tr> </table></details></td></tr><tr><td><strong>Configuration changes </strong></td><td><details><summary>2 files</summary><table> <tr> <td> <details> <summary><strong>kustomization.yaml</strong><dd><code>Update kustomization to include release 8.2 presubmits</code>      </dd></summary> <hr> prow-jobs/kustomization.yaml - Added new entry for `release-8.2-presubmits.yaml`. </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-2a448e5f33de2760b641240deffcaf4996310b93b9258eb0c83c6b44838c024c">+22/-21</a>  </td> </tr> <tr> <td> <details> <summary><strong>release-8.2-presubmits.yaml</strong><dd><code>Define presubmits for `pingcap/tiflow` release 8.2</code>              </dd></summary> <hr> prow-jobs/pingcap/tiflow/release-8.2-presubmits.yaml <li>Defined presubmits for <code>pingcap/tiflow</code> release 8.2.<br> <li> Configured triggers, contexts, and branches.<br> </details> </td> <td><a href="https://github.com/PingCAP-QE/ci/pull/3008/files#diff-33137a30ee5e4844b56ea147de5807f62d47bff1ebdbad0a7a135fdd4502cdb5">+97/-0</a>    </td> </tr> </table></details></td></tr></tr></tbody></table> ___ > 💡 **PR-Agent usage**: >Comment `/help` on the PR to get a list of all available PR-Agent tools and their descriptions
PingCAP-QE · Jun 25, 2024 · 180bd9a · 180bd9a
1 parent f07ffca
commit 180bd9a
Show file tree

Hide file tree

Showing 27 changed files with 2,342 additions and 21 deletions.
diff --git a/jobs/pingcap/tiflow/release-8.2/aa_folder.groovy b/jobs/pingcap/tiflow/release-8.2/aa_folder.groovy
@@ -0,0 +1,3 @@
+folder('pingcap/tiflow/release-8.2') {
+    description("Folder for pipelines of pingcap/tiflow repo for v8.2")
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/ghpr_verify.groovy b/jobs/pingcap/tiflow/release-8.2/ghpr_verify.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/ghpr_verify') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/ghpr_verify.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_kafka_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_mysql_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_pulsar_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_cdc_integration_storage_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_dm_compatibility_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_dm_compatibility_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_dm_compatibility_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_dm_compatibility_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_dm_integration_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_dm_integration_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_dm_integration_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_dm_integration_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}
diff --git a/jobs/pingcap/tiflow/release-8.2/pull_engine_integration_test.groovy b/jobs/pingcap/tiflow/release-8.2/pull_engine_integration_test.groovy
@@ -0,0 +1,37 @@
+// REF: https://<your-jenkins-server>/plugin/job-dsl/api-viewer/index.html
+pipelineJob('pingcap/tiflow/release-8.2/pull_engine_integration_test') {
+    logRotator {
+        daysToKeep(30)
+    }
+    parameters {
+        // Ref: https://docs.prow.k8s.io/docs/jobs/#job-environment-variables
+        stringParam("BUILD_ID")
+        stringParam("PROW_JOB_ID")
+        stringParam("JOB_SPEC")
+    }
+    properties {
+        githubProjectUrl("https://github.com/pingcap/tiflow")
+    }
+
+    definition {
+        cpsScm {
+            lightweight(true)
+            scriptPath("pipelines/pingcap/tiflow/release-8.2/pull_engine_integration_test.groovy")
+            scm {
+                git{
+                    remote {
+                        url('https://github.com/PingCAP-QE/ci.git')
+                    }
+                    branch('main')
+                    extensions {
+                        cloneOptions {
+                            depth(1)
+                            shallow(true)
+                            timeout(5)
+                        } 
+                    }
+                }
+            }
+        }
+    }
+}