v2024.11.8

What's Changed

• cdc: fix sync diff version by @CharlesCheung96 in #2973
• Update README.md by @wuhuizuo in #2977
• fix(deps): update module github.com/puerkitobio/goquery to v1.9.2 by @renovate in #2949
• fix(docs&docs-cn): update to image with pre install python3 packages by @purelind in #2978
• chore: update deprecated domain name by @purelind in #2979
• k8s docs: bump pdf stable version to release-1.6 by @Oreoxmt in #2969
• Define code ownership using "OWNERS" files in the central CI config repo by @wuhuizuo in #2976
• feat(scripts/artifacts): add shell function publish_tiup_from_oci_artifact_repos by @wuhuizuo in #2955
• feat: try to collect failure log after test timeout by @purelind in #2986
• feat(tikv-pd): use prow style job in 6.1 by @purelind in #2987
• chore: ignore file changed when collect log file by @purelind in #2988
• opt(pingcap/tidb-dashboard): speedup image building fo linux/arm64 target by @wuhuizuo in #2989
• opt(ti-community-infra/prow): move jobs from test-infra to prow by @wuhuizuo in #2990
• fix(ti-community-infra/prow): bump job images by @wuhuizuo in #2992
• fix: handle non-standard version information of dumpling by @purelind in #2991
• fix(scripts/artifacts): not override other parts in output file by @wuhuizuo in #2994
• fix(jenkins/pipelines/cd): keep same tags with inner repositories on GCR by @wuhuizuo in #2995
• fix(ti-community-infra/prow): fix image building jobs by @wuhuizuo in #2996
• feat(pingcap/tidb-tools): add prow style job with jenkins runner by @wuhuizuo in #2993
• fix: fix tidb-tools presubmit config by @purelind in #2997
• fix(ti-community-infra/prow): let the heavy job run in other cluster by @wuhuizuo in #2998
• fix: temp comment cross-compile platform darwin by @purelind in #2999
• feat(pingcap/tidb-tools): add integration tests by @purelind in #3000
• feat: add jobdsl for old tidb-tools pipeline by @purelind in #3001
• fix: add missing conf on joddsl by @purelind in #3002
• feat(pingcap/tidb-tools): enable new tidb-tools pipelines by @purelind in #3003
• fix(scripts/opt): update to new deno version by @wuhuizuo in #3004
• pd: make real cluster test run by @HuSharp in #3006
• feat(tiflash): upgrade to LLVM17 & remove useless prepare tool stage by @Lloyd-Pottiger in #2901
• feat: add 8.2 tikv cache image build by @purelind in #3010
• feat(pingcap/tiflow): tiflow split release 8.2 jobs by @purelind in #3008
• feat(pingcap/tidb): support ci for release-8.2 by @wuhuizuo in #3011
• feat(prow-jobs/pingcap/monitoring): add periodic type job to update file for release-8.2 by @wuhuizuo in #3007
• fix: fix jobdsl error by @purelind in #3012
• feat: tiflash and tikv split release 8.2 jobs by @purelind in #3009
• feat: daily internal build add release-8.1 by @purelind in #3013
• fix(pingcap/tikv): fix pod yaml path by @purelind in #3015
• fix: fix br & lightning job name by @purelind in #3016
• chore: sqllogic test pod use specify node by @purelind in #3017
• Update sanitizer tiflash image by @yibin87 in #3018
• docs PDF: add release-8.2 and remove archived versions by @qiancai in #3020
• Fix building tiflash-sanitizer by @JaySon-Huang in #3019
• fix(deps): update golang image for mysql_connector_test by @djshow832 in #3021
• fix(scripts/artifacts): fix check-tiup.sh by @wuhuizuo in #3023
• fix(deps): update module golang.org/x/mod to v0.19.0 by @renovate in #2984
• fix(scripts/artifacts): workaround tikv amd64 building hang problem by @wuhuizuo in #3024
• Revert "fix(scripts/artifacts): workaround tikv amd64 building hang problem" by @wuhuizuo in #3025
• Update ghpr_mysql_test.groovy by @lance6716 in #3026
• chore(tidb): archive log if test not successful by @purelind in #3028
• chore(deps): update bitnami/oras docker tag to v1.2.0-debian-12-r3 by @renovate in #2981
• chore(deps): update dependency requests to v2.32.3 by @renovate in #2967
• chore(deps): update dependency certifi to v2024.7.4 by @renovate in #3022
• docs-pdf: remove v5.1 and v7.5 as they are archived by @qiancai in #3029
• chore(deps): update dependency urllib3 to v2.2.2 by @renovate in #3005
• chore(deps): update docker docker tag to v27 by @renovate in #3014
• feat: build tiflash with rust cache by @purelind in #3031
• chore: bump master nightly version to v8.3.0-alpha by @purelind in #3033
• chore: build tiflash with rust cargo cache by @purelind in #3034
• chore(deps): update docker docker tag to v27.1 by @renovate in #3030
• chore(deps): update bitnami/oras docker tag to v1.2.0-debian-12-r5 by @renovate in #3032
• feat(tools/list-rust-dependencies): add script to list rust dependencies to csv by @wuhuizuo in #3035
• feat(pingcap/tiflow,pingcap/pd): support feature branch by @wuhuizuo in #3036
• fix(pingcap/tidb): fix the cache too large problem by @wuhuizuo in #3037
• chore(pingcap/tidb): update trigger for CI job pull-br-integration-test by @wuhuizuo in #3040
• feature(pingcap/tiflash): intergration support feature branch and ci params in PR title by @wuhuizuo in #3042
• feat(pingcap/tidb): intergration support feature branch and ci params in PR title by @purelind in #3045
• fix(scripts/artifacts): fix check-images-internal.sh by @wuhuizuo in #3046
• chore: add support for feature branch build by @purelind in #3047
• fix(pingcap/tidb): mysql-test support batch merge in 8.1 by @purelind in #3049
• chore: support auto-handle in more branches by @purelind in #3050
• Add support branch for proxy by @CalvinNeo in #3054
• feat: add presubmit pipeline on 8.1 by @purelind in #3055
• feat(pingcap/tidb): support more integration pipeline in VerfiyCI of tidb lts branches by @wuhuizuo in #3060
• chore: add net-tool container by @purelind in #3062
• fix(deps): update module golang.org/x/mod to v0.20.0 by @renovate in #3048
• chore: fix on presubmit 6.1 by @purelind in #3066
• feat: add presubmit pipelines on 7.1 by @purelind in #3061
• feat: add more presubmit pipelines on 7.5 by @purelind in #3058
• fix: add missing nettool container by @purelind in #3068
• chore(deps): update bitnami/oras docker tag to v1.2.0-debian-12-r6 by @renovate in #3067
• fix: tiflash test ci need mysql cli by @purelind in #3074
• chore: remove wip/ on test passed pipelines by @purelind in #3075
• fix: remove wip/ on test passed pipelines on 7.5 by @purelind in #3076
• feat(tikv/tikv): add refactored jobs for LTS branches by @wuhuizuo in #3065
• chore: increase timeout for nodejs test by @purelind in #3077
• feat(pingcap/tiflash): add refactored jobs for release-8.1 by @wuhuizuo in #3064
• chore: increate timeout for tiflash ut by @purelind in #3078
• feat: add cache image build for 8.3 by @purelind in #3079
• Update periodics.yaml by @wuhuizuo in #3080
• feat: tiflash & tikv split release 8.3 jobs by @purelind in #3081
• feat: tiflow split release 8.3 jobs by @purelind in #3082
• feat: tidb split release 8.3 jobs by @purelind in #3084
• feat(scripts/ops): add a script to helper skip some CI checks by @wuhuizuo in #3085
• chore: increase timeout for nodejs test by @purelind in #3086
• fix: update git version to 2.40.3 in image by @purelind in #3087
• chore: prepare to create release-8.3 branch by @wuhuizuo in #3083
• chore: update image of tiflash new pipelines by @purelind in #3088
• chore: ajust ut parallelism from 16 to 12 by @purelind in #3089
• fix(scripts/artifacts): add checks for enterprise images by @wuhuizuo in #3091
• add more trigger for lightning tests by @D3Hunter in #3093
• chore: enable pipeline of tidb-tools by @purelind in #3096
• feat(script/flow): add script ga script create_github_release.ts by @wuhuizuo in #3095
• Update latest-presubmits.yaml by @wuhuizuo in #3101
• Update latest-presubmits.yaml to add more trigger for lightning by @D3Hunter in #3102
• docs-pdf: remove v5.2 and v8.0 as they are archived by @qiancai in #3099
• update latest-presubmits.yaml to add trigger of infoschema pkg by @BornChanger in #3103
• chore(br,dm): delete jenkins/pipelines/ci/br and jenkins/pipelines/ci/dm folder by @wuhuizuo in #3053
• fix: not to set jnlp conf in pod file by @purelind in #3100
• chore(deps): update dependency pbr to v6.1.0 by @renovate in #3092
• chore(deps): update dependency idna to v3.8 by @renovate in #3090
• chore(deps): update docker docker tag to v27.2 by @renovate in #3094
• chore(deps): update dependency certifi to v2024.8.30 by @renovate in #3097
• Revert "fix: not to set jnlp conf in pod file" by @purelind in #3104
• fix: not to set jnlp conf in pod file by @purelind in #3106
• feat: cache build in tiflash pipeline by @purelind in #3107
• RocksDB CI: use static link by @v01dstar in #3108
• Accomodate rocksdb 8.10 by @v01dstar in #3110
• fix(deps): update module github.com/puerkitobio/goquery to v1.10.0 by @renovate in #3112
• chore(deps): update bitnami/oras docker tag to v1.2.0-debian-12-r7 by @renovate in #3109
• feat(tiflow): support downloading dependencies from a specified branch by @purelind in #3111
• feat: refactor pd ut pipelines by @purelind in #3098
• fix: change tikv wip it job name by @purelind in #3113
• fix: fix pod yaml file name by @purelind in #3114
• feat: switch to use new pipeline trigger by prow in branch 8.1 by @purelind in #3116
• feat: add retry and check binary by @purelind in #3117
• feat(tiproxy): print pr info in pipeline details by @purelind in #3118
• chore(tiflash): simplify pod jnlp container conf by @purelind in #3119
• feat: print pr info in pipeline details by @purelind in #3120
• fix: update pd wip ut pipeline by @purelind in #3121
• ci(ti-community-infra/configs): remove archived repo from sync list by @wuhuizuo in #3126
• Fix RocksDB CI by @v01dstar in #3125
• feat(lib): support checkout to pr commit sha by @purelind in #3130
• fix(scripts/flow/ga): fix release note detail list by @wuhuizuo in #3132
• feat: switch to use new pipeline trigger by prow in branch 7.5 by @purelind in #3135
• feat: switch to use new pipeline trigger by prow in branch 7.1 by @purelind in #3136
• fix(tiflash&tikv): disable old jobs trigger on feature branch by @purelind in #3142
• refactor(canary): use new base ci image by @wuhuizuo in #3143
• fix(canary): fix pod vol by @wuhuizuo in #3144
• fix: vol fs group by @wuhuizuo in #3145
• feat(tidb): add another merged ddlv1 ut pipeline by @purelind in #3146
• opt: use mirror to download bazel by @wuhuizuo in #3147
• chore(lib): increase refreash time for lib cache by @purelind in #3149
• feat(tidb): add ddlv1 unit test pipeline by @purelind in #3150
• feat(tiflow): tiflow master bump go version to 1.23 by @purelind in #3137
• feat(pd): pd master bump go version to 1.23 by @purelind in #3140
• support go1.23 for tidb master branch by @hawkingrei in #3154
• fix Permission for go1.23 by @hawkingrei in #3155
• feat(tidb-test): tidb-test master bump go version to 1.23 by @purelind in #3139
• feat(build): multi-branch build on master bump go version to 1.23 by @purelind in #3141
• feat(tiproxy): tiproxy master bump go version to 1.23 by @purelind in #3138
• feat: support go1.23 for build-common by @purelind in #3156
• chore: increase resource for merged ut to increase stability by @purelind in #3158
• chore(deps): update dependency go to v1.23.2 by @renovate in #3151
• chore(deps): update python docker tag to v3.13 by @renovate in #3153
• feat: add cache image build for 8.4 by @purelind in #3159
• chore(deps): update dependency charset-normalizer to v3.4.0 by @renovate in #3157
• chore(pingcap/monitoring): update periodics.yaml by @wuhuizuo in #3160
• feat: tidb split release 8.4 jobs by @purelind in #3162
• refactor(prow-jobs): refactor ci prow job kustomization generation by @wuhuizuo in #3163
• feat: tiflash & tikv & pd split release 8.4 jobs by @purelind in #3164
• feat: tiflow split release 8.4 jobs by @purelind in #3161
• feat: support build for v8.4 by @purelind in #3165
• chore: fix for nighlty build on tidb-binlog by @purelind in #3166
• fix: correct pod file path by @purelind in #3167
• fix(deps): update module golang.org/x/mod to v0.21.0 by @renovate in #3105
• chore(deps): update dependency urllib3 to v2.2.3 by @renovate in #3122
• chore(deps): update dependency idna to v3.10 by @renovate in #3124
• fix: fix pod file path by @purelind in #3169
• fix: use clang-format 15 after v7.4 by @purelind in #3170
• fix(tiflash): user clang-format 15 after v7.4 by @purelind in #3171
• feat(pd): display pr info on pipeline run by @purelind in #3173
• feat: add new pull integration e2e test by @purelind in #3174
• feat(tidb): enable ddlv1 ut pipeline by @purelind in #3172
• chore(deps): update bitnami/oras docker tag to v1.2.0-debian-12-r8 by @renovate in #3152
• script: add find pod images script by @purelind in #3176
• fix(scripts/pingcap/community): fix /update-prow-owners.ts by @wuhuizuo in #3177
• chore: to use clang-format 12 for tiflash version less than v7.4 by @purelind in #3178
• feat(tiflash & tikv): switch to use new pipeline trigger by prow in branch 7.1 by @purelind in #3179
• pd: update pd real cluster test by @okJiang in #3168
• pd: remove option from pd integration test by @okJiang in #3180
• chore: temporary disable failed job by @purelind in #3183
• feat: disable auto refresh cache image for master&8.4 by @purelind in #3184
• feat(tiflash): gen build cache in merge ci for tiflash by @purelind in #3187
• fix(tiflash): set readonly to false to update cache in nfs by @purelind in #3190
• fix(script/flow/rc): fix flow check script by @wuhuizuo in #3191
• feat(pd): update base image to use rockylinux 8 by @purelind in #3188
• feat(tikv): start use rocky8 as base image since from 8.4 by @purelind in #3185
• fix(tiflash): correct build ccache path by @purelind in #3193
• fix(tiflash): enable ccache save in merged pipelines by @purelind in #3194
• chore(tiflash): remove building bench_dbms in master by @purelind in #3196
• feat(tiflash): start use rocky8 as base image by @purelind in #3186
• feat(tiflow): split release 8.5 jobs for tiflow by @purelind in #3198
• feat(tidb): split release 8.5 jobs for tidb by @purelind in #3199
• feat(tiflash&tikv): split release 8.5 jobs for tiflash and tikv by @purelind in #3197
• fix(cd): correct fetch version from tiflow branch by @purelind in #3200
• chore(tiflash): use clang-format in image by @Lloyd-Pottiger in #3201
• feat(pd): adjust trigger for branch release-6.5-20241101-v6.5.7 by @purelind in #3203
• feat(tidb-engine-ext): add cargo cache for tidb-eninge-ext by @purelind in #3204
• feat(tikv/raft-engine): enable ci for raft-engine by @wuhuizuo in #3206
• feat(lib): use git shallow clone for lib cache by @purelind in #3207
• fix(ticdc): update env for debezium test by @wk989898 in #3208
• fix(tidb-engine-ext): link git and registry cargo cache by @purelind in #3210
• chore(deps): update dependency go to v1.23.3 by @renovate in #3209
• fix(ticdc): update env for debezium test for release-8.5 by @wk989898 in #3213
• fix(tikv/raft-engine): limit job on master branche by @wuhuizuo in #3214
• chore(tiflash): update CI/CD pipelines by @wuhuizuo in #3219
• feat(tidb-engine-ext): Mount the necessary cargo home cache directory by @purelind in #3212
• feat(script): add s3 object monitor clean script by @purelind in #3215

New Contributors

• @Lloyd-Pottiger made their first contribution in #2901
• @qiancai made their first contribution in #3020
• @BornChanger made their first contribution in #3103
• @v01dstar made their first contribution in #3108
• @okJiang made their first contribution in #3168
• @wk989898 made their first contribution in #3208

Full Changelog: v2.0.0...v2024.11.8