TestConfigTestSuite is unstable

[HuSharp]

Flaky Test

TestConfigTestSuite

Which jobs are failing

2023-11-24T09:13:41.3004455Z --- FAIL: TestConfigTestSuite (59.50s)
2023-11-24T09:13:41.3004734Z     --- FAIL: TestConfigTestSuite/TestConfig (7.51s)
2023-11-24T09:13:41.3005090Z         testutil.go:265: start to run test in pd mode
2023-11-24T09:13:41.3005419Z         testutil.go:269: finish to run test in pd mode
2023-11-24T09:13:41.3005674Z         testutil.go:274: start to run test in api mode
2023-11-24T09:13:41.3005960Z         config_test.go:109: 
2023-11-24T09:13:41.3006490Z             	Error Trace:	/home/runner/work/pd/pd/tests/pdctl/config/config_test.go:109
2023-11-24T09:13:41.3007316Z             	            				/home/runner/work/pd/pd/tests/testutil.go:279
2023-11-24T09:13:41.3007985Z             	            				/home/runner/work/pd/pd/tests/testutil.go:260
2023-11-24T09:13:41.3009023Z             	            				/home/runner/work/pd/pd/tests/pdctl/config/config_test.go:64
2023-11-24T09:13:41.3009346Z             	Error:      	Should be false
2023-11-24T09:13:41.3009653Z             	Test:       	TestConfigTestSuite/TestConfig

CI link

https://github.com/tikv/pd/actions/runs/6978834150/job/18990966346
https://github.com/tikv/pd/actions/runs/6973238800/job/18976877533

Reason for failure (if possible)

Anything else

[rleungx]

We can find from the log, the trace-region-flow is updated to false:

[2023/11/24 09:12:41.169 +00:00] [INFO] [audit.go:126] ["audit log"] [service-info="{ServiceLabel:SetConfig, Method:HTTP/1.1/POST:/pd/api/v1/config, Component:pdctl, IP:127.0.0.1, Port:40408, StartTime:2023-11-24 09:12:41 +0000 UTC, URLParam:{}, BodyParam:{\"trace-region-flow\":\"false\"}}"]
...
[2023/11/24 09:12:41.175 +00:00] [INFO] [server.go:1258] ["PD server config is updated"] [new="{\"use-region-storage\":\"true\",\"max-gap-reset-ts\":\"24h0m0s\",\"key-type\":\"table\",\"runtime-services\":\"\",\"metric-storage\":\"\",\"dashboard-address\":\"auto\",\"flow-round-by-digit\":3,\"min-resolved-ts-persistence-interval\":\"1s\",\"server-memory-limit\":0,\"server-memory-limit-gc-trigger\":0.7,\"enable-gogc-tuner\":\"false\",\"gc-tuner-threshold\":0.6,\"block-safe-point-v1\":\"false\"}"] [old="{\"use-region-storage\":\"true\",\"max-gap-reset-ts\":\"24h0m0s\",\"key-type\":\"table\",\"runtime-services\":\"\",\"metric-storage\":\"\",\"dashboard-address\":\"auto\",\"trace-region-flow\":\"true\",\"flow-round-by-digit\":3,\"min-resolved-ts-persistence-interval\":\"1s\",\"server-memory-limit\":0,\"server-memory-limit-gc-trigger\":0.7,\"enable-gogc-tuner\":\"false\",\"gc-tuner-threshold\":0.6,\"block-safe-point-v1\":\"false\"}"]

But later, it is changed back because of the dashboard address check goroutine:

[2023/11/24 09:12:41.180 +00:00] [INFO] [server.go:1258] ["PD server config is updated"] [new="{\"use-region-storage\":\"true\",\"max-gap-reset-ts\":\"24h0m0s\",\"key-type\":\"table\",\"runtime-services\":\"\",\"metric-storage\":\"\",\"dashboard-address\":\"[http://127.0.0.1:40831\](http://127.0.0.1:40831/)",\"trace-region-flow\":\"true\",\"flow-round-by-digit\":3,\"min-resolved-ts-persistence-interval\":\"1s\",\"server-memory-limit\":0,\"server-memory-limit-gc-trigger\":0.7,\"enable-gogc-tuner\":\"false\",\"gc-tuner-threshold\":0.6,\"block-safe-point-v1\":\"false\"}"] [old="{\"use-region-storage\":\"true\",\"max-gap-reset-ts\":\"24h0m0s\",\"key-type\":\"table\",\"runtime-services\":\"\",\"metric-storage\":\"\",\"dashboard-address\":\"auto\",\"flow-round-by-digit\":3,\"min-resolved-ts-persistence-interval\":\"1s\",\"server-memory-limit\":0,\"server-memory-limit-gc-trigger\":0.7,\"enable-gogc-tuner\":\"false\",\"gc-tuner-threshold\":0.6,\"block-safe-point-v1\":\"false\"}"]

[rleungx]

Tracking Issue: #7464

[okJiang]

This is not the same test, you can close it, sorry 😂