`bindinfo` hang for 9 minutes #27410

zhouqiang-cl · 2021-08-20T03:47:51Z

Bug Report

Please answer these questions before submitting your issue. Thanks!

[2021-08-20T03:16:59.738Z] SELECT variable_name, variable_value FROM mysql.global_variables;
[2021-08-20T03:16:59.738Z] panic: test timed out after 10m0s
[2021-08-20T03:16:59.738Z] 
[2021-08-20T03:16:59.738Z] goroutine 8171 [running]:
[2021-08-20T03:16:59.738Z] testing.(*M).startAlarm.func1()
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1700 +0xe5
[2021-08-20T03:16:59.738Z] created by time.goFunc
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/time/sleep.go:180 +0x45
[2021-08-20T03:16:59.738Z] 
[2021-08-20T03:16:59.738Z] goroutine 1 [chan receive, 10 minutes]:
[2021-08-20T03:16:59.738Z] testing.(*T).Run(0xc000574480, 0x3aa4db0, 0x5, 0x3bab188, 0x124a046)
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1239 +0x2da
[2021-08-20T03:16:59.738Z] testing.runTests.func1(0xc000574300)
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1511 +0x78
[2021-08-20T03:16:59.738Z] testing.tRunner(0xc000574300, 0xc000d3fde0)
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1193 +0xef
[2021-08-20T03:16:59.738Z] testing.runTests(0xc00000f050, 0x5601ab0, 0x1, 0x1, 0xc03fe588578bc598, 0x8bb89bcd83, 0x5cd7660, 0x3aba730)
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1509 +0x2fe
[2021-08-20T03:16:59.738Z] testing.(*M).Run(0xc000655a00, 0x0)
[2021-08-20T03:16:59.738Z] 	/usr/local/go/src/testing/testing.go:1417 +0x1eb
[2021-08-20T03:16:59.738Z] main.main()
[2021-08-20T03:16:59.738Z] 	_testmain.go:45 +0x138
[2021-08-20T03:16:59.738Z] 
[2021-08-20T03:16:59.738Z] goroutine 13 [select]:
[2021-08-20T03:16:59.738Z] go.opencensus.io/stats/view.(*worker).start(0xc000655800)
[2021-08-20T03:16:59.738Z] 	/nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:276 +0xcd
[2021-08-20T03:16:59.738Z] created by go.opencensus.io/stats/view.init.0
[2021-08-20T03:16:59.738Z] 	/nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:34 +0x68

1. Minimal reproduce step (Required)

in ci
https://ci.pingcap.net/blue/rest/organizations/jenkins/pipelines/tidb-unit-test-nightly/runs/9089/nodes/129/steps/437/log/?start=0

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

master

The text was updated successfully, but these errors were encountered:

zhouqiang-cl · 2021-08-20T03:48:01Z

also in https://ci.pingcap.net/blue/rest/organizations/jenkins/pipelines/tidb_ghpr_check_2/runs/27647/nodes/53/steps/64/log/?start=0

tisonkun · 2021-08-20T05:39:05Z

https://ci.pingcap.net/blue/organizations/jenkins/tidb_ghpr_check_2/detail/tidb_ghpr_check_2/27717/pipeline/

[2021-08-20T05:23:24.482Z] SELECT variable_name, variable_value FROM mysql.global_variables;
[2021-08-20T05:23:24.482Z] coverage: 84.6% of statements
[2021-08-20T05:23:24.482Z] panic: test timed out after 9m0s
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 8916 [running]:
[2021-08-20T05:23:24.482Z] testing.(*M).startAlarm.func1()
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1700 +0xe5
[2021-08-20T05:23:24.482Z] created by time.goFunc
[2021-08-20T05:23:24.482Z] /usr/local/go/src/time/sleep.go:180 +0x45
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 1 [chan receive, 9 minutes]:
[2021-08-20T05:23:24.482Z] testing.(*T).Run(0xc000959b00, 0x3aa5390, 0x5, 0x3bab3e8, 0x1249d86)
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1239 +0x2da
[2021-08-20T05:23:24.482Z] testing.runTests.func1(0xc000959980)
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1511 +0x78
[2021-08-20T05:23:24.482Z] testing.tRunner(0xc000959980, 0xc000adfda8)
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1193 +0xef
[2021-08-20T05:23:24.482Z] testing.runTests(0xc000db0eb8, 0x5600ab0, 0x1, 0x1, 0xc03fecef7248def3, 0x7dc1267d1d, 0x5cd8240, 0x3abad10)
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1509 +0x2fe
[2021-08-20T05:23:24.482Z] testing.(*M).Run(0xc000b85a00, 0x0)
[2021-08-20T05:23:24.482Z] /usr/local/go/src/testing/testing.go:1417 +0x1eb
[2021-08-20T05:23:24.482Z] main.main()
[2021-08-20T05:23:24.482Z] _testmain.go:99 +0x1c5
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 174 [chan receive]:
[2021-08-20T05:23:24.482Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc000303140)
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:23:24.482Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 102 [select]:
[2021-08-20T05:23:24.482Z] go.opencensus.io/stats/view.(*worker).start(0xc000b84000)
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:276 +0xcd
[2021-08-20T05:23:24.482Z] created by go.opencensus.io/stats/view.init.0
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:34 +0x68
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 214 [chan receive]:
[2021-08-20T05:23:24.482Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc00090c0a8)
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:23:24.482Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 217 [chan receive]:
[2021-08-20T05:23:24.482Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc00090c1e0)
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:23:24.482Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:23:24.482Z] /nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:23:24.482Z]
[2021-08-20T05:23:24.482Z] goroutine 103 [select]:
[2021-08-20T05:23:24.482Z] github.com/tikv/client-go/v2/oracle/oracles.(*pdOracle).updateTS(0xc0006f02a0, 0x3fb78a0, 0xc0000520d0, 0x77359400)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/oracle/oracles/pd.go:229 +0x131
[2021-08-20T05:23:24.483Z] created by github.com/tikv/client-go/v2/oracle/oracles.NewPdOracle
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/oracle/oracles/pd.go:77 +0xd3
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 324 [semacquire, 9 minutes]:
[2021-08-20T05:23:24.483Z] sync.runtime_Semacquire(0xc000803888)
[2021-08-20T05:23:24.483Z] /usr/local/go/src/runtime/sema.go:56 +0x45
[2021-08-20T05:23:24.483Z] sync.(*WaitGroup).Wait(0xc000803880)
[2021-08-20T05:23:24.483Z] /usr/local/go/src/sync/waitgroup.go:130 +0x65
[2021-08-20T05:23:24.483Z] github.com/pingcap/check.RunAll(0xc000573e78, 0x0)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/run.go:129 +0x516
[2021-08-20T05:23:24.483Z] github.com/pingcap/check.TestingT(0xc000959b00)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/run.go:99 +0x45c
[2021-08-20T05:23:24.483Z] github.com/pingcap/tidb/bindinfo_test.TestT(0xc000959b00)
[2021-08-20T05:23:24.483Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/bindinfo/bind_test.go:62 +0x14e
[2021-08-20T05:23:24.483Z] testing.tRunner(0xc000959b00, 0x3bab3e8)
[2021-08-20T05:23:24.483Z] /usr/local/go/src/testing/testing.go:1193 +0xef
[2021-08-20T05:23:24.483Z] created by testing.(*T).Run
[2021-08-20T05:23:24.483Z] /usr/local/go/src/testing/testing.go:1238 +0x2b3
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 325 [select, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/check.(*resultTracker)._loopRoutine(0xc000ddc360)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:464 +0xbc
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/check.(*resultTracker).start
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:444 +0x3f
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 326 [select, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/check.(*suiteRunner).doRun(0xc000ddc3f0, 0xc00046aff0)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:667 +0x128
[2021-08-20T05:23:24.483Z] github.com/pingcap/check.(*suiteRunner).asyncRun.func1(0xc000ddc3f0, 0xc000803880, 0xc000063020)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:650 +0xaa
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/check.(*suiteRunner).asyncRun
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:646 +0x15b
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 328 [select, 2 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*DB).updateSize(0xc000b51680, 0xc00090c438)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:1032 +0x108
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:327 +0xe14
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 329 [select]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger/epoch.(*ResourceManager).collectLoop(0xc000df95c0, 0xc00090c450)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/epoch/manager.go:101 +0xdc
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger/epoch.NewResourceManager
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/epoch/manager.go:79 +0xa7
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 330 [select, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.Open.func4(0xc00082c690)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:341 +0x17c
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:338 +0x10a8
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 67 [select, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*blobGCHandler).run(0xc000b44100, 0xc000db0018)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/blob.go:468 +0xd4
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.(*blobManager).Open
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/blob.go:292 +0x618
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 68 [select]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*levelsController).runWorker(0xc00026dce0, 0xc000db0030, 0x3779100)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/levels.go:212 +0x185
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.(*levelsController).startCompact
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/levels.go:180 +0x93
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 69 [chan receive, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*DB).runFlushMemTable(0xc000b51680, 0xc00090c9c0, 0x0, 0x0)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:913 +0x190
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:360 +0x17b0
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 611 [select]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/tidb/domain.(*Domain).LoadSysVarCacheLoop.func1(0xc0056a8400, 0xc005650c00, 0x6fc23ac00, 0x3ffdd78, 0xc0009c7c00)
[2021-08-20T05:23:24.483Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:933 +0x125
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/tidb/domain.(*Domain).LoadSysVarCacheLoop
[2021-08-20T05:23:24.483Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:924 +0xf6
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 284 [select, 8 minutes]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*writeWorker).runWriteVLog(0xc0009a6020, 0xc00045c060)
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:94 +0x1dc
[2021-08-20T05:23:24.483Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:23:24.483Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:64 +0x190
[2021-08-20T05:23:24.483Z]
[2021-08-20T05:23:24.483Z] goroutine 285 [chan receive, 8 minutes, locked to thread]:
[2021-08-20T05:23:24.483Z] github.com/pingcap/badger.(*writeWorker).runWriteLSM(0xc0009a6020, 0xc00045c060)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:141 +0x195
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:65 +0x1bc
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 286 [chan receive, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/badger.(*writeWorker).runMergeLSM(0xc0009a6020, 0xc00045c060)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:154 +0xad
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:66 +0x1e8
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 287 [select, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.writeDBWorker.run(0xc00038e300, 0xc0000fcd80)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:96 +0x205
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*dbWriter).Open
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:199 +0x8f
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 288 [select, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.writeLockWorker.run(0xc00038e360, 0xc0000fcd80)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:148 +0x3e5
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*dbWriter).Open
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:206 +0xdc
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 289 [select, 2 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).runUpdateSafePointLoop(0xc0009a5e00)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1550 +0x28a
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.NewMVCCStore
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:85 +0x269
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 338 [select, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).StartDeadlockDetection.func1(0xc0009a5e00)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1286 +0x8a
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).StartDeadlockDetection
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1284 +0x78
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 104 [select, 2 minutes]:
[2021-08-20T05:23:24.484Z] github.com/tikv/client-go/v2/internal/locate.(*RegionCache).asyncCheckAndResolveLoop(0xc0009a5f00, 0xdf8475800)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/internal/locate/region_cache.go:397 +0xdc
[2021-08-20T05:23:24.484Z] created by github.com/tikv/client-go/v2/internal/locate.NewRegionCache
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/internal/locate/region_cache.go:368 +0x259
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 105 [select]:
[2021-08-20T05:23:24.484Z] github.com/tikv/client-go/v2/tikv.(*KVStore).runSafePointChecker(0xc00085a120)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:264 +0x136
[2021-08-20T05:23:24.484Z] created by github.com/tikv/client-go/v2/tikv.NewKVStore
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:187 +0x407
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 106 [select]:
[2021-08-20T05:23:24.484Z] github.com/tikv/client-go/v2/tikv.(*KVStore).safeTSUpdater(0xc00085a120)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:542 +0x194
[2021-08-20T05:23:24.484Z] created by github.com/tikv/client-go/v2/tikv.NewKVStore
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:188 +0x429
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 107 [select, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000c617a0)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/policy.go:96 +0xa5
[2021-08-20T05:23:24.484Z] created by github.com/dgraph-io/ristretto.newDefaultPolicy
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/policy.go:80 +0x129
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 108 [select, 8 minutes]:
[2021-08-20T05:23:24.484Z] github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00038eba0)
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/cache.go:257 +0x9d
[2021-08-20T05:23:24.484Z] created by github.com/dgraph-io/ristretto.NewCache
[2021-08-20T05:23:24.484Z] /nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/cache.go:155 +0x205
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 473 [select]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/ddl.(*worker).start(0xc00517e9a0, 0xc004718540)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:178 +0x315
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:365 +0x6a5
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 608 [select, 4 minutes]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/domain.(*Domain).LoadPrivilegeLoop.func1(0xc0056a8400, 0xc005650aa0, 0x45d964b800, 0x3ffdd78, 0xc005479200)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:884 +0x125
[2021-08-20T05:23:24.484Z] created by github.com/pingcap/tidb/domain.(*Domain).LoadPrivilegeLoop
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:875 +0x1f0
[2021-08-20T05:23:24.484Z]
[2021-08-20T05:23:24.484Z] goroutine 472 [select]:
[2021-08-20T05:23:24.484Z] github.com/pingcap/tidb/ddl.(*worker).start(0xc00517ea50, 0xc004718540)
[2021-08-20T05:23:24.484Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:178 +0x315
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:365 +0x6a5
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 470 [select, 8 minutes]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/ddl.(*ddl).limitDDLJobs(0xc0056bbab0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:266 +0x2d9
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:347 +0x2d5
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 471 [select, 8 minutes]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/ddl.(*delRange).startEmulator(0xc005690230)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/delete_range.go:144 +0x128
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/ddl.(*delRange).start
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/delete_range.go:126 +0x6a
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 478 [select]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/domain.(*Domain).topologySyncerKeeper(0xc0056a8400)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:482 +0x193
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:779 +0x770
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 617 [select]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/domain.(*Domain).TelemetryRotateSubWindowLoop.func1(0xc0056a8400)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1113 +0xd8
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/domain.(*Domain).TelemetryRotateSubWindowLoop
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1106 +0x7f
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 477 [select]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/domain.(*Domain).infoSyncerKeeper(0xc0056a8400)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:456 +0x138
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:775 +0x70a
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 8298 [semacquire, 8 minutes]:
[2021-08-20T05:23:24.485Z] sync.runtime_SemacquireMutex(0xc005531274, 0x0, 0x1)
[2021-08-20T05:23:24.485Z] /usr/local/go/src/runtime/sema.go:71 +0x47
[2021-08-20T05:23:24.485Z] sync.(*Mutex).lockSlow(0xc005531270)
[2021-08-20T05:23:24.485Z] /usr/local/go/src/sync/mutex.go:138 +0x105
[2021-08-20T05:23:24.485Z] sync.(*Mutex).Lock(...)
[2021-08-20T05:23:24.485Z] /usr/local/go/src/sync/mutex.go:81
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/util/cteutil.(*StorageRC).Lock(0xc005531270)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/cteutil/storage.go:214 +0x47
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*CTEExec).Next(0xc007945a40, 0x3fb7868, 0xc007221e00, 0xc004b7b590, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:141 +0x6e
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc007221e00, 0x3fbc238, 0xc007945a40, 0xc004b7b590, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*CTEExec).computeSeedPart(0xc007945b80, 0x3fb7868, 0xc007221e00, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:226 +0x1b2
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*CTEExec).Next(0xc007945b80, 0x3fb7868, 0xc007221e00, 0xc005531400, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:161 +0x491
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc007221e00, 0x3fbc238, 0xc007945b80, 0xc005531400, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*SelectionExec).Next(0xc0055460d0, 0x3fb7868, 0xc007221e00, 0xc004b7b540, 0x7f70ac1f1001, 0xc004b23340)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:1302 +0x24c
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc007221e00, 0x3fbcdf8, 0xc0055460d0, 0xc004b7b540, 0x0, 0x0)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*outerWorker).buildTask(0xc00552ae70, 0x3fb7868, 0xc007221e00, 0x1a, 0x5cd6320, 0xc0060d9f18)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:403 +0x325
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/executor.(*outerWorker).run(0xc00552ae70, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:347 +0x116
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:181 +0x18b
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 476 [select]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/domain.(*Domain).topNSlowQueryLoop(0xc0056a8400)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:424 +0x1e5
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:772 +0x6ca
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 616 [select, 8 minutes]:
[2021-08-20T05:23:24.485Z] github.com/pingcap/tidb/domain.(*Domain).TelemetryReportLoop.func1(0xc0056a8400, 0x3ffdd78, 0xc005e80200)
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1084 +0x12f
[2021-08-20T05:23:24.485Z] created by github.com/pingcap/tidb/domain.(*Domain).TelemetryReportLoop
[2021-08-20T05:23:24.485Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1076 +0x2b8
[2021-08-20T05:23:24.485Z]
[2021-08-20T05:23:24.485Z] goroutine 8301 [select, 8 minutes]:
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc007cf3e40, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:23:24.486Z]
[2021-08-20T05:23:24.486Z] goroutine 8332 [semacquire, 8 minutes]:
[2021-08-20T05:23:24.486Z] sync.runtime_SemacquireMutex(0xc005531314, 0x2fcc300, 0x1)
[2021-08-20T05:23:24.486Z] /usr/local/go/src/runtime/sema.go:71 +0x47
[2021-08-20T05:23:24.486Z] sync.(*Mutex).lockSlow(0xc005531310)
[2021-08-20T05:23:24.486Z] /usr/local/go/src/sync/mutex.go:138 +0x105
[2021-08-20T05:23:24.486Z] sync.(*Mutex).Lock(...)
[2021-08-20T05:23:24.486Z] /usr/local/go/src/sync/mutex.go:81
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/util/cteutil.(*StorageRC).Lock(0xc005531310)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/cteutil/storage.go:214 +0x47
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/session.resetCTEStorageMap(0xc004e76200, 0x0, 0x0)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1738 +0xe7
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/session.(*execStmtResult).Close(0xc007b90330, 0x0, 0x0)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1717 +0x38
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/util/testkit.(*TestKit).MustExec(0xc0052d3a08, 0x3b90763, 0xb1, 0x0, 0x0, 0x0)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/testkit/testkit.go:220 +0x33e
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/bindinfo_test.(*testSuite).TestIssue25505(0xc000dde930, 0xc0051c4b40)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/bindinfo/bind_test.go:2343 +0x5ec
[2021-08-20T05:23:24.486Z] reflect.Value.call(0x3a8fea0, 0xc000dde930, 0xce13, 0x3aa3c82, 0x4, 0xc00579eef0, 0x1, 0x1, 0x5d0f640, 0xc0083f1e28, ...)
[2021-08-20T05:23:24.486Z] /usr/local/go/src/reflect/value.go:476 +0x8e7
[2021-08-20T05:23:24.486Z] reflect.Value.Call(0x3a8fea0, 0xc000dde930, 0xce13, 0xc0083f1ef0, 0x1, 0x1, 0x0, 0xc000d8e280, 0x0)
[2021-08-20T05:23:24.486Z] /usr/local/go/src/reflect/value.go:337 +0xb9
[2021-08-20T05:23:24.486Z] github.com/pingcap/check.(*suiteRunner).forkTest.func1(0xc0051c4b40)
[2021-08-20T05:23:24.486Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:850 +0x6b5
[2021-08-20T05:23:24.486Z] github.com/pingcap/check.(*suiteRunner).forkCall.func1(0xc000ddc3f0, 0xc0051c4b40, 0xc008468000)
[2021-08-20T05:23:24.486Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:739 +0xbf
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/check.(*suiteRunner).forkCall
[2021-08-20T05:23:24.486Z] /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:734 +0x233
[2021-08-20T05:23:24.486Z]
[2021-08-20T05:23:24.486Z] goroutine 8300 [select, 8 minutes]:
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc007cf3ce0, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:23:24.486Z]
[2021-08-20T05:23:24.486Z] goroutine 8302 [select, 8 minutes]:
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc008049a20, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:23:24.486Z]
[2021-08-20T05:23:24.486Z] goroutine 8299 [select, 8 minutes]:
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc007cf3b80, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:23:24.486Z]
[2021-08-20T05:23:24.486Z] goroutine 8303 [select, 8 minutes]:
[2021-08-20T05:23:24.486Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc008049b80, 0x3fb7868, 0xc007221e00, 0xc0086fc140)
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:23:24.486Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:23:24.486Z] /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:23:24.486Z] FAIL github.com/pingcap/tidb/bindinfo 540.139s

unconsolable · 2021-08-20T06:09:47Z

Maybe another occurence

https://ci.pingcap.net/blue/rest/organizations/jenkins/pipelines/tidb_ghpr_check_2/runs/27738/nodes/62/log/?start=0

[2021-08-20T05:58:53.631Z] SELECT variable_name, variable_value FROM mysql.global_variables;
[2021-08-20T05:58:53.631Z] coverage: 84.6% of statements
[2021-08-20T05:58:53.631Z] panic: test timed out after 9m0s
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 9002 [running]:
[2021-08-20T05:58:53.631Z] testing.(*M).startAlarm.func1()
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1700 +0xe5
[2021-08-20T05:58:53.631Z] created by time.goFunc
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/time/sleep.go:180 +0x45
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 1 [chan receive, 9 minutes]:
[2021-08-20T05:58:53.631Z] testing.(*T).Run(0xc000824900, 0x3aa5390, 0x5, 0x3bab3e8, 0x1249d86)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1239 +0x2da
[2021-08-20T05:58:53.631Z] testing.runTests.func1(0xc000824780)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1511 +0x78
[2021-08-20T05:58:53.631Z] testing.tRunner(0xc000824780, 0xc000d3fda8)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1193 +0xef
[2021-08-20T05:58:53.631Z] testing.runTests(0xc0007186d8, 0x5600ab0, 0x1, 0x1, 0xc03fef0330b1086a, 0x7dc29ea50b, 0x5cd8240, 0x3abad10)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1509 +0x2fe
[2021-08-20T05:58:53.631Z] testing.(*M).Run(0xc00003f980, 0x0)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1417 +0x1eb
[2021-08-20T05:58:53.631Z] main.main()
[2021-08-20T05:58:53.631Z] 	_testmain.go:99 +0x1c5
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 157 [select, 8 minutes]:
[2021-08-20T05:58:53.631Z] github.com/pingcap/check.(*resultTracker)._loopRoutine(0xc00096ca20)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:464 +0xbc
[2021-08-20T05:58:53.631Z] created by github.com/pingcap/check.(*resultTracker).start
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:444 +0x3f
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 7 [select]:
[2021-08-20T05:58:53.631Z] go.opencensus.io/stats/view.(*worker).start(0xc00003f780)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:276 +0xcd
[2021-08-20T05:58:53.631Z] created by go.opencensus.io/stats/view.init.0
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.opencensus.io@v0.22.5/stats/view/worker.go:34 +0x68
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 156 [semacquire, 9 minutes]:
[2021-08-20T05:58:53.631Z] sync.runtime_Semacquire(0xc0006b51e8)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/runtime/sema.go:56 +0x45
[2021-08-20T05:58:53.631Z] sync.(*WaitGroup).Wait(0xc0006b51e0)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/sync/waitgroup.go:130 +0x65
[2021-08-20T05:58:53.631Z] github.com/pingcap/check.RunAll(0xc0000e0e78, 0x0)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/run.go:129 +0x516
[2021-08-20T05:58:53.631Z] github.com/pingcap/check.TestingT(0xc000824900)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/run.go:99 +0x45c
[2021-08-20T05:58:53.631Z] github.com/pingcap/tidb/bindinfo_test.TestT(0xc000824900)
[2021-08-20T05:58:53.631Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/bindinfo/bind_test.go:62 +0x14e
[2021-08-20T05:58:53.631Z] testing.tRunner(0xc000824900, 0x3bab3e8)
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1193 +0xef
[2021-08-20T05:58:53.631Z] created by testing.(*T).Run
[2021-08-20T05:58:53.631Z] 	/usr/local/go/src/testing/testing.go:1238 +0x2b3
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 32 [chan receive]:
[2021-08-20T05:58:53.631Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc0001b4948)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:58:53.631Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 200 [chan receive]:
[2021-08-20T05:58:53.631Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc0001b58c0)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:58:53.631Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 203 [chan receive]:
[2021-08-20T05:58:53.631Z] go.etcd.io/etcd/pkg/logutil.(*MergeLogger).outputLoop(0xc0001b5a10)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:173 +0x3ac
[2021-08-20T05:58:53.631Z] created by go.etcd.io/etcd/pkg/logutil.NewMergeLogger
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/go.etcd.io/etcd@v0.5.0-alpha.5.0.20200824191128-ae9734ed278b/pkg/logutil/merge_logger.go:91 +0x85
[2021-08-20T05:58:53.631Z] 
[2021-08-20T05:58:53.631Z] goroutine 326 [select]:
[2021-08-20T05:58:53.631Z] github.com/tikv/client-go/v2/oracle/oracles.(*pdOracle).updateTS(0xc0001ea930, 0x3fb78a0, 0xc00019c018, 0x77359400)
[2021-08-20T05:58:53.631Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/oracle/oracles/pd.go:229 +0x131
[2021-08-20T05:58:53.631Z] created by github.com/tikv/client-go/v2/oracle/oracles.NewPdOracle
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/oracle/oracles/pd.go:77 +0xd3
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 158 [select, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/check.(*suiteRunner).doRun(0xc00096cab0, 0xc00096e0f0)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:667 +0x128
[2021-08-20T05:58:53.632Z] github.com/pingcap/check.(*suiteRunner).asyncRun.func1(0xc00096cab0, 0xc0006b51e0, 0xc0000648a0)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:650 +0xaa
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/check.(*suiteRunner).asyncRun
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:646 +0x15b
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 265 [select, 2 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*DB).updateSize(0xc000e0cd80, 0xc000cde4b0)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:1032 +0x108
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:327 +0xe14
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 266 [select]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger/epoch.(*ResourceManager).collectLoop(0xc0003795c0, 0xc000cde4c8)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/epoch/manager.go:101 +0xdc
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger/epoch.NewResourceManager
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/epoch/manager.go:79 +0xa7
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 267 [select, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.Open.func4(0xc000988010)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:341 +0x17c
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:338 +0x10a8
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 87 [select, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*blobGCHandler).run(0xc0006f5dc0, 0xc000128d98)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/blob.go:468 +0xd4
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.(*blobManager).Open
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/blob.go:292 +0x618
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 88 [select]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*levelsController).runWorker(0xc000cb62a0, 0xc000128db0, 0x0)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/levels.go:212 +0x185
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.(*levelsController).startCompact
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/levels.go:180 +0x93
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 89 [chan receive, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*DB).runFlushMemTable(0xc000e0cd80, 0xc000cdea38, 0x0, 0x0)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:913 +0x190
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.Open
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/db.go:360 +0x17b0
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 46 [select, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*writeWorker).runWriteVLog(0xc00098dfe0, 0xc000cde000)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:94 +0x1dc
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:64 +0x190
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 47 [chan receive, 8 minutes, locked to thread]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*writeWorker).runWriteLSM(0xc00098dfe0, 0xc000cde000)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:141 +0x195
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:65 +0x1bc
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 48 [chan receive, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/badger.(*writeWorker).runMergeLSM(0xc00098dfe0, 0xc000cde000)
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:154 +0xad
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/badger.startWriteWorker
[2021-08-20T05:58:53.632Z] 	/nfs/cache/mod/github.com/pingcap/badger@v1.5.1-0.20200908111422-2e78ee155d19/writer.go:66 +0x1e8
[2021-08-20T05:58:53.632Z] 
[2021-08-20T05:58:53.632Z] goroutine 49 [select, 8 minutes]:
[2021-08-20T05:58:53.632Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.writeDBWorker.run(0xc000afe240, 0xc000246ac0)
[2021-08-20T05:58:53.632Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:96 +0x205
[2021-08-20T05:58:53.632Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*dbWriter).Open
[2021-08-20T05:58:53.632Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:199 +0x8f
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 338 [select, 8 minutes]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.writeLockWorker.run(0xc000afe2a0, 0xc000246ac0)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:148 +0x3e5
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*dbWriter).Open
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/write.go:206 +0xdc
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 339 [select, 2 minutes]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).runUpdateSafePointLoop(0xc000cac080)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1550 +0x28a
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.NewMVCCStore
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:85 +0x269
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 340 [select, 8 minutes]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).StartDeadlockDetection.func1(0xc000cac080)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1286 +0x8a
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/store/mockstore/unistore/tikv.(*MVCCStore).StartDeadlockDetection
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/store/mockstore/unistore/tikv/mvcc.go:1284 +0x78
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 327 [select, 2 minutes]:
[2021-08-20T05:58:53.633Z] github.com/tikv/client-go/v2/internal/locate.(*RegionCache).asyncCheckAndResolveLoop(0xc000cac180, 0xdf8475800)
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/internal/locate/region_cache.go:397 +0xdc
[2021-08-20T05:58:53.633Z] created by github.com/tikv/client-go/v2/internal/locate.NewRegionCache
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/internal/locate/region_cache.go:368 +0x259
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 328 [select]:
[2021-08-20T05:58:53.633Z] github.com/tikv/client-go/v2/tikv.(*KVStore).runSafePointChecker(0xc000d4c000)
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:264 +0x136
[2021-08-20T05:58:53.633Z] created by github.com/tikv/client-go/v2/tikv.NewKVStore
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:187 +0x407
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 329 [select]:
[2021-08-20T05:58:53.633Z] github.com/tikv/client-go/v2/tikv.(*KVStore).safeTSUpdater(0xc000d4c000)
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:542 +0x194
[2021-08-20T05:58:53.633Z] created by github.com/tikv/client-go/v2/tikv.NewKVStore
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/tikv/client-go/v2@v2.0.0-alpha.0.20210816071108-df2119f51be1/tikv/kv.go:188 +0x429
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 330 [select, 8 minutes]:
[2021-08-20T05:58:53.633Z] github.com/dgraph-io/ristretto.(*defaultPolicy).processItems(0xc000eec180)
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/policy.go:96 +0xa5
[2021-08-20T05:58:53.633Z] created by github.com/dgraph-io/ristretto.newDefaultPolicy
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/policy.go:80 +0x129
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 331 [select, 8 minutes]:
[2021-08-20T05:58:53.633Z] github.com/dgraph-io/ristretto.(*Cache).processItems(0xc00070e120)
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/cache.go:257 +0x9d
[2021-08-20T05:58:53.633Z] created by github.com/dgraph-io/ristretto.NewCache
[2021-08-20T05:58:53.633Z] 	/nfs/cache/mod/github.com/dgraph-io/ristretto@v0.0.1/cache.go:155 +0x205
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 320 [select]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/ddl.(*worker).start(0xc00593a0b0, 0xc0007a6300)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:178 +0x315
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:365 +0x6a5
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 563 [select]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/domain.(*Domain).topNSlowQueryLoop(0xc00004ae00)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:424 +0x1e5
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:772 +0x6ca
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 565 [select]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/domain.(*Domain).topologySyncerKeeper(0xc00004ae00)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:482 +0x193
[2021-08-20T05:58:53.633Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:779 +0x770
[2021-08-20T05:58:53.633Z] 
[2021-08-20T05:58:53.633Z] goroutine 319 [select]:
[2021-08-20T05:58:53.633Z] github.com/pingcap/tidb/ddl.(*worker).start(0xc00593a000, 0xc0007a6300)
[2021-08-20T05:58:53.633Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:178 +0x315
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:365 +0x6a5
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 318 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/ddl.(*delRange).startEmulator(0xc0045f4780)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/delete_range.go:144 +0x128
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/ddl.(*delRange).start
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/delete_range.go:126 +0x6a
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 317 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/ddl.(*ddl).limitDDLJobs(0xc0059152d0)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl_worker.go:266 +0x2d9
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/ddl.(*ddl).Start
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/ddl/ddl.go:347 +0x2d5
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 564 [select]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/domain.(*Domain).infoSyncerKeeper(0xc00004ae00)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:456 +0x138
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/domain.(*Domain).Init
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:775 +0x70a
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 587 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/domain.(*Domain).TelemetryReportLoop.func1(0xc00004ae00, 0x3ffdd78, 0xc005e6c200)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1084 +0x12f
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/domain.(*Domain).TelemetryReportLoop
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1076 +0x2b8
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 588 [select]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/domain.(*Domain).TelemetryRotateSubWindowLoop.func1(0xc00004ae00)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1113 +0xd8
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/domain.(*Domain).TelemetryRotateSubWindowLoop
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:1106 +0x7f
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 341 [select, 4 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/domain.(*Domain).LoadPrivilegeLoop.func1(0xc00004ae00, 0xc000dee038, 0x45d964b800, 0x3ffdd78, 0xc005492e00)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:884 +0x125
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/domain.(*Domain).LoadPrivilegeLoop
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:875 +0x1f0
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 582 [select]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/domain.(*Domain).LoadSysVarCacheLoop.func1(0xc00004ae00, 0xc005479fc0, 0x6fc23ac00, 0x3ffdd78, 0xc005c9c000)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:933 +0x125
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/domain.(*Domain).LoadSysVarCacheLoop
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/domain/domain.go:924 +0xf6
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 8545 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc00635f340, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 8544 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc00635f1e0, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 8628 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc00635f760, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 8627 [select, 8 minutes]:
[2021-08-20T05:58:53.634Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc00635f600, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:58:53.634Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.634Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:58:53.634Z] 
[2021-08-20T05:58:53.634Z] goroutine 8543 [semacquire, 8 minutes]:
[2021-08-20T05:58:53.634Z] sync.runtime_SemacquireMutex(0xc0065e31d4, 0x400, 0x1)
[2021-08-20T05:58:53.634Z] 	/usr/local/go/src/runtime/sema.go:71 +0x47
[2021-08-20T05:58:53.634Z] sync.(*Mutex).lockSlow(0xc0065e31d0)
[2021-08-20T05:58:53.634Z] 	/usr/local/go/src/sync/mutex.go:138 +0x105
[2021-08-20T05:58:53.634Z] sync.(*Mutex).Lock(...)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/sync/mutex.go:81
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/util/cteutil.(*StorageRC).Lock(0xc0065e31d0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/cteutil/storage.go:214 +0x47
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*CTEExec).Next(0xc007cd9b80, 0x3fb7868, 0xc00707dcc0, 0xc006493f40, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:141 +0x6e
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc00707dcc0, 0x3fbc238, 0xc007cd9b80, 0xc006493f40, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*CTEExec).computeSeedPart(0xc007cd9cc0, 0x3fb7868, 0xc00707dcc0, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:226 +0x1b2
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*CTEExec).Next(0xc007cd9cc0, 0x3fb7868, 0xc00707dcc0, 0xc0065e3360, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/cte.go:161 +0x491
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc00707dcc0, 0x3fbc238, 0xc007cd9cc0, 0xc0065e3360, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*SelectionExec).Next(0xc006235790, 0x3fb7868, 0xc00707dcc0, 0xc006493ef0, 0x7f65606aba01, 0xc006491ce0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:1302 +0x24c
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.Next(0x3fb7868, 0xc00707dcc0, 0x3fbcdf8, 0xc006235790, 0xc006493ef0, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/executor.go:286 +0x2de
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*outerWorker).buildTask(0xc0065d0630, 0x3fb7868, 0xc00707dcc0, 0x1a, 0x5cd6320, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:403 +0x325
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*outerWorker).run(0xc0065d0630, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:347 +0x116
[2021-08-20T05:58:53.635Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:181 +0x18b
[2021-08-20T05:58:53.635Z] 
[2021-08-20T05:58:53.635Z] goroutine 8626 [select, 8 minutes]:
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/executor.(*innerWorker).run(0xc00635f4a0, 0x3fb7868, 0xc00707dcc0, 0xc00052e800)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:462 +0x218
[2021-08-20T05:58:53.635Z] created by github.com/pingcap/tidb/executor.(*IndexLookUpJoin).startWorkers
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/executor/index_lookup_join.go:184 +0x205
[2021-08-20T05:58:53.635Z] 
[2021-08-20T05:58:53.635Z] goroutine 8519 [semacquire, 8 minutes]:
[2021-08-20T05:58:53.635Z] sync.runtime_SemacquireMutex(0xc0065e3274, 0x2fcc300, 0x1)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/runtime/sema.go:71 +0x47
[2021-08-20T05:58:53.635Z] sync.(*Mutex).lockSlow(0xc0065e3270)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/sync/mutex.go:138 +0x105
[2021-08-20T05:58:53.635Z] sync.(*Mutex).Lock(...)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/sync/mutex.go:81
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/util/cteutil.(*StorageRC).Lock(0xc0065e3270)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/cteutil/storage.go:214 +0x47
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/session.resetCTEStorageMap(0xc006092e00, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1738 +0xe7
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/session.(*execStmtResult).Close(0xc007e74b10, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1717 +0x38
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/util/testkit.(*TestKit).MustExec(0xc0046c7a08, 0x3b90763, 0xb1, 0x0, 0x0, 0x0)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/testkit/testkit.go:220 +0x33e
[2021-08-20T05:58:53.635Z] github.com/pingcap/tidb/bindinfo_test.(*testSuite).TestIssue25505(0xc000712690, 0xc005649d10)
[2021-08-20T05:58:53.635Z] 	/home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/bindinfo/bind_test.go:2345 +0x65c
[2021-08-20T05:58:53.635Z] reflect.Value.call(0x3a8fea0, 0xc000712690, 0xce13, 0x3aa3c82, 0x4, 0xc000ee8ef0, 0x1, 0x1, 0x5d0f640, 0xc0051f1628, ...)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/reflect/value.go:476 +0x8e7
[2021-08-20T05:58:53.635Z] reflect.Value.Call(0x3a8fea0, 0xc000712690, 0xce13, 0xc0051f16f0, 0x1, 0x1, 0x0, 0xc000cc7d00, 0xc0051f1710)
[2021-08-20T05:58:53.635Z] 	/usr/local/go/src/reflect/value.go:337 +0xb9
[2021-08-20T05:58:53.635Z] github.com/pingcap/check.(*suiteRunner).forkTest.func1(0xc005649d10)
[2021-08-20T05:58:53.635Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:850 +0x6b5
[2021-08-20T05:58:53.635Z] github.com/pingcap/check.(*suiteRunner).forkCall.func1(0xc00096cab0, 0xc005649d10, 0xc008234000)
[2021-08-20T05:58:53.635Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:739 +0xbf
[2021-08-20T05:58:53.635Z] created by github.com/pingcap/check.(*suiteRunner).forkCall
[2021-08-20T05:58:53.635Z] 	/nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:734 +0x233
[2021-08-20T05:58:53.635Z] FAIL	github.com/pingcap/tidb/bindinfo	540.179s

rleungx · 2021-08-20T06:24:56Z

Another one: https://ci.pingcap.net/blue/organizations/jenkins/tidb_ghpr_check_2/detail/tidb_ghpr_check_2/27652/pipeline

zimulala · 2021-08-20T07:04:18Z

It seem that TestIssue25505 is hang.

[2021-08-20T02:35:19.537Z] goroutine 8563 [semacquire, 8 minutes]:
[2021-08-20T02:35:19.537Z] sync.runtime_SemacquireMutex(0xc005c3bd64, 0x2fcc200, 0x1)
[2021-08-20T02:35:19.537Z]      /usr/local/go/src/runtime/sema.go:71 +0x47
[2021-08-20T02:35:19.537Z] sync.(*Mutex).lockSlow(0xc005c3bd60)
[2021-08-20T02:35:19.537Z]      /usr/local/go/src/sync/mutex.go:138 +0x105
[2021-08-20T02:35:19.537Z] sync.(*Mutex).Lock(...)
[2021-08-20T02:35:19.537Z]      /usr/local/go/src/sync/mutex.go:81
[2021-08-20T02:35:19.537Z] github.com/pingcap/tidb/util/cteutil.(*StorageRC).Lock(0xc005c3bd60)
[2021-08-20T02:35:19.537Z]      /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/cteutil/storage.go:214 +0x47
[2021-08-20T02:35:19.537Z] github.com/pingcap/tidb/session.resetCTEStorageMap(0xc0077ade00, 0x0, 0x0)
[2021-08-20T02:35:19.537Z]      /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1738 +0xe7
[2021-08-20T02:35:19.537Z] github.com/pingcap/tidb/session.(*execStmtResult).Close(0xc0075844b0, 0x0, 0x0)
[2021-08-20T02:35:19.537Z]      /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/session/session.go:1717 +0x38
[2021-08-20T02:35:19.537Z] github.com/pingcap/tidb/util/testkit.(*TestKit).MustExec(0xc0010f5a08, 0x3b905de, 0xb1, 0x0, 0x0, 0x0)
[2021-08-20T02:35:19.537Z]      /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/util/testkit/testkit.go:220 +0x33e
[2021-08-20T02:35:19.537Z] github.com/pingcap/tidb/bindinfo_test.(*testSuite).TestIssue25505(0xc000a5dda0, 0xc0055bec30)
[2021-08-20T02:35:19.537Z]      /home/jenkins/agent/workspace/tidb_ghpr_check_2/go/src/github.com/pingcap/tidb/bindinfo/bind_test.go:2343 +0x5ec
[2021-08-20T02:35:19.537Z] reflect.Value.call(0x3a8fd80, 0xc000a5dda0, 0xce13, 0x3aa3b62, 0x4, 0xc0000e1ef0, 0x1, 0x1, 0x5d0f640, 0xc006def628, ...)
[2021-08-20T02:35:19.537Z]      /usr/local/go/src/reflect/value.go:476 +0x8e7
[2021-08-20T02:35:19.537Z] reflect.Value.Call(0x3a8fd80, 0xc000a5dda0, 0xce13, 0xc006def6f0, 0x1, 0x1, 0x0, 0xc007a18080, 0x1)
[2021-08-20T02:35:19.537Z]      /usr/local/go/src/reflect/value.go:337 +0xb9
[2021-08-20T02:35:19.537Z] github.com/pingcap/check.(*suiteRunner).forkTest.func1(0xc0055bec30)
[2021-08-20T02:35:19.537Z]      /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:850 +0x6b5
[2021-08-20T02:35:19.537Z] github.com/pingcap/check.(*suiteRunner).forkCall.func1(0xc000a74870, 0xc0055bec30, 0xc007a7c000)
[2021-08-20T02:35:19.537Z]      /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:739 +0xbf
[2021-08-20T02:35:19.537Z] created by github.com/pingcap/check.(*suiteRunner).forkCall
[2021-08-20T02:35:19.537Z]      /nfs/cache/mod/github.com/pingcap/check@v0.0.0-20200212061837-5e12011dc712/check.go:734 +0x233
[2021-08-20T02:35:19.537Z]

ti-srebot · 2021-08-24T07:26:09Z

Please edit this comment or add a new comment to complete the following information

Not a bug

Remove the 'type/bug' label
Add notes to indicate why it is not a bug

Duplicate bug

Add the 'type/duplicate' label
Add the link to the original bug

Bug

Note: Make Sure that 'component', and 'severity' labels are added
Example for how to fill out the template: #20100

1. Root Cause Analysis (RCA) (optional)

2. Symptom (optional)

3. All Trigger Conditions (optional)

4. Workaround (optional)

5. Affected versions

6. Fixed versions

zhouqiang-cl added the type/bug The issue is confirmed as a bug. label Aug 20, 2021

zhouqiang-cl mentioned this issue Aug 20, 2021

Tracking issue for unstable tests #25899

Closed

tisonkun mentioned this issue Aug 20, 2021

bindinfo hang #27420

Closed

tisonkun changed the title ~~hang for 9 minutes~~ bindinfo hang for 9 minutes Aug 20, 2021

zimulala assigned guo-shaoge Aug 20, 2021

ChenPeng2013 added severity/major sig/execution SIG execution labels Aug 20, 2021

This was referenced Aug 21, 2021

execution: fix cte dead lock when used with IndexLookupJoin #27465

Merged

execution: fix cte dead lock when used with IndexLookupJoin #27497

Closed

execution: fix cte dead lock when used with IndexLookupJoin #27498

Merged

longfangsong mentioned this issue Aug 24, 2021

txn, session, test: Try to stabilize testTxnStateSerialSuite.TestRunning and TestBlocked #27235

Merged

1 task

ti-chi-bot closed this as completed in #27465 Aug 24, 2021

ti-srebot added the need-more-info label Aug 24, 2021

This was referenced Aug 24, 2021

execution: fix cte dead lock when used with IndexLookupJoin (#27465) #27536

Merged

execution: fix cte dead lock when used with IndexLookupJoin (#27465) #27537

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`bindinfo` hang for 9 minutes #27410

`bindinfo` hang for 9 minutes #27410

zhouqiang-cl commented Aug 20, 2021

zhouqiang-cl commented Aug 20, 2021

tisonkun commented Aug 20, 2021

unconsolable commented Aug 20, 2021

rleungx commented Aug 20, 2021

zimulala commented Aug 20, 2021

ti-srebot commented Aug 24, 2021

bindinfo hang for 9 minutes #27410

bindinfo hang for 9 minutes #27410

Comments

zhouqiang-cl commented Aug 20, 2021

Bug Report

1. Minimal reproduce step (Required)

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

zhouqiang-cl commented Aug 20, 2021

tisonkun commented Aug 20, 2021

unconsolable commented Aug 20, 2021

rleungx commented Aug 20, 2021

zimulala commented Aug 20, 2021

ti-srebot commented Aug 24, 2021

Please edit this comment or add a new comment to complete the following information

Not a bug

Duplicate bug

Bug

1. Root Cause Analysis (RCA) (optional)

2. Symptom (optional)

3. All Trigger Conditions (optional)

4. Workaround (optional)

5. Affected versions

6. Fixed versions

`bindinfo` hang for 9 minutes #27410

`bindinfo` hang for 9 minutes #27410