server: package timed out

[cockroach-teamcity]

(server).(unknown) failed on master@37cdf01299861235888af3411e699480f5a2d670:

Slow failing tests:
TestDecommissionedNodeCannotConnect - 3.00s

Slow passing tests:
TestStatusAPITransactionStatementIDsTruncation - 27.76s
TestClusterConnectivity - 25.93s
TestInitHandshakeWrongToken - 20.10s
TestStatusAPITransactions - 19.12s
TestAdminAPITableStats - 17.69s
TestAdminAPIDataDistribution - 14.55s
TestListSessionsV2 - 14.18s
TestRangeCount - 12.30s
TestStatusAPIStatements - 12.05s
TestNodesV2 - 11.16s
TestLivenessAPI - 10.70s
TestHealthV2 - 10.56s
TestStatsforSpanOnLocalMax - 10.55s
TestAdminAPINonTableStats - 9.91s
TestAdminAPITableDetails - 9.85s
TestMultiRangeScanWithPagination - 9.55s
TestInitHandshake - 8.48s
TestRotationOnIntializedNode - 7.68s
TestRotationOnPartialIntializedNode - 6.78s
TestRotationOnBrokenIntializedNode - 6.57s

More

Parameters:

• TAGS=
• GOFLAGS=-race -parallel=4

make stressrace TESTS=(unknown) PKG=./pkg/server TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[cockroach-teamcity]

(server).(unknown) failed on master@37cdf01299861235888af3411e699480f5a2d670:

Slow failing tests:
TestDecommissionedNodeCannotConnect - 0.44s

Slow passing tests:
TestInitHandshakeWrongToken - 20.02s
TestClusterConnectivity - 17.65s
TestStatusAPITransactions - 8.78s
TestMakeIdleMonitor_WithBriefConnectionDuringCountdown - 5.32s
TestInitHandshake - 4.49s
TestLogGC - 4.20s
TestStatusAPITransactionStatementIDsTruncation - 4.09s
TestRotationOnIntializedNode - 3.60s
TestRotationOnPartialIntializedNode - 2.53s
TestListSessionsV2 - 2.51s
TestMakeIdleMonitor_WithConnectionDuringWarmup - 2.28s
TestInitializeFromConfig - 2.28s
TestMakeIdleMonitor_WithBriefConnectionDuringWarmup - 2.27s
TestMakeIdleMonitor - 2.27s
TestAdminAPIDataDistribution - 2.07s
TestDummyInitializeNodeFromBundle - 2.00s
TestRotationOnBrokenIntializedNode - 1.90s
TestAdminAPITableStats - 1.81s
TestVerifyPassword - 1.80s
TestStatusAPIStatements - 1.77s

More

Parameters:

• TAGS=
• GOFLAGS=-parallel=4

make stressrace TESTS=(unknown) PKG=./pkg/server TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[adityamaru]

This issue was opened by TC because TestDecommissionedNodeCannotConnect was failing with:
E210304 06:43:14.645467 698376 2@rpc/context.go:1057 [n3] 22183 removing connection to 127.0.0.1:39687 due to error: rpc error: code = PermissionDenied desc = n3 was permanently removed from the cluster at 2021-03-04 06:17:09.902970014 +0000 UTC; it is not allowed to rejoin the cluster panic: test timed out after 30m0s

Example failure: https://teamcity.cockroachdb.com/viewLog.html?buildId=2743148&buildTypeId=Cockroach_UnitTests_Test&tab=artifacts#%2FlogTestDecommissionedNodeCannotConnect696035602;%2Fraw.0.json.txt.tgz

[adityamaru]

@tbg assigning this to you, as the most recent editor of the test.