roachtest: decommission/randomized failed

[cockroach-teamcity]

(roachtest).decommission/randomized failed on release-20.2@150c5918fb6e28e0ea5bfa4e8e94088986fbbf98:

		  |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/decommission.go:61
		  |   | main.(*testRunner).runTest.func2
		  |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:755
		  |   | runtime.goexit
		  |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  | Wraps: (2) secondary error attachment
		  |   | <nil>
		  |   | (1) attached stack trace
		  |   |   -- stack trace:
		  |   |   | main.(*decommTestHelper).matchCSV
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/decommission.go:998
		  |   |   | main.runDecommissionRandomized.func3
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/decommission.go:555
		  |   |   | github.com/cockroachdb/cockroach/pkg/util/retry.WithMaxAttempts
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/util/retry/retry.go:172
		  |   |   | main.runDecommissionRandomized
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/decommission.go:540
		  |   |   | main.registerDecommission.func2
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/decommission.go:61
		  |   |   | main.(*testRunner).runTest.func2
		  |   |   | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:755
		  |   |   | runtime.goexit
		  |   |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  |   | Wraps: (2) <nil>
		  |   |   | row #1, col #1: found "2" which does not match "id"
		  |   | Error types: (1) *withstack.withStack (2) *errutil.leafError
		  | Wraps: (3) <nil>
		  |   | row #1, col #1: found "2" which does not match "id"
		  |   | row #2, col #1: found "3" which does not match "1"
		  | Error types: (1) *withstack.withStack (2) *secondary.withSecondaryError (3) *errutil.leafError
		Wraps: (3) csv input:
		  | id
		  | 1
		  | 2
		  | 3
		  | 4
		  | 5
		  | 6
		  | expected:
		  | [][]string{
		  |     {"id"},
		  |     {"1"},
		  |     {"4"},
		  |     {"5"},
		  |     {"6"},
		  | }
		  | errors:<nil>
		  | row #1, col #1: found "2" which does not match "id"
		  | row #2, col #1: found "3" which does not match "1"
		Error types: (1) *withstack.withStack (2) *secondary.withSecondaryError (3) *errutil.leafError

More

Artifacts: /decommission/randomized

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[nvanbenschoten]

@tbg do you have context on this failure? It looks like nodes that we decommissioned are still showing up in node ls. I see that you touched this test in #55809 to close out a series of flakes in #55581.

[tbg]

I'll take a look. I'm noticing this is on the 20.2 branch, maybe the test there didn't get the update.