roachtest: acceptance/rapid-restart failed #70559

cockroach-teamcity · 2021-09-22T06:20:35Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 1dbea6a3e4c93ba7c4a43ad34369c438558eba8a:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3479918-1632291457-10-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		4: skipped
		2: skipped
		3: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

The text was updated successfully, but these errors were encountered:

cockroach-teamcity · 2021-09-23T06:34:56Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ a465b0d5d51a6534d39e0683fd037d132bcbd576:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3485082-1632378740-08-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		2: skipped
		3: skipped
		4: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-24T06:20:40Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 85b1e92455eb2795043d71e5766b1b56dab308f2:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3490908-1632464226-12-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		4: skipped
		2: skipped
		3: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-25T06:25:19Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 9ba8499e80a3234da094e061827f1c23d9d33341:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3496731-1632550956-11-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		3: skipped
		4: skipped
		2: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-26T06:17:14Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ ecaa4920192549af1418923648769ede3de1c9c8:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3498637-1632636879-02-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		3: skipped
		2: skipped
		4: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-27T06:18:42Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 37d9f72a28a8e009bc6ba3c4d3c5780af554b92d:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3500695-1632723355-16-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		2: skipped
		4: skipped
		3: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-28T06:28:42Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 80844e44f4f9d0e565c6e810bd4c782be61899bf:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3507382-1632810364-12-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		4: skipped
		2: skipped
		3: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-29T06:11:42Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ ab0c462672cff1e6928aba2dfc3a5429466aea39:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-09-30T06:21:42Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ ac885449c1fe74de23ea5d82858b3aa3674496f9:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3518573-1632982730-14-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		2: skipped
		4: skipped
		3: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-10-10T06:27:50Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ afb9f8dd5c4b66c39a15dc16e1b9ca07c09816bd:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3562413-1633847114-04-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		2: skipped
		3: skipped
		4: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1175
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2104
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-10-11T06:25:14Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ fffd9274a986fcbff880b9d503334f117ba17515:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

	cluster.go:1300,context.go:91,cluster.go:1288,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3564395-1633933349-13-n4cpu4 --oneshot --ignore-empty-nodes: exit status 1 1: dead (exit status 0)
		2: skipped
		3: skipped
		4: skipped
		Error: UNCLASSIFIED_PROBLEM: 1: dead (exit status 0)
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  -- stack trace:
		  | main.glob..func14
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1175
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
		  | github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
		  | github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
		  | github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2104
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:225
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1371
		Wraps: (3) 1: dead (exit status 0)
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-10-15T06:13:57Z

roachtest.acceptance/rapid-restart failed with artifacts on master @ 0984f873c6170ab34afe6fee4661fc5f76ac0dee:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/acceptance/rapid-restart/run_1
	rapid_restart.go:89,acceptance.go:104,test_runner.go:777: unexpected exit status 10

Reproduce

See: roachtest README

Same failure on other branches

roachtest: acceptance/rapid-restart failed (skipped) #65295 roachtest: acceptance/rapid-restart failed (skipped) [C-test-failure O-roachtest O-robot T-kv T-server-and-security branch-release-21.1]

/cc @cockroachdb/server _{This test on roachdash | Improve this report!}

blathers-crl bot added the T-server-and-security DB Server & Security label Sep 22, 2021

cameronnunez mentioned this issue Oct 20, 2021

roachtest: improve rapid-restart by using c.Start #71774

Merged

craig bot closed this as completed in 7265486 Oct 21, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

roachtest: acceptance/rapid-restart failed #70559

roachtest: acceptance/rapid-restart failed #70559

cockroach-teamcity commented Sep 22, 2021

cockroach-teamcity commented Sep 23, 2021

cockroach-teamcity commented Sep 24, 2021

cockroach-teamcity commented Sep 25, 2021

cockroach-teamcity commented Sep 26, 2021

cockroach-teamcity commented Sep 27, 2021

cockroach-teamcity commented Sep 28, 2021

cockroach-teamcity commented Sep 29, 2021

cockroach-teamcity commented Sep 30, 2021

cockroach-teamcity commented Oct 10, 2021

cockroach-teamcity commented Oct 11, 2021

cockroach-teamcity commented Oct 15, 2021

roachtest: acceptance/rapid-restart failed #70559

roachtest: acceptance/rapid-restart failed #70559

Comments

cockroach-teamcity commented Sep 22, 2021

cockroach-teamcity commented Sep 23, 2021

cockroach-teamcity commented Sep 24, 2021

cockroach-teamcity commented Sep 25, 2021

cockroach-teamcity commented Sep 26, 2021

cockroach-teamcity commented Sep 27, 2021

cockroach-teamcity commented Sep 28, 2021

cockroach-teamcity commented Sep 29, 2021

cockroach-teamcity commented Sep 30, 2021

cockroach-teamcity commented Oct 10, 2021

cockroach-teamcity commented Oct 11, 2021

cockroach-teamcity commented Oct 15, 2021