roachtest: clock/monotonic/persistent failed

[cockroach-teamcity]

(roachtest).clock/monotonic/persistent failed on master@1520ad2ba7c926f8043de8b6e044ab35c2f67b13:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/clock/monotonic/persistent/run_1
	clock_monotonic.go:87,clock_monotonic.go:138,test_runner.go:753: Node unexpectedly crashed

	cluster.go:2012,clock_util.go:100,clock_monotonic.go:70,panic.go:563,test.go:279,test.go:254,clock_monotonic.go:87,clock_monotonic.go:138,test_runner.go:753: output in run_091231.255_n1_sudo_service_ntp_stop: cluster.RunL: context canceled
		(1) attached stack trace
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2087
		  | [...repeated from below...]
		Wraps: (2) 2 safe details enclosed
		Wraps: (3) output in run_091231.255_n1_sudo_service_ntp_stop
		Wraps: (4) attached stack trace
		  | main.(*cluster).RunL
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2093
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2077
		  | main.(*cluster).Run
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2010
		  | main.(*offsetInjector).recover
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_util.go:100
		  | main.runClockMonotonicity.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:70
		  | runtime.Goexit
		  | 	/usr/local/go/src/runtime/panic.go:563
		  | main.(*test).fatalfInner
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test.go:279
		  | main.(*test).Fatal
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test.go:254
		  | main.runClockMonotonicity
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:87
		  | main.registerClockMonotonicTests.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:138
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:753
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (5) cluster.RunL
		Wraps: (6) context canceled
		Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *errutil.withMessage (4) *withstack.withStack (5) *errutil.withMessage (6) *errors.errorString

More

Artifacts: /clock/monotonic/persistent

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[cockroach-teamcity]

(roachtest).clock/monotonic/persistent failed on master@fe74c9b3534ef364f7bf9410bb84ed2034e1624b:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/clock/monotonic/persistent/run_1
	clock_monotonic.go:87,clock_monotonic.go:138,test_runner.go:753: Node unexpectedly crashed

	cluster.go:2043,clock_util.go:100,clock_monotonic.go:70,panic.go:563,test.go:279,test.go:254,clock_monotonic.go:87,clock_monotonic.go:138,test_runner.go:753: output in run_104432.528_n1_sudo_service_ntp_stop: cluster.RunL: context canceled
		(1) attached stack trace
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2118
		  | [...repeated from below...]
		Wraps: (2) 2 safe details enclosed
		Wraps: (3) output in run_104432.528_n1_sudo_service_ntp_stop
		Wraps: (4) attached stack trace
		  | main.(*cluster).RunL
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2124
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2108
		  | main.(*cluster).Run
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2041
		  | main.(*offsetInjector).recover
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_util.go:100
		  | main.runClockMonotonicity.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:70
		  | runtime.Goexit
		  | 	/usr/local/go/src/runtime/panic.go:563
		  | main.(*test).fatalfInner
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test.go:279
		  | main.(*test).Fatal
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test.go:254
		  | main.runClockMonotonicity
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:87
		  | main.registerClockMonotonicTests.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/clock_monotonic.go:138
		  | main.(*testRunner).runTest.func2
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:753
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (5) cluster.RunL
		Wraps: (6) context canceled
		Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *errutil.withMessage (4) *withstack.withStack (5) *errutil.withMessage (6) *errors.errorString

More

Artifacts: /clock/monotonic/persistent

See this test on roachdash
_{powered by pkg/cmd/internal/issues}

[nvanbenschoten]

10:44:32 test.go:325: test failure: 	clock_monotonic.go:87,clock_monotonic.go:138,test_runner.go:753: Node unexpectedly crashed

But this doesn't actually appear to be the case. We should log the error here:

cockroach/pkg/cmd/roachtest/clock_util.go

Line 22 in b4b7d45

_, err := db.Exec("SHOW DATABASES")