Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build: build failure on darwin builders since CL 536399 [consistent failure] #70402

Closed
gopherbot opened this issue Nov 17, 2024 · 17 comments
Closed
Assignees
Labels
NeedsFix The path to resolution is known, but the work has not been done. release-blocker
Milestone

Comments

@gopherbot
Copy link
Contributor

gopherbot commented Nov 17, 2024

#!watchflakes
default <- goos == "darwin" && repo == "go" && mode == "build"

Issue created automatically to collect these failures.

Example (log):

[I2024-11-17T08:21:42.014312-08:00 32500 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T08:21:42.015086-08:00 32500 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T08:21:42.019370-08:00 32500 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T08:21:42.019707-08:00 32500 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.197s
ok  	archive/zip	0.557s
ok  	bufio	0.074s
ok  	bytes	0.576s
ok  	cmp	0.022s
ok  	compress/bzip2	0.129s
...
[W2024-11-17T08:41:11.541847-08:00 32500 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T08:41:11.541996-08:00 32500 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T08:41:11.543664-08:00 32500 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T08:41:11.543745-08:00 32500 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T08:41:11.543763-08:00 32500 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T08:41:11.543798-08:00 32500 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T08:41:11.543811-08:00 32500 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T08:41:11.543854-08:00 32500 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T08:41:11.543973-08:00 32500 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T08:41:11.544163-08:00 32500 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@gopherbot gopherbot added the NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. label Nov 17, 2024
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-darwin-amd64-nocgo" && repo == "go" && mode == "build"
2024-11-17 14:32 gotip-darwin-amd64-nocgo go@f9a95b1b [build] (log)
[I2024-11-17T08:21:42.014312-08:00 32500 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T08:21:42.015086-08:00 32500 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T08:21:42.019370-08:00 32500 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T08:21:42.019707-08:00 32500 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.197s
ok  	archive/zip	0.557s
ok  	bufio	0.074s
ok  	bytes	0.576s
ok  	cmp	0.022s
ok  	compress/bzip2	0.129s
...
[W2024-11-17T08:41:11.541847-08:00 32500 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T08:41:11.541996-08:00 32500 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T08:41:11.543664-08:00 32500 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T08:41:11.543745-08:00 32500 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T08:41:11.543763-08:00 32500 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T08:41:11.543798-08:00 32500 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T08:41:11.543811-08:00 32500 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T08:41:11.543854-08:00 32500 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T08:41:11.543973-08:00 32500 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T08:41:11.544163-08:00 32500 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64-nocgo go@44d4b699 [build] (log)
[I2024-11-17T07:38:19.235255-08:00 93031 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T07:38:19.235356-08:00 93031 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T07:38:19.239065-08:00 93031 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T07:38:19.239826-08:00 93031 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.204s
ok  	archive/zip	0.469s
ok  	bufio	0.092s
ok  	bytes	0.422s
ok  	cmp	0.026s
ok  	compress/bzip2	0.117s
...
[W2024-11-17T07:56:03.658111-08:00 93031 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T07:56:03.658273-08:00 93031 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T07:56:03.658501-08:00 93031 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T07:56:03.658652-08:00 93031 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T07:56:03.658670-08:00 93031 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T07:56:03.658722-08:00 93031 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T07:56:03.658734-08:00 93031 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T07:56:03.658940-08:00 93031 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T07:56:03.659178-08:00 93031 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T07:56:03.659227-08:00 93031 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:17 gotip-darwin-amd64-nocgo go@63f762bc [build] (log)
[I2024-11-17T12:38:38.893020-08:00 91118 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:38:38.893183-08:00 91118 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:38:38.898377-08:00 91118 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:38:38.898757-08:00 91118 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.284s
ok  	archive/zip	0.526s
ok  	bufio	0.079s
ok  	bytes	0.445s
ok  	cmp	0.021s
ok  	compress/bzip2	0.159s
...
[W2024-11-17T12:57:21.772909-08:00 91118 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T12:57:21.772968-08:00 91118 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T12:57:21.773179-08:00 91118 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T12:57:21.773272-08:00 91118 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T12:57:21.773290-08:00 91118 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T12:57:21.773318-08:00 91118 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T12:57:21.773330-08:00 91118 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T12:57:21.773480-08:00 91118 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T12:57:21.773647-08:00 91118 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T12:57:21.773689-08:00 91118 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:21 gotip-darwin-amd64-nocgo go@a867e5e5 [build] (log)
[I2024-11-17T13:19:33.333502-08:00 1168 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:19:33.333577-08:00 1168 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:19:33.336820-08:00 1168 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:19:33.337141-08:00 1168 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.212s
ok  	archive/zip	0.542s
ok  	bufio	0.067s
ok  	bytes	0.543s
ok  	cmp	0.030s
ok  	compress/bzip2	0.102s
...
[W2024-11-17T13:40:53.759529-08:00 1168 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:40:53.759675-08:00 1168 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:40:53.760132-08:00 1168 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:40:53.760341-08:00 1168 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:40:53.760376-08:00 1168 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:40:53.760452-08:00 1168 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:40:53.760472-08:00 1168 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:40:53.760539-08:00 1168 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:40:53.760598-08:00 1168 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:40:53.760648-08:00 1168 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-darwin-amd64-nocgo" && repo == "go" && mode == "build"
2024-11-17 21:09 gotip-darwin-amd64-nocgo go@01e1e5c2 [build] (log)
[I2024-11-17T14:05:30.645846-08:00 70868 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T14:05:30.646306-08:00 70868 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T14:05:30.651098-08:00 70868 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T14:05:30.651490-08:00 70868 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.264s
ok  	archive/zip	0.413s
ok  	bufio	0.067s
ok  	bytes	0.413s
ok  	cmp	0.025s
ok  	compress/bzip2	0.087s
...
[W2024-11-17T14:23:24.016937-08:00 70868 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T14:23:24.017171-08:00 70868 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T14:23:24.017402-08:00 70868 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T14:23:24.017541-08:00 70868 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T14:23:24.017559-08:00 70868 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T14:23:24.017610-08:00 70868 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T14:23:24.017622-08:00 70868 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T14:23:24.017675-08:00 70868 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T14:23:24.017775-08:00 70868 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T14:23:24.018060-08:00 70868 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "gotip-darwin-amd64-nocgo" && repo == "go" && mode == "build"
2024-11-17 20:16 gotip-darwin-amd64-nocgo go@04807d3a [build] (log)
[I2024-11-17T14:24:32.561176-08:00 44880 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T14:24:32.561264-08:00 44880 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T14:24:32.564303-08:00 44880 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T14:24:32.564651-08:00 44880 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.173s
ok  	archive/zip	0.491s
ok  	bufio	0.066s
ok  	bytes	0.331s
ok  	cmp	0.021s
ok  	compress/bzip2	0.106s
...
[W2024-11-17T14:42:52.767425-08:00 44880 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T14:42:52.767677-08:00 44880 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T14:42:52.767990-08:00 44880 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T14:42:52.768165-08:00 44880 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T14:42:52.768197-08:00 44880 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T14:42:52.768306-08:00 44880 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T14:42:52.768329-08:00 44880 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T14:42:52.768376-08:00 44880 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T14:42:52.768415-08:00 44880 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T14:42:52.768468-08:00 44880 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@cherrymui cherrymui changed the title build: build failure on gotip-darwin-amd64-nocgo [consistent failure] build: build failure on darwin builders since CL 536399 [consistent failure] Nov 18, 2024
@cherrymui
Copy link
Member

cc @aclements

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "darwin" && repo == "go" && mode == "build"
2024-11-17 14:32 gotip-darwin-amd64-longtest go@f9a95b1b [build] (log)
[I2024-11-17T09:51:54.694725-08:00 55234 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T09:51:54.694796-08:00 55234 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T09:51:54.696424-08:00 55234 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T09:51:54.696749-08:00 55234 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.580s
ok  	archive/zip	82.341s
ok  	bufio	0.681s
ok  	bytes	3.867s
ok  	cmp	1.029s
ok  	compress/bzip2	1.293s
...
[W2024-11-17T10:23:05.865723-08:00 55234 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T10:23:05.865814-08:00 55234 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T10:23:05.866095-08:00 55234 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T10:23:05.866180-08:00 55234 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T10:23:05.866198-08:00 55234 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T10:23:05.866230-08:00 55234 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T10:23:05.866241-08:00 55234 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T10:23:05.866282-08:00 55234 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T10:23:05.866303-08:00 55234 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T10:23:05.866330-08:00 55234 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64_13 go@f9a95b1b [build] (log)
[I2024-11-17T07:38:15.504478-08:00 57221 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T07:38:15.504585-08:00 57221 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T07:38:15.507567-08:00 57221 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T07:38:15.508069-08:00 57221 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.227s
ok  	archive/zip	0.561s
ok  	bufio	0.104s
ok  	bytes	0.723s
ok  	cmp	0.036s
ok  	compress/bzip2	0.140s
...
[W2024-11-17T08:08:36.902062-08:00 57221 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T08:08:36.902143-08:00 57221 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T08:08:36.902297-08:00 57221 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T08:08:36.902402-08:00 57221 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T08:08:36.902420-08:00 57221 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T08:08:36.902455-08:00 57221 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T08:08:36.902467-08:00 57221 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T08:08:36.902512-08:00 57221 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T08:08:36.902557-08:00 57221 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T08:08:36.902625-08:00 57221 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64_14 go@f9a95b1b [build] (log)
[I2024-11-17T08:38:12.724505-08:00 28053 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T08:38:12.724686-08:00 28053 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T08:38:12.729617-08:00 28053 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T08:38:12.729988-08:00 28053 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.199s
ok  	archive/zip	0.633s
ok  	bufio	0.091s
ok  	bytes	0.468s
ok  	cmp	0.033s
ok  	compress/bzip2	0.137s
...
[W2024-11-17T09:07:31.771536-08:00 28053 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T09:07:31.771756-08:00 28053 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T09:07:31.771985-08:00 28053 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T09:07:31.772126-08:00 28053 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T09:07:31.772143-08:00 28053 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T09:07:31.772193-08:00 28053 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T09:07:31.772208-08:00 28053 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T09:07:31.772345-08:00 28053 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T09:07:31.772398-08:00 28053 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T09:07:31.772440-08:00 28053 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-arm64_13 go@f9a95b1b [build] (log)
[I2024-11-17T07:17:43.522594-08:00 43218 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T07:17:43.522644-08:00 43218 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T07:17:43.523657-08:00 43218 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T07:17:43.523834-08:00 43218 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.190s
ok  	archive/zip	0.455s
ok  	bufio	0.263s
ok  	bytes	0.314s
ok  	cmp	0.217s
ok  	compress/bzip2	0.196s
...
[W2024-11-17T07:22:26.729795-08:00 43218 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T07:22:26.729810-08:00 43218 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T07:22:26.729926-08:00 43218 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T07:22:26.729950-08:00 43218 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T07:22:26.729956-08:00 43218 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T07:22:26.729966-08:00 43218 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T07:22:26.729974-08:00 43218 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T07:22:26.729984-08:00 43218 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T07:22:26.730000-08:00 43218 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T07:22:26.730024-08:00 43218 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64-longtest go@44d4b699 [build] (log)
[I2024-11-17T08:12:13.302893-08:00 65265 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T08:12:13.302986-08:00 65265 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T08:12:13.308397-08:00 65265 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T08:12:13.308805-08:00 65265 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.188s
ok  	archive/zip	34.192s
ok  	bufio	0.071s
ok  	bytes	2.573s
ok  	cmp	0.029s
ok  	compress/bzip2	0.109s
...
[W2024-11-17T09:34:22.001422-08:00 65265 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T09:34:22.001466-08:00 65265 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T09:34:22.001647-08:00 65265 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T09:34:22.001726-08:00 65265 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T09:34:22.001742-08:00 65265 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T09:34:22.001769-08:00 65265 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T09:34:22.001781-08:00 65265 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T09:34:22.001821-08:00 65265 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T09:34:22.002030-08:00 65265 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T09:34:22.002207-08:00 65265 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64_13 go@44d4b699 [build] (log)
[I2024-11-17T07:11:50.562796-08:00 74249 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T07:11:50.563405-08:00 74249 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T07:11:50.568107-08:00 74249 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T07:11:50.568463-08:00 74249 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.269s
ok  	archive/zip	0.639s
ok  	bufio	0.076s
ok  	bytes	0.381s
ok  	cmp	0.028s
ok  	compress/bzip2	0.106s
...
[W2024-11-17T07:37:05.821685-08:00 74249 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T07:37:05.821970-08:00 74249 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T07:37:05.822405-08:00 74249 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T07:37:05.822564-08:00 74249 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T07:37:05.822589-08:00 74249 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T07:37:05.822658-08:00 74249 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T07:37:05.822681-08:00 74249 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T07:37:05.822947-08:00 74249 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T07:37:05.823333-08:00 74249 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T07:37:05.823395-08:00 74249 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-amd64_14 go@44d4b699 [build] (log)
[I2024-11-17T07:45:16.499751-08:00 26566 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T07:45:16.500074-08:00 26566 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T07:45:16.506376-08:00 26566 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T07:45:16.506794-08:00 26566 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.201s
ok  	archive/zip	0.591s
ok  	bufio	0.084s
ok  	bytes	0.481s
ok  	cmp	0.031s
ok  	compress/bzip2	0.096s
...
[W2024-11-17T08:10:20.559098-08:00 26566 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T08:10:20.559155-08:00 26566 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T08:10:20.559420-08:00 26566 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T08:10:20.559532-08:00 26566 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T08:10:20.559550-08:00 26566 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T08:10:20.559577-08:00 26566 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T08:10:20.559589-08:00 26566 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T08:10:20.559621-08:00 26566 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T08:10:20.559737-08:00 26566 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T08:10:20.559899-08:00 26566 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 14:32 gotip-darwin-arm64_13 go@44d4b699 [build] (log)
[I2024-11-17T06:59:20.348124-08:00 64022 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T06:59:20.348194-08:00 64022 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T06:59:20.349177-08:00 64022 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T06:59:20.349352-08:00 64022 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.258s
ok  	archive/zip	0.457s
ok  	bufio	0.123s
ok  	bytes	0.517s
ok  	cmp	0.137s
ok  	compress/bzip2	0.249s
...
[W2024-11-17T07:04:06.363056-08:00 64022 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T07:04:06.363088-08:00 64022 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T07:04:06.363228-08:00 64022 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T07:04:06.363264-08:00 64022 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T07:04:06.363270-08:00 64022 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T07:04:06.363280-08:00 64022 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T07:04:06.363284-08:00 64022 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T07:04:06.363310-08:00 64022 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T07:04:06.363338-08:00 64022 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T07:04:06.363351-08:00 64022 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:16 gotip-darwin-amd64_13 go@04807d3a [build] (log)
[I2024-11-17T13:52:35.174215-08:00 6216 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:52:35.174335-08:00 6216 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:52:35.179461-08:00 6216 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:52:35.180047-08:00 6216 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.190s
ok  	archive/zip	0.631s
ok  	bufio	0.096s
ok  	bytes	0.473s
ok  	cmp	0.037s
ok  	compress/bzip2	0.108s
...
[W2024-11-17T14:21:42.429265-08:00 6216 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T14:21:42.429345-08:00 6216 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T14:21:42.429521-08:00 6216 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T14:21:42.429616-08:00 6216 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T14:21:42.429636-08:00 6216 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T14:21:42.429665-08:00 6216 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T14:21:42.429677-08:00 6216 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T14:21:42.429731-08:00 6216 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T14:21:42.429753-08:00 6216 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T14:21:42.429785-08:00 6216 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:16 gotip-darwin-amd64_14 go@04807d3a [build] (log)
[I2024-11-17T14:34:25.326508-08:00 65932 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T14:34:25.326752-08:00 65932 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T14:34:25.331574-08:00 65932 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T14:34:25.332107-08:00 65932 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.211s
ok  	archive/zip	0.568s
ok  	bufio	0.074s
ok  	bytes	0.509s
ok  	cmp	0.037s
ok  	compress/bzip2	0.108s
...
[W2024-11-17T15:00:29.337762-08:00 65932 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T15:00:29.337819-08:00 65932 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T15:00:29.337976-08:00 65932 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T15:00:29.338043-08:00 65932 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T15:00:29.338061-08:00 65932 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T15:00:29.338088-08:00 65932 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T15:00:29.338100-08:00 65932 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T15:00:29.338132-08:00 65932 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T15:00:29.338162-08:00 65932 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T15:00:29.338208-08:00 65932 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:16 gotip-darwin-arm64_13 go@04807d3a [build] (log)
[I2024-11-17T13:04:31.603297-08:00 43297 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:04:31.603348-08:00 43297 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:04:31.604005-08:00 43297 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:04:31.604190-08:00 43297 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.206s
ok  	archive/zip	0.500s
ok  	bufio	0.234s
ok  	bytes	0.400s
ok  	cmp	0.371s
ok  	compress/bzip2	0.514s
...
[W2024-11-17T13:09:17.825201-08:00 43297 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:09:17.825223-08:00 43297 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:09:17.825356-08:00 43297 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:09:17.825388-08:00 43297 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:09:17.825393-08:00 43297 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:09:17.825405-08:00 43297 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:09:17.825409-08:00 43297 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:09:17.825432-08:00 43297 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:09:17.825448-08:00 43297 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:09:17.825473-08:00 43297 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:17 gotip-darwin-amd64-longtest go@63f762bc [build] (log)
[I2024-11-17T16:55:51.037436-08:00 1963 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T16:55:51.037586-08:00 1963 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T16:55:51.045651-08:00 1963 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T16:55:51.046006-08:00 1963 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.279s
ok  	archive/zip	36.494s
ok  	bufio	0.087s
ok  	bytes	2.791s
ok  	cmp	0.028s
ok  	compress/bzip2	0.109s
...
[W2024-11-17T18:25:23.288995-08:00 1963 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:25:23.289261-08:00 1963 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:25:23.289501-08:00 1963 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:25:23.289648-08:00 1963 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:25:23.289665-08:00 1963 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:25:23.289715-08:00 1963 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:25:23.289731-08:00 1963 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:25:23.289798-08:00 1963 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:25:23.289936-08:00 1963 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:25:23.290236-08:00 1963 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:17 gotip-darwin-amd64_13 go@63f762bc [build] (log)
[I2024-11-17T12:27:31.088434-08:00 11006 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:27:31.088661-08:00 11006 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:27:31.091259-08:00 11006 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:27:31.091597-08:00 11006 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.310s
ok  	archive/zip	0.613s
ok  	bufio	0.070s
ok  	bytes	0.376s
ok  	cmp	0.022s
ok  	compress/bzip2	0.122s
...
[W2024-11-17T12:57:28.387618-08:00 11006 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T12:57:28.387769-08:00 11006 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T12:57:28.388026-08:00 11006 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T12:57:28.388285-08:00 11006 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T12:57:28.388307-08:00 11006 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T12:57:28.388358-08:00 11006 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T12:57:28.388370-08:00 11006 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T12:57:28.388404-08:00 11006 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T12:57:28.388451-08:00 11006 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T12:57:28.388514-08:00 11006 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:17 gotip-darwin-amd64_14 go@63f762bc [build] (log)
[I2024-11-17T12:36:39.917419-08:00 85972 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:36:39.917659-08:00 85972 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:36:39.921367-08:00 85972 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:36:39.922785-08:00 85972 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.166s
ok  	archive/zip	0.743s
ok  	bufio	0.090s
ok  	bytes	0.388s
ok  	cmp	0.023s
ok  	compress/bzip2	0.101s
...
[W2024-11-17T12:59:28.225210-08:00 85972 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T12:59:28.225402-08:00 85972 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T12:59:28.225640-08:00 85972 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T12:59:28.225787-08:00 85972 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T12:59:28.225805-08:00 85972 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T12:59:28.225856-08:00 85972 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T12:59:28.225868-08:00 85972 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T12:59:28.225903-08:00 85972 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T12:59:28.225924-08:00 85972 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T12:59:28.225959-08:00 85972 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:17 gotip-darwin-arm64_13 go@63f762bc [build] (log)
[I2024-11-17T12:26:22.191350-08:00 7343 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:26:22.191396-08:00 7343 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:26:22.192156-08:00 7343 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:26:22.192343-08:00 7343 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.410s
ok  	archive/zip	0.390s
ok  	bufio	0.116s
ok  	bytes	0.237s
ok  	cmp	0.205s
ok  	compress/bzip2	0.396s
...
[W2024-11-17T12:31:09.312861-08:00 7343 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T12:31:09.312879-08:00 7343 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T12:31:09.312991-08:00 7343 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T12:31:09.313018-08:00 7343 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T12:31:09.313024-08:00 7343 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T12:31:09.313034-08:00 7343 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T12:31:09.313042-08:00 7343 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T12:31:09.313057-08:00 7343 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T12:31:09.313067-08:00 7343 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T12:31:09.313075-08:00 7343 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:21 gotip-darwin-amd64-longtest go@a867e5e5 [build] (log)
[I2024-11-17T15:36:30.251236-08:00 1688 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T15:36:30.251397-08:00 1688 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T15:36:30.258751-08:00 1688 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T15:36:30.259282-08:00 1688 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.221s
ok  	archive/zip	34.429s
ok  	bufio	0.074s
ok  	bytes	2.524s
ok  	cmp	0.026s
ok  	compress/bzip2	0.101s
...
[W2024-11-17T16:54:13.781120-08:00 1688 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T16:54:13.781184-08:00 1688 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T16:54:13.781722-08:00 1688 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T16:54:13.781867-08:00 1688 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T16:54:13.781887-08:00 1688 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T16:54:13.781916-08:00 1688 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T16:54:13.781941-08:00 1688 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T16:54:13.782079-08:00 1688 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T16:54:13.782236-08:00 1688 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T16:54:13.782372-08:00 1688 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:21 gotip-darwin-amd64_13 go@a867e5e5 [build] (log)
[I2024-11-17T12:58:18.164924-08:00 28966 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:58:18.165170-08:00 28966 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:58:18.169636-08:00 28966 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:58:18.169959-08:00 28966 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.256s
ok  	archive/zip	0.679s
ok  	bufio	0.073s
ok  	bytes	0.386s
ok  	cmp	0.030s
ok  	compress/bzip2	0.129s
...
[W2024-11-17T13:26:44.664693-08:00 28966 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:26:44.664870-08:00 28966 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:26:44.665105-08:00 28966 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:26:44.665218-08:00 28966 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:26:44.665236-08:00 28966 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:26:44.665294-08:00 28966 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:26:44.665306-08:00 28966 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:26:44.665364-08:00 28966 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:26:44.665509-08:00 28966 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:26:44.665609-08:00 28966 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:21 gotip-darwin-amd64_14 go@a867e5e5 [build] (log)
[I2024-11-17T13:21:47.522597-08:00 14109 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:21:47.522845-08:00 14109 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:21:47.527885-08:00 14109 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:21:47.528256-08:00 14109 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.152s
ok  	archive/zip	0.589s
ok  	bufio	0.062s
ok  	bytes	0.487s
ok  	cmp	0.034s
ok  	compress/bzip2	0.096s
...
[W2024-11-17T13:44:46.339385-08:00 14109 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:44:46.339436-08:00 14109 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:44:46.339616-08:00 14109 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:44:46.339685-08:00 14109 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:44:46.339702-08:00 14109 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:44:46.339728-08:00 14109 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:44:46.339740-08:00 14109 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:44:46.339875-08:00 14109 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:44:46.339926-08:00 14109 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:44:46.339978-08:00 14109 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 20:21 gotip-darwin-arm64_13 go@a867e5e5 [build] (log)
[I2024-11-17T12:45:55.275771-08:00 46427 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T12:45:55.275794-08:00 46427 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T12:45:55.276658-08:00 46427 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T12:45:55.276852-08:00 46427 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.262s
ok  	archive/zip	0.396s
ok  	bufio	0.121s
ok  	bytes	0.567s
ok  	cmp	0.099s
ok  	compress/bzip2	0.191s
...
[W2024-11-17T12:50:41.502023-08:00 46427 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T12:50:41.502041-08:00 46427 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T12:50:41.502181-08:00 46427 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T12:50:41.502220-08:00 46427 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T12:50:41.502226-08:00 46427 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T12:50:41.502239-08:00 46427 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T12:50:41.502242-08:00 46427 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T12:50:41.502268-08:00 46427 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T12:50:41.502296-08:00 46427 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T12:50:41.502316-08:00 46427 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 21:09 gotip-darwin-amd64-longtest go@01e1e5c2 [build] (log)
[I2024-11-17T14:05:51.271359-08:00 10366 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T14:05:51.271483-08:00 10366 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T14:05:51.277678-08:00 10366 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T14:05:51.278169-08:00 10366 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.265s
ok  	archive/zip	35.506s
ok  	bufio	0.095s
ok  	bytes	2.482s
ok  	cmp	0.028s
ok  	compress/bzip2	0.109s
...
[W2024-11-17T15:34:50.044319-08:00 10366 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T15:34:50.044400-08:00 10366 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T15:34:50.044641-08:00 10366 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T15:34:50.044745-08:00 10366 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T15:34:50.044762-08:00 10366 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T15:34:50.044790-08:00 10366 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T15:34:50.044801-08:00 10366 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T15:34:50.044834-08:00 10366 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T15:34:50.044931-08:00 10366 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T15:34:50.045150-08:00 10366 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 21:09 gotip-darwin-amd64_13 go@01e1e5c2 [build] (log)
[I2024-11-17T13:27:42.250320-08:00 19491 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:27:42.250625-08:00 19491 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:27:42.253397-08:00 19491 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:27:42.253783-08:00 19491 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.206s
ok  	archive/zip	0.620s
ok  	bufio	0.152s
ok  	bytes	0.550s
ok  	cmp	0.026s
ok  	compress/bzip2	0.121s
...
[W2024-11-17T13:51:41.374994-08:00 19491 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:51:41.375056-08:00 19491 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:51:41.375342-08:00 19491 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:51:41.375579-08:00 19491 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:51:41.375621-08:00 19491 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:51:41.375730-08:00 19491 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:51:41.375743-08:00 19491 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:51:41.375779-08:00 19491 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:51:41.375848-08:00 19491 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:51:41.376256-08:00 19491 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 21:09 gotip-darwin-amd64_14 go@01e1e5c2 [build] (log)
[I2024-11-17T14:08:36.822623-08:00 3979 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T14:08:36.822856-08:00 3979 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T14:08:36.828181-08:00 3979 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T14:08:36.829586-08:00 3979 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.221s
ok  	archive/zip	0.493s
ok  	bufio	0.093s
ok  	bytes	0.514s
ok  	cmp	0.021s
ok  	compress/bzip2	0.118s
...
[W2024-11-17T14:33:19.677230-08:00 3979 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T14:33:19.677578-08:00 3979 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T14:33:19.677809-08:00 3979 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T14:33:19.677934-08:00 3979 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T14:33:19.677955-08:00 3979 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T14:33:19.678006-08:00 3979 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T14:33:19.678019-08:00 3979 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T14:33:19.678069-08:00 3979 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T14:33:19.678138-08:00 3979 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T14:33:19.678457-08:00 3979 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-17 21:09 gotip-darwin-arm64_13 go@01e1e5c2 [build] (log)
[I2024-11-17T13:21:24.298636-08:00 43576 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T13:21:24.298682-08:00 43576 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T13:21:24.299345-08:00 43576 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T13:21:24.299530-08:00 43576 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.182s
ok  	archive/zip	0.584s
ok  	bufio	0.194s
ok  	bytes	0.386s
ok  	cmp	0.244s
ok  	compress/bzip2	0.226s
...
[W2024-11-17T13:26:08.998270-08:00 43576 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T13:26:08.998287-08:00 43576 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T13:26:08.998418-08:00 43576 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T13:26:08.998451-08:00 43576 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T13:26:08.998457-08:00 43576 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T13:26:08.998466-08:00 43576 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T13:26:08.998471-08:00 43576 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T13:26:08.998510-08:00 43576 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T13:26:08.998524-08:00 43576 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T13:26:08.998540-08:00 43576 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:08 gotip-darwin-amd64_13 go@d1180dbd [build] (log)
[I2024-11-17T18:12:26.032764-08:00 49996 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:12:26.032829-08:00 49996 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:12:26.033983-08:00 49996 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:12:26.034915-08:00 49996 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.414s
ok  	archive/zip	1.035s
ok  	bufio	0.552s
ok  	bytes	0.891s
ok  	cmp	1.128s
ok  	compress/bzip2	0.953s
...
[W2024-11-17T18:22:41.546686-08:00 49996 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:22:41.546737-08:00 49996 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:22:41.547011-08:00 49996 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:22:41.547084-08:00 49996 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:22:41.547103-08:00 49996 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:22:41.547127-08:00 49996 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:22:41.547137-08:00 49996 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:22:41.547187-08:00 49996 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:22:41.547251-08:00 49996 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:22:41.547284-08:00 49996 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:08 gotip-darwin-arm64_13 go@d1180dbd [build] (log)
[I2024-11-17T18:14:11.633105-08:00 50979 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:14:11.633153-08:00 50979 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:14:11.634028-08:00 50979 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:14:11.634289-08:00 50979 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.333s
ok  	archive/zip	0.215s
ok  	bufio	0.198s
ok  	bytes	0.426s
ok  	cmp	0.404s
ok  	compress/bzip2	0.391s
...
[W2024-11-17T18:19:21.277265-08:00 50979 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:19:21.277279-08:00 50979 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:19:21.277395-08:00 50979 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:19:21.277420-08:00 50979 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:19:21.277426-08:00 50979 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:19:21.277436-08:00 50979 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:19:21.277441-08:00 50979 0 sink_server.go:100] SinkServer: draining Art
(... long comment truncated ...)

watchflakes

@aclements
Copy link
Member

Looking closely at https://ci.chromium.org/ui/p/golang/builders/ci/gotip-darwin-amd64_13/b8730968502183490337/overview

I think what's going on is that we have this one new line in the middle of the go tool dist test -json output:

{"ImportPath":"crypto/internal/fips/check.test","Action":"build-output","Output":"# crypto/internal/fips/check.test\nld: warning: no platform load command found in '/Users/swarming/.swarming/w/ir/x/t/go-link-2453470639/go.o', assuming: macOS\n"}

And this new "build-output" action is confusing the LUCI test reader:

ok  	cmd/internal/testdir	59.254s
Warning: no '=' in invocation-link-artifacts pair: "", ignoring
[W2024-11-17T18:52:14.923249-08:00 28844 0 sink_server.go:178] Test result for "" is invalid: test_id: unspecified
[W2024-11-17T18:52:14.923452-08:00 28844 0 encoding.go:224] prpc: responding with InvalidArgument error (HTTP 400): test_results[34909]: test_id: unspecified
RPC failed permanently: rpc error: code = InvalidArgument desc = test_results[34909]: test_id: unspecified {"host":"localhost:51281", "method":"ReportTestResults", "service":"luci.resultsink.v1.Sink"}
result_adapter: rpc error: code = InvalidArgument desc = test_results[34909]: test_id: unspecified

Prior to this change (example), the dist JSON output just had text embedded in it:

# crypto/internal/fips/check.test
ld: warning: no platform load command found in '/Users/swarming/.swarming/w/ir/x/t/go-link-2718337584/go.o', assuming: macOS

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "darwin" && repo == "go" && mode == "build"
2024-11-18 02:08 gotip-darwin-amd64-nocgo go@d1180dbd [build] (log)
[I2024-11-17T18:25:29.119611-08:00 77077 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:25:29.119694-08:00 77077 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:25:29.122118-08:00 77077 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:25:29.122463-08:00 77077 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.171s
ok  	archive/zip	0.545s
ok  	bufio	0.084s
ok  	bytes	0.556s
ok  	cmp	0.026s
ok  	compress/bzip2	0.116s
...
[W2024-11-17T18:46:23.306620-08:00 77077 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:46:23.306837-08:00 77077 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:46:23.307089-08:00 77077 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:46:23.307239-08:00 77077 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:46:23.307257-08:00 77077 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:46:23.307311-08:00 77077 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:46:23.307324-08:00 77077 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:46:23.307366-08:00 77077 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:46:23.307414-08:00 77077 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:46:23.307483-08:00 77077 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:08 gotip-darwin-amd64_14 go@d1180dbd [build] (log)
[I2024-11-17T18:26:24.382254-08:00 71453 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:26:24.382607-08:00 71453 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:26:24.386941-08:00 71453 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:26:24.388529-08:00 71453 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.185s
ok  	archive/zip	0.733s
ok  	bufio	0.070s
ok  	bytes	0.446s
ok  	cmp	0.022s
ok  	compress/bzip2	0.104s
...
[W2024-11-17T18:51:32.606049-08:00 71453 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:51:32.606228-08:00 71453 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:51:32.606460-08:00 71453 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:51:32.606587-08:00 71453 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:51:32.606605-08:00 71453 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:51:32.606654-08:00 71453 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:51:32.606666-08:00 71453 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:51:32.606712-08:00 71453 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:51:32.606852-08:00 71453 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:51:32.607098-08:00 71453 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:09 gotip-darwin-amd64-nocgo go@90b1dc01 [build] (log)
[I2024-11-17T19:18:48.186410-08:00 6744 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T19:18:48.186459-08:00 6744 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T19:18:48.190415-08:00 6744 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T19:18:48.190887-08:00 6744 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.174s
ok  	archive/zip	0.371s
ok  	bufio	0.076s
ok  	bytes	0.429s
ok  	cmp	0.024s
ok  	compress/bzip2	0.112s
...
[W2024-11-17T19:37:32.118020-08:00 6744 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T19:37:32.118119-08:00 6744 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T19:37:32.118303-08:00 6744 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T19:37:32.118396-08:00 6744 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T19:37:32.118417-08:00 6744 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T19:37:32.118445-08:00 6744 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T19:37:32.118457-08:00 6744 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T19:37:32.118511-08:00 6744 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T19:37:32.118540-08:00 6744 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T19:37:32.118581-08:00 6744 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:09 gotip-darwin-amd64_13 go@90b1dc01 [build] (log)
[I2024-11-17T18:27:16.320811-08:00 28844 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:27:16.320894-08:00 28844 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:27:16.326515-08:00 28844 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:27:16.326951-08:00 28844 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.372s
ok  	archive/zip	0.523s
ok  	bufio	0.111s
ok  	bytes	0.464s
ok  	cmp	0.022s
ok  	compress/bzip2	0.096s
...
[W2024-11-17T18:52:14.934991-08:00 28844 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:52:14.935147-08:00 28844 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:52:14.935355-08:00 28844 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:52:14.935479-08:00 28844 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:52:14.935497-08:00 28844 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:52:14.935557-08:00 28844 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:52:14.935573-08:00 28844 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:52:14.935645-08:00 28844 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:52:14.935736-08:00 28844 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:52:14.936119-08:00 28844 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:09 gotip-darwin-arm64_13 go@90b1dc01 [build] (log)
[I2024-11-17T18:33:50.435613-08:00 46482 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:33:50.435664-08:00 46482 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:33:50.436748-08:00 46482 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:33:50.436946-08:00 46482 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Volumes/Work/s/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Volumes/Work/s/w/ir/x/w/dist.testjson" "--" "/Volumes/Work/s/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.195s
ok  	archive/zip	0.292s
ok  	bufio	0.250s
ok  	bytes	0.241s
ok  	cmp	0.157s
ok  	compress/bzip2	0.257s
...
[W2024-11-17T18:38:35.324510-08:00 46482 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T18:38:35.324533-08:00 46482 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T18:38:35.324648-08:00 46482 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T18:38:35.324674-08:00 46482 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T18:38:35.324680-08:00 46482 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T18:38:35.324689-08:00 46482 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T18:38:35.324694-08:00 46482 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T18:38:35.324716-08:00 46482 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T18:38:35.324735-08:00 46482 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T18:38:35.324747-08:00 46482 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@aclements
Copy link
Member

cc @mknyszek @dmitshur for LUCI test processing issue.

@gopherbot
Copy link
Contributor Author

Change https://go.dev/cl/628955 mentions this issue: cmd/go: temporarily disable build JSON in test output

@aclements
Copy link
Member

Marking as a release blocker because we either need to re-enable build JSON from go test (rolling back https://go.dev/cl/628955) or we need to fix the documentation and release notes to not claim that go test -json emit build errors in JSON (which would be unfortunate).

@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "darwin" && repo == "go" && mode == "build"
2024-11-18 02:09 gotip-darwin-amd64-longtest go@90b1dc01 [build] (log)
[I2024-11-17T18:56:45.458409-08:00 1595 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T18:56:45.458641-08:00 1595 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T18:56:45.461728-08:00 1595 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T18:56:45.462126-08:00 1595 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.187s
ok  	archive/zip	31.850s
ok  	bufio	0.075s
ok  	bytes	2.361s
ok  	cmp	0.022s
ok  	compress/bzip2	0.108s
...
[W2024-11-17T20:07:02.894588-08:00 1595 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T20:07:02.894795-08:00 1595 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T20:07:02.911732-08:00 1595 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T20:07:02.911993-08:00 1595 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T20:07:02.912016-08:00 1595 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T20:07:02.912068-08:00 1595 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T20:07:02.912091-08:00 1595 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T20:07:02.912127-08:00 1595 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T20:07:02.912149-08:00 1595 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T20:07:02.912195-08:00 1595 0 cmd_stream.go:420] rdb-stream: exiting with 123
2024-11-18 02:09 gotip-darwin-amd64_14 go@90b1dc01 [build] (log)
[I2024-11-17T19:18:49.352497-08:00 36108 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T19:18:49.352654-08:00 36108 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T19:18:49.355761-08:00 36108 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T19:18:49.356112-08:00 36108 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.230s
ok  	archive/zip	0.454s
ok  	bufio	0.073s
ok  	bytes	0.498s
ok  	cmp	0.025s
ok  	compress/bzip2	0.115s
...
[W2024-11-17T19:45:01.311105-08:00 36108 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T19:45:01.311182-08:00 36108 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T19:45:01.311375-08:00 36108 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T19:45:01.311468-08:00 36108 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T19:45:01.311486-08:00 36108 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T19:45:01.311513-08:00 36108 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T19:45:01.311525-08:00 36108 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T19:45:01.311583-08:00 36108 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T19:45:01.311615-08:00 36108 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T19:45:01.311648-08:00 36108 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

gopherbot pushed a commit that referenced this issue Nov 18, 2024
Unfortunately, this is tripping up the LUCI test output processor, so
we need to disable it until we can figure that out.

For #70402.
Updates #62067.

Cq-Include-Trybots: luci.golang.try:gotip-darwin-arm64_13,gotip-linux-amd64-longtest
Change-Id: I9ae722218e98b8060b8b4c46358f23381ac8537a
Reviewed-on: https://go-review.googlesource.com/c/go/+/628955
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Cherry Mui <cherryyz@google.com>
@gopherbot
Copy link
Contributor Author

Found new dashboard test flakes for:

#!watchflakes
default <- goos == "darwin" && repo == "go" && mode == "build"
2024-11-18 02:08 gotip-darwin-amd64-longtest go@d1180dbd [build] (log)
[I2024-11-17T20:08:35.423965-08:00 29625 0 sink.go:277] SinkServer: warm-up started
[I2024-11-17T20:08:35.424156-08:00 29625 0 sink.go:350] SinkServer: starting HTTP server...
[I2024-11-17T20:08:35.428955-08:00 29625 0 sink.go:282] SinkServer: warm-up ended
[I2024-11-17T20:08:35.429420-08:00 29625 0 cmd_stream.go:492] rdb-stream: starting the test command - ["/Users/swarming/.swarming/w/ir/cache/tools/bin/result_adapter" "go" "-v=false" "-dump-json" "/Users/swarming/.swarming/w/ir/x/w/dist.testjson" "--" "/Users/swarming/.swarming/w/ir/x/w/goroot/bin/go" "tool" "dist" "test" "-json"]
ok  	archive/tar	0.300s
ok  	archive/zip	38.610s
ok  	bufio	0.126s
ok  	bytes	2.954s
ok  	cmp	0.029s
ok  	compress/bzip2	0.114s
...
[W2024-11-17T21:36:01.509613-08:00 29625 0 cmd_stream.go:504] rdb-stream: test process exited with error: exit status 123
[I2024-11-17T21:36:01.509733-08:00 29625 0 cmd_stream.go:488] rdb-stream: the test process terminated
[I2024-11-17T21:36:01.509972-08:00 29625 0 sink.go:375] SinkServer: shutdown started
[I2024-11-17T21:36:01.510075-08:00 29625 0 sink.go:353] SinkServer: HTTP server stopped with "http: Server closed"
[I2024-11-17T21:36:01.510096-08:00 29625 0 sink_server.go:96] SinkServer: draining TestResult channel started
[I2024-11-17T21:36:01.510124-08:00 29625 0 sink_server.go:98] SinkServer: draining TestResult channel ended
[I2024-11-17T21:36:01.510136-08:00 29625 0 sink_server.go:100] SinkServer: draining Artifact channel started
[I2024-11-17T21:36:01.510215-08:00 29625 0 sink_server.go:102] SinkServer: draining Artifact channel ended
[I2024-11-17T21:36:01.510249-08:00 29625 0 sink.go:378] SinkServer: shutdown completed successfully
[I2024-11-17T21:36:01.510283-08:00 29625 0 cmd_stream.go:420] rdb-stream: exiting with 123

watchflakes

@dmitshur dmitshur self-assigned this Nov 18, 2024
@dmitshur dmitshur added this to the Go1.24 milestone Nov 18, 2024
@dmitshur dmitshur moved this to In Progress in Go Release Nov 18, 2024
@dmitshur
Copy link
Contributor

dmitshur commented Nov 18, 2024

Updating this with some details that I'm seeing so far.

The Test result for "" is invalid: test_id: unspecified error happens because the ResultDB system that stores individual test results requires each one to have an ID. That ID is a string with some validation done, and in particular it cannot be the empty string.

For TestEvent objects, the test ID was constructed from the Package and Test fields. The new BuildEvent objects populate the ImportPath field instead of a Package field, and so they end up having an empty ID associated, which get rejected by the server. The fix for this particular problem should be, when the Package field is empty, to consider the new ImportPath field and use it to generate the ID.

As @mknyszek pointed out, result_adapter already intends to ignore unknown actions, so those might not need any special handling to get the baseline behavior back. I'll look more into that after handling the test IDs.

@gopherbot
Copy link
Contributor Author

Change https://go.dev/cl/629335 mentions this issue: cmd/go: re-enable build JSON from go test -json, now with GODEBUG

@aclements
Copy link
Member

The fix for this particular problem should be, when the Package field is empty, to consider the new ImportPath field and use it to generate the ID.

I'm not sure if that's the right fix. The ImportPath is really there to be matched up with the FailedBuild field from a test event. So I would expect it to get attached to one (or more) tests, and use those test's Package fields. Unless ResultDB has some way to connect the ID of the failed test result to a separate ID of the build failure that caused it.

If a build event never matches up with a test, then it might make sense to construct a result for it independently using the ImportPath.

@gopherbot
Copy link
Contributor Author

Change https://go.dev/cl/629375 mentions this issue: main.star: set gotestjsonbuildtext=1 globally at tip

gopherbot pushed a commit to golang/build that referenced this issue Nov 18, 2024
Two reasons: to buy more time to work on the result_adapter/ResultDB
side (beyond just the bare minimum behavior of not regressing beyond
what we had before), and to test that using a GODEBUG for this works
as we expect. It already uncovered the need to merge multiple GODEBUG
settings that we hadn't run into earlier.

For golang/go#70402.

Change-Id: I9b86f6a5462637eef84f3efca9fc31d11657d756
Reviewed-on: https://go-review.googlesource.com/c/build/+/629375
Auto-Submit: Dmitri Shuralyov <dmitshur@golang.org>
LUCI-TryBot-Result: Go LUCI <golang-scoped@luci-project-accounts.iam.gserviceaccount.com>
Reviewed-by: Dmitri Shuralyov <dmitshur@google.com>
Reviewed-by: Michael Knyszek <mknyszek@google.com>
@dmitshur
Copy link
Contributor

dmitshur commented Nov 19, 2024

Updated plan, which takes into account https://pkg.go.dev/cmd/go@master#hdr-Build__json_encoding and #70402 (comment), is to determine that a given JSON object is a BuildEvent rather than a TestEvent by checking its Action field and seeing a "build-" prefix, and then attach the build output to the test record corresponding to the package.

Out of the options currently available at https://pkg.go.dev/go.chromium.org/luci/resultdb/proto/v1#TestStatus, TestStatus_FAIL will do. So the main observable difference will be that the package build error output will be attached to the package's test record, instead of only being visible in the non-structured output.

I have a working prototype of that, need to clean it up a bit before mailing to handle edge cases.

Edit: Filed #70435 to track the LUCI side of this work.

@github-project-automation github-project-automation bot moved this from In Progress to Done in Go Release Nov 19, 2024
@dmitshur dmitshur added NeedsFix The path to resolution is known, but the work has not been done. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NeedsFix The path to resolution is known, but the work has not been done. release-blocker
Projects
Status: Done
Status: Done
Development

No branches or pull requests

4 participants