Skip to content

all: plan9-arm builder failing frequently with a variety of errors #49338

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
bcmills opened this issue Nov 4, 2021 · 1,205 comments
Open

all: plan9-arm builder failing frequently with a variety of errors #49338

bcmills opened this issue Nov 4, 2021 · 1,205 comments
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Milestone
Unplanned

Comments

@bcmills
Copy link
Contributor

bcmills commented Nov 4, 2021 •
edited by cherrymui
Loading 

#!watchflakes
post <- builder ~ `plan9-arm`

The one remaining plan9 builder is failing a significant fraction of build attempts.
Many of the failures follow specific known patterns (notably #49337, #46526, and #41952). However, many do not.

@millerresearch, @0intro, @fhs: is there someone who can investigate these failures and bring the plan9 port back up to par? With the 0intro builders missing (#49327, #49328), there is no longer any plan9 builder consistently passing tests.

greplogs --dashboard -md -l -e \\Aplan9. -E . --since=2021-10-01

2021-11-04T01:44:54-d9bb5f6/plan9-arm
2021-11-03T23:48:28-283373d/plan9-arm
2021-11-03T21:45:33-4a4e1f2-d3f5dd5/plan9-arm
2021-11-03T21:45:33-2c98350-d3f5dd5/plan9-arm
2021-11-03T19:32:33-74f99d0/plan9-arm
2021-11-03T18:37:22-cfd016d/plan9-arm
2021-11-03T15:59:11-5f0e5d2/plan9-arm
2021-11-03T09:23:34-6458b2e/plan9-arm
2021-11-03T05:00:00-519c0a2/plan9-arm
2021-11-03T00:49:50-a4b2c57/plan9-arm
2021-11-03T00:21:24-8f0ca7d/plan9-arm
2021-11-03T00:07:38-49a0063/plan9-arm
2021-11-03T00:06:52-32d2752/plan9-arm
2021-11-02T23:44:58-a0f373c/plan9-arm
2021-11-02T23:05:17-714668c-eb63cbd/plan9-arm
2021-11-02T21:18:39-60fd3ed/plan9-arm
2021-11-02T20:59:34-79024cf/plan9-arm
2021-11-02T19:56:02-c45c32b/plan9-arm
2021-11-02T19:37:42-1011e26/plan9-arm
2021-11-02T18:35:29-433ba58/plan9-arm
2021-11-02T18:35:22-0b37bd9/plan9-arm
2021-11-02T18:31:53-79c5240/plan9-arm
2021-11-02T18:24:18-f7a95d2/plan9-arm
2021-11-02T15:33:01-4d06874-da7173a/plan9-arm
2021-11-02T13:43:24-ee08195-4d7bf41/plan9-arm
2021-11-02T13:43:24-4ff95d6-4d7bf41/plan9-arm
2021-11-02T06:25:39-4ff95d6-088bb4b/plan9-arm
2021-11-02T06:21:44-3ee426a/plan9-arm
2021-11-02T06:20:21-c1ea339/plan9-arm
2021-11-02T06:19:33-4633b2d/plan9-arm
2021-11-02T05:35:11-6f327f7/plan9-arm
2021-11-02T03:55:19-4ff95d6-6f1e9a9/plan9-arm
2021-11-02T03:54:24-3c61cb3/plan9-arm
2021-11-02T03:53:56-b0472aa/plan9-arm
2021-11-02T03:52:33-9268565/plan9-arm
2021-11-01T22:55:50-02e5913/plan9-arm
2021-11-01T19:42:30-4ff95d6-5f1bcd1/plan9-arm
2021-11-01T18:53:06-b5a5b7b/plan9-arm
2021-11-01T16:31:02-03971e3-2bcf1c0/plan9-arm
2021-11-01T15:55:25-e2e910e/plan9-arm
2021-11-01T15:55:20-d2b5121/plan9-arm
2021-11-01T14:45:28-82f902a/plan9-arm
2021-11-01T13:12:37-4056934/plan9-arm
2021-11-01T13:08:16-732db40/plan9-arm
2021-11-01T02:47:30-fde4cc2/plan9-arm
2021-10-31T18:39:05-89c5270/plan9-arm
2021-10-31T18:13:09-fd09e88/plan9-arm
2021-10-31T17:52:41-3fa9ee4/plan9-arm
2021-10-30T18:30:34-6113dac/plan9-arm
2021-10-30T16:46:47-d1dceaf/plan9-arm
2021-10-30T12:32:06-351c04c-5d6d9f5/plan9-arm
2021-10-29T23:25:18-5d6d9f5/plan9-arm
2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-29T22:27:26-3571ab5/plan9-arm
2021-10-29T19:35:47-5ec139f/plan9-arm
2021-10-29T18:56:29-6afdf01/plan9-arm
2021-10-29T18:35:29-9da6415/plan9-arm
2021-10-29T18:23:03-413672f/plan9-arm
2021-10-29T17:44:52-353d5b6/plan9-arm
2021-10-29T04:21:07-103d89b-f288526/plan9-arm
2021-10-29T02:16:47-2c7cdec/plan9-arm
2021-10-29T02:11:42-33c392f/plan9-arm
2021-10-29T00:04:41-d6a9af8-af05d8b/plan9-arm
2021-10-28T20:50:34-d0751b1/plan9-arm
2021-10-28T20:50:34-103d89b-d0751b1/plan9-arm
2021-10-28T20:43:39-b954024/plan9-arm
2021-10-28T20:43:02-e741e2f/plan9-arm
2021-10-28T18:48:25-e7eb6f6-f229e70/plan9-arm
2021-10-28T18:10:59-ed475fe/plan9-arm
2021-10-28T18:10:50-2bc8ed8/plan9-arm
2021-10-28T17:57:57-2666262/plan9-arm
2021-10-28T17:52:59-3124968/plan9-arm
2021-10-28T02:35:22-056dfe6/plan9-arm
2021-10-28T01:15:26-b2fe2eb/plan9-arm
2021-10-28T00:11:24-a91d0b6/plan9-arm
2021-10-27T22:17:35-79ff663/plan9-arm
2021-10-27T21:37:54-749f6e9/plan9-arm
2021-10-27T21:35:48-a3c4ac0/plan9-arm
2021-10-27T21:34:20-4fefd43/plan9-arm
2021-10-27T20:25:06-bbc0595/plan9-arm
2021-10-27T20:24:34-56dcf97/plan9-arm
2021-10-27T20:03:17-68bd512/plan9-arm
2021-10-27T19:34:49-ffd2284/plan9-arm
2021-10-27T19:18:20-514ebae/plan9-arm
2021-10-27T18:24:50-259735f/plan9-amd64-0intro
2021-10-27T18:24:50-259735f/plan9-arm
2021-10-27T16:59:43-c0ac39c/plan9-arm
2021-10-27T13:12:49-cfb5321/plan9-arm
2021-10-27T08:50:27-e1e2965-bdefb77/plan9-arm
2021-10-27T08:50:27-bdefb77/plan9-arm
2021-10-26T23:12:17-13eccaa/plan9-arm
2021-10-26T22:05:53-80be4a4/plan9-386-0intro
2021-10-26T19:04:53-9626607-1dc77a3/plan9-arm
2021-10-26T19:04:53-03971e3-1dc77a3/plan9-arm
2021-10-26T18:33:39-244f92e-76cef81/plan9-386-0intro
2021-10-26T17:10:45-d418f37-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-amd64-0intro
2021-10-26T16:00:26-94870a3-1b2362b/plan9-arm
2021-10-26T14:05:47-a2b8c18/plan9-arm
2021-10-26T11:58:05-1e2820a/plan9-arm
2021-10-26T05:05:24-23fdd7f/plan9-arm
2021-10-26T01:22:47-f916b54-adfb85b/plan9-arm
2021-10-26T01:22:47-22652b4-adfb85b/plan9-arm
2021-10-26T01:07:41-41f7407/plan9-arm
2021-10-25T23:28:03-f916b54-e9eb66d/plan9-arm
2021-10-25T23:28:03-e9eb66d/plan9-arm
2021-10-25T21:03:33-60c3069/plan9-arm
2021-10-25T18:46:45-f47335e/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-25T16:07:11-fc8b4ca-c6e82e5/plan9-arm
2021-10-23T20:23:35-c96bc14-8dbf3e9/plan9-386-0intro
2021-10-23T20:23:35-8dbf3e9/plan9-arm
2021-10-23T16:18:19-d418f37-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-affba50-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-16318df/plan9-arm
2021-10-23T16:18:15-12e4404/plan9-arm
2021-10-23T16:18:09-c526cf8/plan9-arm
2021-10-23T16:18:04-2d205eb/plan9-arm
2021-10-23T16:17:58-3cd28ba/plan9-arm
2021-10-23T12:44:47-b0f7eb6/plan9-arm
2021-10-22T21:48:34-ae4d67c/plan9-arm
2021-10-22T21:12:07-76dd01f/plan9-arm
2021-10-22T14:05:31-ff8115d/plan9-arm
2021-10-21T17:31:42-392bb06/plan9-arm
2021-10-21T17:23:58-02a3666/plan9-arm
2021-10-21T13:05:07-8b9c0d1/plan9-arm
2021-10-21T02:35:47-9b675d0-fca46d0/plan9-arm
2021-10-20T20:39:19-d419a80/plan9-arm
2021-10-20T20:38:59-75b73d6/plan9-arm
2021-10-20T20:38:47-3ec8d4b/plan9-arm
2021-10-20T19:30:13-cbf1d01-3ff39c5/plan9-arm
2021-10-20T19:30:13-3ff39c5/plan9-arm
2021-10-20T19:29:12-4320949/plan9-arm
2021-10-20T18:48:51-cbf1d01-4e565f7/plan9-arm
2021-10-20T05:28:45-b091189/plan9-arm
2021-10-19T23:27:41-4ea6123-2be5b84/plan9-arm
2021-10-19T22:47:35-9fa8551/plan9-arm
2021-10-19T18:56:08-07e5527/plan9-arm
2021-10-19T18:43:12-d944984/plan9-arm
2021-10-19T18:43:08-1d63052/plan9-arm
2021-10-19T18:22:59-6c3cd5d/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-19T17:12:53-404f84d/plan9-arm
2021-10-19T17:01:42-3a07ab7/plan9-arm
2021-10-19T16:19:27-98f6e03-f92a358/plan9-arm
2021-10-19T08:44:22-1e49210/plan9-arm
2021-10-19T07:45:46-281050f-ee92daa/plan9-arm
2021-10-18T22:56:07-eba0e86/plan9-arm
2021-10-18T22:55:05-7397178/plan9-arm
2021-10-18T19:46:27-98f6e03-394a1ad/plan9-arm
2021-10-18T16:32:38-543a513/plan9-arm
2021-10-18T15:38:40-74acbaf/plan9-arm
2021-10-16T16:27:40-c96bc14-640a49b/plan9-386-0intro
2021-10-16T16:27:40-98f6e03-640a49b/plan9-arm
2021-10-16T16:27:40-640a49b/plan9-arm
2021-10-16T16:27:40-4f30a5c-640a49b/plan9-386-0intro
2021-10-16T14:50:21-c96bc14-680caf1/plan9-386-0intro
2021-10-16T14:50:21-98f6e03-680caf1/plan9-386-0intro
2021-10-16T14:50:21-4f30a5c-680caf1/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-c96bc14-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-4f30a5c-ed1c8db/plan9-amd64-0intro
2021-10-15T21:44:07-4a7975e/plan9-386-0intro
2021-10-15T20:29:48-85cbdda/plan9-arm
2021-10-15T20:29:36-a17b2e8/plan9-386-0intro
2021-10-15T19:54:44-22951fb/plan9-arm
2021-10-15T19:03:33-98f6e03-cfe6763/plan9-arm
2021-10-15T18:07:49-98f6e03-8331f25/plan9-arm
2021-10-15T02:45:22-288d0b3-3da0ff8/plan9-arm
2021-10-15T02:02:50-ce04ca3-3da0ff8/plan9-arm
2021-10-15T02:02:50-3da0ff8/plan9-386-0intro
2021-10-15T00:16:20-ce04ca3-9e8ed86/plan9-arm
2021-10-14T23:32:09-3a269dc-9e8ed86/plan9-arm
2021-10-14T22:15:24-281050f-b59467e/plan9-arm
2021-10-14T18:44:37-a37bebc/plan9-arm
2021-10-14T18:44:29-a8c5a99/plan9-arm
2021-10-14T15:17:03-fbdf830/plan9-arm
2021-10-14T13:09:28-88e80df-24e798e/plan9-arm
2021-10-14T13:09:28-24e798e/plan9-arm
2021-10-14T12:38:31-88e80df-2feb2cc/plan9-arm
2021-10-14T07:18:59-1349c6e/plan9-arm
2021-10-14T04:18:44-acac939-9e4dc6f/plan9-arm
2021-10-14T01:51:22-276fb27/plan9-arm
2021-10-13T22:21:08-ac2ed98-b90d258/plan9-arm
2021-10-13T20:31:25-b90d258/plan9-arm
2021-10-13T18:15:48-40f82f8/plan9-amd64-0intro
2021-10-13T18:15:48-40f82f8/plan9-arm
2021-10-13T18:15:48-281050f-40f82f8/plan9-arm
2021-10-13T17:02:43-b5904f3/plan9-arm
2021-10-13T16:39:23-3986e5c/plan9-arm
2021-10-13T16:36:59-69041c7/plan9-arm
2021-10-13T15:11:16-0454d73/plan9-arm
2021-10-13T03:12:54-24389d4-4fb2e1c/plan9-arm
2021-10-12T22:02:39-732f6fa/plan9-arm
2021-10-12T21:30:45-0b930fb-3283d1a/plan9-arm
2021-10-12T21:15:50-3d051ba/plan9-arm
2021-10-12T20:53:52-ac6d706/plan9-arm
2021-10-12T20:20:41-d032b2b/plan9-arm
2021-10-12T18:30:24-281050f-6e0adde/plan9-arm
2021-10-12T12:24:09-c8768b9-4679670/plan9-arm
2021-10-12T06:55:50-c83725b-d887d3b/plan9-arm
2021-10-11T20:46:14-7023535/plan9-arm
2021-10-11T20:46:14-18fa840-7023535/plan9-arm
2021-10-11T19:20:12-18fa840-65ffee6/plan9-arm
2021-10-11T15:48:29-2478b6f/plan9-arm
2021-10-11T12:53:11-3b03d30-34f7b1f/plan9-386-0intro
2021-10-11T12:53:11-34f7b1f/plan9-arm
2021-10-11T12:42:06-59b2f51/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-d2d21d9/plan9-amd64-0intro
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-10T15:11:26-3b03d30-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-1af23bd-d2d21d9/plan9-386-0intro
2021-10-10T13:37:52-1af23bd-b99abf3/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-386-0intro
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-08T22:21:41-ee04797-74abcab/plan9-arm
2021-10-08T19:41:16-c5188f2-7fcf9a1/plan9-arm
2021-10-08T19:41:16-7fcf9a1/plan9-386-0intro
2021-10-08T19:30:58-f430bda/plan9-arm
2021-10-08T19:19:09-b9e1e1b/plan9-386-0intro
2021-10-08T18:07:25-d480b5c/plan9-386-0intro
2021-10-08T17:58:41-16a3cef/plan9-arm
2021-10-08T17:32:31-d7ba1d2/plan9-386-0intro
2021-10-08T17:32:25-a7d3a0e/plan9-arm
2021-10-08T15:27:20-b3a4b2d/plan9-arm
2021-10-08T14:08:12-5b9206f/plan9-386-0intro
2021-10-08T14:08:12-5b9206f/plan9-arm
2021-10-07T22:19:58-1ceb723/plan9-arm
2021-10-07T21:39:17-6b4cf2b/plan9-arm
2021-10-07T20:37:43-d477ef3-ef2ebbe/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-07T18:58:33-7286502/plan9-arm
2021-10-07T18:09:53-4607ebc/plan9-arm
2021-10-07T16:38:24-be571a3/plan9-arm
2021-10-07T14:37:45-ebeab63/plan9-arm
2021-10-07T14:37:36-375a1fb/plan9-arm
2021-10-07T02:30:47-2c98350-39bbf08/plan9-arm
2021-10-06T23:26:57-c8dd89e/plan9-arm
2021-10-06T23:26:57-86761ae-c8dd89e/plan9-arm
2021-10-06T21:17:08-2e107b4/plan9-arm
2021-10-06T21:06:48-197b328/plan9-arm
2021-10-06T15:53:04-4d8db00/plan9-arm
2021-10-05T23:58:29-ac60900/plan9-arm
2021-10-05T23:36:43-e82ed0c/plan9-arm
2021-10-05T22:42:11-96fface/plan9-arm
2021-10-05T20:52:58-0d6561b/plan9-arm
2021-10-05T20:35:54-990c9c6/plan9-arm
2021-10-05T19:15:03-ae83301/plan9-arm
2021-10-05T18:31:14-5d946f1/plan9-arm
2021-10-05T17:10:45-2dc2755-5140ad1/plan9-arm
2021-10-05T15:47:57-017ffcd/plan9-arm
2021-10-05T15:47:07-cfd74f7/plan9-arm
2021-10-05T01:30:56-d4b1ae0-123393a/plan9-386-0intro
2021-10-04T22:59:44-78c2529/plan9-arm
2021-10-04T22:59:13-199ec42/plan9-arm
2021-10-04T22:54:58-7c79e8e/plan9-arm
2021-10-04T22:00:53-d9952ff/plan9-386-0intro
2021-10-04T22:00:19-739328c/plan9-arm
2021-10-04T21:10:16-db89b5a-f0db7ea/plan9-arm
2021-10-04T18:15:09-ccaa907-9f8d558/plan9-arm
2021-10-04T17:17:11-cedda3a-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-ccaa907-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-cc5e3de/plan9-amd64-0intro
2021-10-04T15:50:43-9432320/plan9-386-0intro
2021-10-04T15:50:43-9432320/plan9-amd64-0intro
2021-10-02T16:05:55-0ebff1a-a7fe161/plan9-arm
2021-10-02T13:15:42-0ebff1a-7bf7bbc/plan9-arm
2021-10-01T23:51:16-c129af9/plan9-arm
2021-10-01T21:26:43-0ebff1a-0d65c27/plan9-arm
2021-10-01T19:30:53-13c407c-0d65c27/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-10-01T17:18:20-5279e53/plan9-arm
2021-10-01T16:45:09-58ad7eb-f19b2d5/plan9-arm
2021-10-01T16:17:08-f19b2d5/plan9-arm
2021-10-01T16:01:09-558b9da-8d494b0/plan9-arm
2021-10-01T15:59:38-e5ad363/plan9-arm
2021-10-01T14:06:36-96d3ba8/plan9-arm
@bcmills bcmills added OS-Plan9 NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 4, 2021
@millerresearch
Copy link
Contributor

For most of plan9-arm failures, the cause is filesystem flakiness on the builder machines (a cluster of 3 x raspberry pi 4). I've just reconfigured the build script to stop using ramfs (which has a locking bug) for /tmp, and stop using the ad hoc directory cache (which still seems to have some flaws). This should bypass most of the failures but will make the test suite a lot slower to run (by go.17 it had already regressed to about 2 hours even with these filesystem tweaks).

There are some other flakes of the "shouldn't be possible" variety, which are are rare and perplexing and impossible to replicate. They are occurring in general go runtime code, not specific to plan 9. There's a slight whiff of possible memory cache coherence trouble in some of these:
marked free object in span
attempt to clean non-empty span set
unexpected waitm - semaphore out of sync
runtime: cannot allocate memory
not inlined: unknown reason

It would be good to have a server-class ARM platform capable of running plan 9 as a more reliable builder. I don't know of one.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 10, 2021

Looks like the filesystem change did resolve at least one class of failure: the '/boot/workdir/go/src/os' does not exit failure mode hasn't occurred at all in November so far.

greplogs --dashboard -md -l -e \''/boot/workdir/go/src/os'\'' does not exist'

2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-09-27T18:58:36-5b90958/plan9-arm
2021-09-21T20:39:31-48cf96c/plan9-arm
2021-09-21T00:59:39-d1fd3eb/plan9-arm
2021-08-28T01:49:50-f371b30/plan9-arm
2021-08-22T22:04:02-5d5e50c/plan9-arm
2021-08-13T21:43:20-a95f1b5/plan9-arm
2021-07-25T17:16:20-849b791/plan9-arm
2021-06-17T03:25:37-b0355a3/plan9-arm
2021-05-25T23:41:42-74242ba/plan9-arm
2021-03-29T20:35:19-164a626/plan9-arm
2021-03-04T06:36:33-868a110/plan9-arm
2021-02-24T19:25:49-bf48163/plan9-arm
2020-10-13T00:31:47-5ef78c4/plan9-arm
2020-10-12T14:44:34-0f53453/plan9-arm
2020-08-18T15:50:52-b58d297/plan9-arm
2020-05-05T19:42:01-0e617d3/plan9-arm

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/362975 mentions this issue: dashboard: omit the website repo on plan9

gopherbot pushed a commit to golang/build that referenced this issue Nov 11, 2021
dashboard: omit the website repo on plan9
d14234e 
The plan9 builders have relatively slow filesystems, and the website
repo is relatively filesystem-intensive — many of its tests walk and
process large trees of website content.

Instead of trying to precisely tune the x/website tests to pass on the
plan9 builders, let's skip this repo on them.

For golang/go#49338.

Change-Id: Ieaf50fb6955a6b39012a23ff72e61c1c31e4ce7c
Reviewed-on: https://go-review.googlesource.com/c/build/+/362975
Trust: Bryan C. Mills <bcmills@google.com>
Run-TryBot: Bryan C. Mills <bcmills@google.com>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Carlos Amedee <carlos@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Nov 17, 2021

Many of the failure modes seem to have cleared up around 11 Nov.; it's not clear to me what fixed them.

One of the failures visible on the dashboard today is #49653; the other is the marked free object in span failure mode.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 19, 2021

A few more failure modes that remain:
#22227 (unexpected signal in os.StartProcess)
#49684 (panic during panic)
#49691 (unexpected stale targets)

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/369018 mentions this issue: src/cmd/go/internal/work: lock Builder output mutex consistently

gopherbot pushed a commit that referenced this issue Dec 6, 2021
@millerresearch
src/cmd/go/internal/work: lock Builder output mutex consistently
765cc72 
To prevent interleaving of output when 'go build' compiles several
packages in parallel, the output mutex in the Builder struct must
be locked around any calls to Builder.Print which could generate
arbitrary amounts of text (ie more than is guaranteed to be written
atomically to a pipe).

Fixes #49987
For #49338

Change-Id: I7947df57667deeff3f03f231824298d823f8a943
Reviewed-on: https://go-review.googlesource.com/c/go/+/369018
Reviewed-by: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Trust: Russ Cox <rsc@golang.org>
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/380414 mentions this issue: message/pipeline: skip TestFullCycle on plan9-arm

gopherbot pushed a commit to golang/text that referenced this issue Jan 24, 2022
message/pipeline: skip TestFullCycle on plan9-arm
d1c84af 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Jan 27, 2022

A sampling from the past week or so. Undiagnosed failures in bold.

greplogs --dashboard -md -l -e \\Aplan9-arm -E . --since=2022-01-20

2022-01-27T05:30:27-be5769c-a991d9d/plan9-arm

panic: test timed out after 10m0s
…
goroutine 6 [select, 9 minutes]:
…
golang.org/x/tools/go/packages.goListDriver(0x1695ab84, {0x175c8c78, 0x1, 0x1})
	/boot/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:200 +0x7b0
…
FAIL	golang.org/x/tools/gopls/doc	600.515s

That's stuck running go list:
https://cs.opensource.google/go/x/tools/+/master:go/packages/golist.go;l=447;drc=eb48d3f608bba06c3bb4f5627f9fc2562cc84dd2

2022-01-27T05:30:27-bbe1937-a991d9d/plan9-arm (#50857)
2022-01-27T05:30:27-aa10faf-a991d9d/plan9-arm (#50857)
2022-01-27T00:03:31-bbe1937-f4aa021/plan9-arm (#50857)
2022-01-26T23:43:39-be5769c-db48840/plan9-arm (probably #46520, not specific to plan9)
2022-01-26T23:43:39-bbe1937-db48840/plan9-arm (#50857)
2022-01-26T22:33:26-ef0b09c/plan9-arm (possibly #22227?)
2022-01-26T22:09:36-bbe1937-ca6a5c0/plan9-arm (#50857)
2022-01-26T21:43:32-be5769c-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T20:51:54-fe74b5f-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T17:58:00-bbe1937-719e989/plan9-arm (#50857)
2022-01-25T22:56:45-c20fd7c-6eb58cd/plan9-arm (#46520, not specific to plan9)
2022-01-25T22:04:10-c20fd7c-38729cf/plan9-arm (#46520, not specific to plan9)
2022-01-25T00:39:08-97de9ec-16d6a52/plan9-arm (#46520, not specific to plan9)
2022-01-24T21:27:20-cdd9e93/plan9-arm

--- FAIL: TestIntendedInlining (15.35s)
    inl_test.go:267: exit status: 'go 32037: 2'
FAIL
FAIL	cmd/compile/internal/test	119.720s

2022-01-24T16:42:11-2cc1836-19d819d/plan9-arm (#50775, mitigated)
2022-01-21T23:16:33-3c751cd-b7fa0f9/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-3c751cd-35b0db7/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-35b0db7/plan9-arm

panic: test timed out after 18m0s
…
goroutine 185 [chan receive, 17 minutes]:
…
os/exec.(*Cmd).CombinedOutput(0x110ae000)
	/boot/workdir/go/src/os/exec/exec.go:567 +0x98 fp=0x11105e2c sp=0x11105e18 pc=0x12b1dc
cmd/compile/internal/test.TestCode(0x10c02f00)
	/boot/workdir/go/src/cmd/compile/internal/test/ssa_test.go:171 +0x9fc fp=0x11105f98 sp=0x11105e2c pc=0x3af55c
…
FAIL	cmd/compile/internal/test	1080.192s

That's running a go test -c subprocess, but without a timeout so we don't get a useful goroutine dump to debug it 😞:
https://cs.opensource.google/go/go/+/master:src/cmd/compile/internal/test/ssa_test.go;l=171;drc=16a3cefc93d9b896b2053320e387d0e449904aba

2022-01-21T21:27:57-e7c9de2-9eba5ff/plan9-arm (#46520, not specific to plan9)
2022-01-21T21:08:53-3425967-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-21T16:59:19-9f83dd3-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-20T20:23:52-80963bc-2c2e081/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:59:17-ab35822-9284279/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:52:25-ab35822-e7d5857/plan9-arm (possibly #45211? if so, not specific to plan9)

@gopherbot
Copy link
Contributor

Change https://go.dev/cl/408697 mentions this issue: dashboard: add known issues for plan9-arm

gopherbot pushed a commit to golang/build that referenced this issue May 26, 2022
@gopherbot
dashboard: add known issue for plan9-arm
560d411 
For golang/go#52653.
Updates golang/go#49338.

Change-Id: Ib23be56bd79bce8b3168cb40064916a2a91dbb88
Reviewed-on: https://go-review.googlesource.com/c/build/+/408697
Auto-Submit: Bryan Mills <bcmills@google.com>
Reviewed-by: Alex Rakoczy <alex@golang.org>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
@seankhliao seankhliao added this to the Unplanned milestone Aug 20, 2022
xhit pushed a commit to xhit/text that referenced this issue Oct 10, 2022
@xhit
message/pipeline: skip TestFullCycle on plan9-arm
dfea723 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@gopherbot

This comment was marked as resolved.

Sign in to view
@bcmills bcmills added the arch-arm Issues solely affecting the 32-bit arm architecture. label Dec 6, 2022
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-05 22:01 plan9-arm go@185e1a7b os/exec.TestExtraFilesRace (log) 
--- FAIL: TestExtraFilesRace (0.50s)
    exec_test.go:850: iteration 2, process B got:

        want:
        fd3: listener 127.0.0.1:40881

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-06 20:08 plan9-arm net@1e63c2f0 go@a4a86c7b x/net/http2.TestTransportUsesGoAwayDebugError_Body (log) 
--- FAIL: TestTransportUsesGoAwayDebugError_Body (0.03s)
    transport_test.go:2861: RoundTrip error = http2.GoAwayError: http2.GoAwayError{LastStreamID:0x5, ErrCode:0x0, DebugData:"some debug data"}, want http2.GoAwayError (http2.GoAwayError{LastStreamID:0x5, ErrCode:0xd, DebugData:"some debug data"})

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-22 15:34 plan9-arm benchmarks@03c43f28 go@f721fa3b (log) 
runtime: signal received on thread not created by Go.

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-01 20:58 plan9-arm go@cc1771e2 net/http.TestOmitHTTP2Vet (log) 
http.test 26576: warning: process exceeds 100 file descriptors
--- FAIL: TestOmitHTTP2Vet (20.57s)
    http_test.go:135: go vet failed: exit status: 'go 26635: 2', fatal error: all goroutines are asleep - deadlock!

        runtime stack:
        runtime.fatal({0x6104f8, 0x25})
        	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffc1c sp=0x3ffffc08 pc=0x3ad1c
        runtime.checkdead()
        	/boot/workdir/go/src/runtime/proc.go:5265 +0x318 fp=0x3ffffc5c sp=0x3ffffc1c pc=0x49858
        runtime.mput(0x983c000)
        	/boot/workdir/go/src/runtime/proc.go:5700 +0x44 fp=0x3ffffc60 sp=0x3ffffc5c pc=0x4b34c
        runtime.stopm()
        	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc74 sp=0x3ffffc60 pc=0x42148
        runtime.findRunnable()
        	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffd14 sp=0x3ffffc74 pc=0x43c9c
        runtime.schedule()
        	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd30 sp=0x3ffffd14 pc=0x44f94
        runtime.park_m(0x96130e0)
        	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd44 sp=0x3ffffd30 pc=0x45784
        runtime.mcall()
        	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd4c sp=0x3ffffd44 pc=0x69814
2022-12-12 22:32 plan9-arm crypto@23edec0b go@357ea858 (log) 
runtime: program exceeds 0-thread limit
fatal error: thread exhaustion

runtime stack:
runtime.throw({0x6018dc, 0x11})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffd84 sp=0x3ffffd70 pc=0x3ac58
runtime.checkmcount()
	/boot/workdir/go/src/runtime/proc.go:789 +0x94 fp=0x3ffffd94 sp=0x3ffffd84 pc=0x3eef0
runtime.mReserveID()
	/boot/workdir/go/src/runtime/proc.go:805 +0x74 fp=0x3ffffda8 sp=0x3ffffd94 pc=0x3ef90
runtime.startm(0x9433300, 0x1)
	/boot/workdir/go/src/runtime/proc.go:2403 +0xb4 fp=0x3ffffdd4 sp=0x3ffffda8 pc=0x422d4
runtime.handoffp(0x9433300)
	/boot/workdir/go/src/runtime/proc.go:2463 +0x390 fp=0x3ffffdfc sp=0x3ffffdd4 pc=0x42870
runtime.retake(0x17310608ee127184)
	/boot/workdir/go/src/runtime/proc.go:5494 +0x2f0 fp=0x3ffffe20 sp=0x3ffffdfc pc=0x4a58c
runtime.sysmon()
	/boot/workdir/go/src/runtime/proc.go:5402 +0x5c0 fp=0x3ffffe8c sp=0x3ffffe20 pc=0x4a0ac
runtime.mstart1()
	/boot/workdir/go/src/runtime/proc.go:1498 +0x7c fp=0x3ffffe9c sp=0x3ffffe8c pc=0x40b88
runtime.mstart0()
	/boot/workdir/go/src/runtime/proc.go:1455 +0x64 fp=0x3ffffeac sp=0x3ffffe9c pc=0x40afc
runtime.mstart()
	/boot/workdir/go/src/runtime/asm_arm.s:210 +0x8 fp=0x3ffffeb0 sp=0x3ffffeac pc=0x697b4
2022-12-12 23:10 plan9-arm go@b16e94d1 (log) 
fatal error: all goroutines are asleep - deadlock!

runtime stack:
runtime.fatal({0x6105a0, 0x25})
	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffbf4 sp=0x3ffffbe0 pc=0x3ad1c
runtime.checkdead()
	/boot/workdir/go/src/runtime/proc.go:5261 +0x318 fp=0x3ffffc34 sp=0x3ffffbf4 pc=0x49858
runtime.mput(0x969c240)
	/boot/workdir/go/src/runtime/proc.go:5696 +0x44 fp=0x3ffffc38 sp=0x3ffffc34 pc=0x4b34c
runtime.stopm()
	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc4c sp=0x3ffffc38 pc=0x42148
runtime.findRunnable()
	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffcec sp=0x3ffffc4c pc=0x43c9c
runtime.schedule()
	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd08 sp=0x3ffffcec pc=0x44f94
runtime.park_m(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd1c sp=0x3ffffd08 pc=0x45784
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd24 sp=0x3ffffd1c pc=0x69814
2022-12-13 21:00 plan9-arm benchmarks@555ee2b5 go@357ea858 (log) 
../../../../pkg/mod/cloud.google.com/go@v0.97.0/iam/iam.go:30:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/internal/proto/error.pb.go:27:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:40:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/google.golang.org/grpc@v1.40.0/status/status.go:34:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:28:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/iam.go:24:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
2022-12-15 00:54 plan9-arm tools@5899b6a2 go@ea14d1b6 (log)
2022-12-23 17:16 plan9-arm go@38cfb3be net.TestPipe (log) 
--- FAIL: TestPipe (120.26s)
    --- FAIL: TestPipe/PresentTimeout (119.92s)
        conntest.go:57: test timed out; terminating pipe
        conntest.go:279: got *errors.errorString: io: read/write on closed pipe, want net.Error
        conntest.go:268: got *errors.errorString: io: read/write on closed pipe, want net.Error
2022-12-29 17:47 plan9-arm go@642fd5f7 net/http.TestServerReadTimeout (log) 
http.test 33195: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h1 (1.60s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:35260: write tcp 127.0.0.1:35327->127.0.0.1:35260: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:35327": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:61614: write tcp 127.0.0.1:63071->127.0.0.1:61614: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:63071": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:48011: write tcp 127.0.0.1:60477->127.0.0.1:48011: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60477": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:58029: read tcp 127.0.0.1:60830->127.0.0.1:58029: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60830": write tcp 127.0.0.1:58029->127.0.0.1:60830: write /net/tcp/106/data: i/o on hungup channel
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:64770": unexpected EOF

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 21:10 plan9-arm benchmarks@33cb3306 go@27b6ace2 (log) 
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.zip: mkdir /boot/workdir/gopath/pkg/mod/github.com/biogo/biogo@v1.0.4/align/matrix/matrices: '/boot/workdir' fossil/fossil: walk: newfid 0x414 in use
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/google/pprof/@v/v0.0.0-20211122183932-1daafda22083.zip: open /boot/workdir/gopath/pkg/mod/github.com/google/pprof@v0.0.0-20211122183932-1daafda22083/internal/driver/driver_focus.go: '.../internal/driver/driver_focus.go' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp: '.../cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp: '.../mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment: '.../workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment' clone failed
...
sweet/benchmarks/tile38/main.go:27:2: unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:39:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:32:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:33:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/doc.go:62:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:26:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/acl.go:24:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:50:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:27:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:51:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-05 16:42 plan9-arm net@f8411da7 go@cc82867f x/net/http2/h2c.TestPropagation (log) 
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:36015: connection error: COMPRESSION_ERROR
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:33357: connection error: COMPRESSION_ERROR
2023/01/25 15:10:34 http2: server connection error from 127.0.0.1:60254: connection error: COMPRESSION_ERROR
2023/01/25 15:10:36 http2: server connection error from 127.0.0.1:59038: connection error: COMPRESSION_ERROR
2023/01/25 15:10:40 http2: server connection error from 127.0.0.1:57344: connection error: COMPRESSION_ERROR
2023/01/25 15:10:48 http2: server connection error from 127.0.0.1:42738: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x92140c0, 0x920a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x92140c0, 0x920a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x920a100, {0x3c0628, 0x92140c0}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x9212100, 0x920a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x9212100, 0x920a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x948
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x92080f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x92080f0, 0x36d90c)
2023-01-19 20:43 plan9-arm go@f89badf6 (log) 
0x9abe000 0x9bc0000
fatal error: bad span state

runtime stack:
runtime.throw({0x5ff570, 0xe})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffbdc sp=0x3ffffbc8 pc=0x3ac58
runtime.stackfree({0x9bc0000, 0x9be0000})
	/boot/workdir/go/src/runtime/stack.go:502 +0x1d0 fp=0x3ffffc20 sp=0x3ffffbdc pc=0x524a0
runtime.gfput(0x9436000, 0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:4395 +0x5c fp=0x3ffffc50 sp=0x3ffffc20 pc=0x47a78
runtime.goexit0(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3671 +0x2e8 fp=0x3ffffc88 sp=0x3ffffc50 pc=0x460f0
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffc90 sp=0x3ffffc88 pc=0x69814
2023-01-19 20:46 plan9-arm go@e08642ca (log)
2023-01-20 02:42 plan9-arm tools@a7f033af go@c641d48a x/tools/gopls/internal/lsp/filecache.TestConcurrency (log) 
--- FAIL: TestConcurrency (2.30s)
    filecache_test.go:99: open /tmp/gopls/eb948799/TestConcurrency/e0/e05ac03a87bbe7ab6768fe0fb083c0bbd4d325061645abf87964477a4bd35143: '/tmp/gopls' mount rpc error
2023-01-20 17:52 plan9-arm go@1011ccad os.TestDirFS (log) 
os.test 38819: warning: process exceeds 100 file descriptors
os.test 38819: warning: process exceeds 200 file descriptors
os.test 38819: warning: process exceeds 300 file descriptors
os.test 38819: warning: process exceeds 400 file descriptors
os.test 38819: warning: process exceeds 500 file descriptors
os.test 38819: warning: process exceeds 600 file descriptors
os.test 38819: warning: process exceeds 700 file descriptors
os.test 38819: warning: process exceeds 800 file descriptors
os.test 38819: warning: process exceeds 900 file descriptors
os.test 38819: warning: process exceeds 1000 file descriptors
os.test 38819: warning: process exceeds 1100 file descriptors
os.test 38819: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.11s)
    os_test.go:2799: TestFS found errors:
        b: fsys.Stat: stat b: './testdata' file does not exist
2023-01-20 19:38 plan9-arm go@f07910bd os.TestDirFS (log) 
os.test 38798: warning: process exceeds 100 file descriptors
os.test 38798: warning: process exceeds 200 file descriptors
os.test 38798: warning: process exceeds 300 file descriptors
os.test 38798: warning: process exceeds 400 file descriptors
os.test 38798: warning: process exceeds 500 file descriptors
os.test 38798: warning: process exceeds 600 file descriptors
os.test 38798: warning: process exceeds 700 file descriptors
os.test 38798: warning: process exceeds 800 file descriptors
os.test 38798: warning: process exceeds 900 file descriptors
os.test 38798: warning: process exceeds 1000 file descriptors
os.test 38798: warning: process exceeds 1100 file descriptors
os.test 38798: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: fsys.Stat: stat dir: './testdata' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3257637846/testdata/dirfs/a: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3257637846/testdata/issue37161: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.02s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.00s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023/01/21 02:05:04 open testdata/hello: 'testdata' file does not exist
2023-01-23 18:50 plan9-arm go@b90971b2 os.TestDirFS (log) 
os.test 38679: warning: process exceeds 100 file descriptors
os.test 38679: warning: process exceeds 200 file descriptors
os.test 38679: warning: process exceeds 300 file descriptors
os.test 38679: warning: process exceeds 400 file descriptors
os.test 38679: warning: process exceeds 500 file descriptors
os.test 38679: warning: process exceeds 600 file descriptors
os.test 38679: warning: process exceeds 700 file descriptors
os.test 38679: warning: process exceeds 800 file descriptors
os.test 38679: warning: process exceeds 900 file descriptors
os.test 38679: warning: process exceeds 1000 file descriptors
os.test 38679: warning: process exceeds 1100 file descriptors
os.test 38679: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.13s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        .: fs.ReadDir: open .: './testdata' file does not exist

— watchflakes

@bcmills bcmills mentioned this issue Jan 25, 2023
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-24 19:29 plan9-arm go@083d94f6 (log) 
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 24782: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 09:27 plan9-arm go@1bef0707 os.TestDirFS (log) 
os.test 38845: warning: process exceeds 100 file descriptors
os.test 38845: warning: process exceeds 200 file descriptors
os.test 38845: warning: process exceeds 300 file descriptors
os.test 38845: warning: process exceeds 400 file descriptors
os.test 38845: warning: process exceeds 500 file descriptors
os.test 38845: warning: process exceeds 600 file descriptors
os.test 38845: warning: process exceeds 700 file descriptors
os.test 38845: warning: process exceeds 800 file descriptors
os.test 38845: warning: process exceeds 900 file descriptors
os.test 38845: warning: process exceeds 1000 file descriptors
os.test 38845: warning: process exceeds 1100 file descriptors
os.test 38845: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.08s)
    os_test.go:2799: TestFS found errors:
        b: second Open: open b: './testdata' file does not exist
2023-01-25 16:38 plan9-arm go@1d3088ef os.TestFileReadDir (log) 
os.test 38568: warning: process exceeds 100 file descriptors
os.test 38568: warning: process exceeds 200 file descriptors
os.test 38568: warning: process exceeds 300 file descriptors
os.test 38568: warning: process exceeds 400 file descriptors
os.test 38568: warning: process exceeds 500 file descriptors
os.test 38568: warning: process exceeds 600 file descriptors
os.test 38568: warning: process exceeds 700 file descriptors
os.test 38568: warning: process exceeds 800 file descriptors
os.test 38568: warning: process exceeds 900 file descriptors
os.test 38568: warning: process exceeds 1000 file descriptors
os.test 38568: warning: process exceeds 1100 file descriptors
os.test 38568: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.01s)
        os_test.go:436: stat ./env.go: './env.go' file does not exist
2023-01-25 18:50 plan9-arm go@3c7884a2 (log)
2023-01-26 01:06 plan9-arm go@89de906a os.TestDirFS (log) 
os.test 38675: warning: process exceeds 100 file descriptors
os.test 38675: warning: process exceeds 200 file descriptors
os.test 38675: warning: process exceeds 300 file descriptors
os.test 38675: warning: process exceeds 400 file descriptors
os.test 38675: warning: process exceeds 500 file descriptors
os.test 38675: warning: process exceeds 600 file descriptors
os.test 38675: warning: process exceeds 700 file descriptors
os.test 38675: warning: process exceeds 800 file descriptors
os.test 38675: warning: process exceeds 900 file descriptors
os.test 38675: warning: process exceeds 1000 file descriptors
os.test 38675: warning: process exceeds 1100 file descriptors
os.test 38675: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: Open: open dir: './testdata' file does not exist
2023-01-26 19:45 plan9-arm go@627f1286 os.TestFileReadDir (log) 
os.test 38900: warning: process exceeds 100 file descriptors
os.test 38900: warning: process exceeds 200 file descriptors
os.test 38900: warning: process exceeds 300 file descriptors
os.test 38900: warning: process exceeds 400 file descriptors
os.test 38900: warning: process exceeds 500 file descriptors
os.test 38900: warning: process exceeds 600 file descriptors
os.test 38900: warning: process exceeds 700 file descriptors
os.test 38900: warning: process exceeds 800 file descriptors
os.test 38900: warning: process exceeds 900 file descriptors
os.test 38900: warning: process exceeds 1000 file descriptors
os.test 38900: warning: process exceeds 1100 file descriptors
os.test 38900: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.00s)
    --- FAIL: TestFileReadDir/. (0.02s)
        os_test.go:436: stat ./dir_unix.go: './dir_unix.go' file does not exist
2023-01-26 21:33 plan9-arm net@296f09aa go@dd44d981 x/net/http2/h2c.TestPropagation (log) 
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:38262: connection error: COMPRESSION_ERROR
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:61518: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x918c120, 0x918a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x918c120, 0x918a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x918a100, {0x3bb8b0, 0x918c120}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x918e140, 0x918a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x918e140, 0x918a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x944
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x91940f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x91940f0, 0x367b44)
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3691254424/testdata/dirfs/a: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3691254424/testdata/issue37161: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.01s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.01s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023/01/28 18:19:03 open testdata/hello: 'testdata' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os/exec (log) 
fork/exec /tmp/go-build985727719/b124/exec.test: '/boot/workdir/go/src/os' does not exist
2023-01-27 03:32 plan9-arm go@4e3abee2 os.TestDirFS (log) 
os.test 36915: warning: process exceeds 100 file descriptors
os.test 36915: warning: process exceeds 200 file descriptors
os.test 36915: warning: process exceeds 300 file descriptors
os.test 36915: warning: process exceeds 400 file descriptors
os.test 36915: warning: process exceeds 500 file descriptors
os.test 36915: warning: process exceeds 600 file descriptors
os.test 36915: warning: process exceeds 700 file descriptors
os.test 36915: warning: process exceeds 800 file descriptors
os.test 36915: warning: process exceeds 900 file descriptors
os.test 36915: warning: process exceeds 1000 file descriptors
os.test 36915: warning: process exceeds 1100 file descriptors
os.test 36915: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.16s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        x: Open: open x: './testdata' file does not exist
2023-01-30 16:32 plan9-arm go@87860873 net/http.TestServerReadTimeout (log) 
http.test 28542: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h2 (1.22s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:43789: write tcp 127.0.0.1:40901->127.0.0.1:43789: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:40901": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:65498: write tcp 127.0.0.1:48431->127.0.0.1:65498: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:48431": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:55311: write tcp 127.0.0.1:60716->127.0.0.1:55311: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60716": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:56933: write tcp 127.0.0.1:57942->127.0.0.1:56933: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:57942": EOF
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:41059": local error: tls: bad record MAC
2023-01-30 20:09 plan9-arm go@45bee5e7 os.TestReadFile (log) 
os.test 31035: warning: process exceeds 100 file descriptors
os.test 31035: warning: process exceeds 200 file descriptors
os.test 31035: warning: process exceeds 300 file descriptors
os.test 31035: warning: process exceeds 400 file descriptors
os.test 31035: warning: process exceeds 500 file descriptors
os.test 31035: warning: process exceeds 600 file descriptors
os.test 31035: warning: process exceeds 700 file descriptors
os.test 31035: warning: process exceeds 800 file descriptors
os.test 31035: warning: process exceeds 900 file descriptors
os.test 31035: warning: process exceeds 1000 file descriptors
os.test 31035: warning: process exceeds 1100 file descriptors
os.test 31035: warning: process exceeds 1200 file descriptors
--- FAIL: TestReadFile (0.01s)
    read_test.go:17: Stat "read_test.go" (looking for size 3171): stat read_test.go: 'read_test.go' file does not exist
2023-01-31 19:43 plan9-arm go@b89a840d (log) 
go: no such tool "vet"
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 15678: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-02-02 23:42 plan9-arm tools@81111180 go@a9648761 x/tools/cmd/bundle.TestBundle (log) 
--- FAIL: TestBundle (5.10s)
    --- FAIL: TestBundle/Modules (1.30s)
        main_test.go:50: failed to load source package

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-07 20:50 x_tools-go1.23-plan9-arm tools@4a726251 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 20:50 x_tools-go1.23-plan9-arm tools@4a726251 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 20:50 x_tools-go1.23-plan9-arm tools@4a726251 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-07 23:17 x_tools-go1.23-plan9-arm tools@dbc82b6d release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 23:17 x_tools-go1.23-plan9-arm tools@dbc82b6d release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 23:17 x_tools-go1.23-plan9-arm tools@dbc82b6d release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-07 16:31 x_tools-go1.23-plan9-arm tools@f71ad04f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 16:31 x_tools-go1.23-plan9-arm tools@f71ad04f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-07 16:31 x_tools-go1.23-plan9-arm tools@f71ad04f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-06 13:59 x_tools-go1.23-plan9-arm tools@055c1afc release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-06 13:59 x_tools-go1.23-plan9-arm tools@055c1afc release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-06 13:59 x_tools-go1.23-plan9-arm tools@055c1afc release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-06 10:57 x_tools-go1.23-plan9-arm tools@51a10bcf release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-06 10:57 x_tools-go1.23-plan9-arm tools@51a10bcf release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-06 10:57 x_tools-go1.23-plan9-arm tools@51a10bcf release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:16 x_tools-go1.23-plan9-arm tools@89c7c2cd release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:16 x_tools-go1.23-plan9-arm tools@89c7c2cd release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:16 x_tools-go1.23-plan9-arm tools@89c7c2cd release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:16 x_tools-go1.24-plan9-arm tools@89c7c2cd release-branch.go1.24@34c8b14c x/tools/gopls/internal/cmd.TestDefinition (log) 
=== RUN   TestDefinition
=== PAUSE TestDefinition
=== CONT  TestDefinition
    integration_test.go:291: gopls definition a.go:7:2: exited with code 1, want success: true (gopls definition a.go:7:2: exit=1 stdout=<<>> stderr=<<2025/05/08 17:38:14 Error:2025/05/08 17:38:14 go/packages.Load #1: err: exit status: 'go 221259: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
        	duration=3.893371609s
        2025/05/08 17:38:14 Error:2025/05/08 17:38:14 initial workspace load failed: packages.Load error: err: exit status: 'go 221259: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        gopls: ./a.go:7:2: no package metadata for file file://./a.go
        >>)
    integration_test.go:292: gopls definition a.go:7:2: stdout does not match [a.go:3:6-7: defined here as func f]; got <<>>
--- FAIL: TestDefinition (129.89s)
2025-05-08 15:56 x_tools-go1.23-plan9-arm tools@6736a6d7 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:56 x_tools-go1.23-plan9-arm tools@6736a6d7 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:56 x_tools-go1.23-plan9-arm tools@6736a6d7 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:56 x_tools-go1.24-plan9-arm tools@6736a6d7 release-branch.go1.24@34c8b14c x/tools/gopls/internal/cmd.TestCheck (log) 
=== RUN   TestCheck
=== PAUSE TestCheck
=== CONT  TestCheck
    integration_test.go:147: gopls check ./c/c2.go: stdout does not match [c2.go:2:5-6: C redeclared in this block]; got <<>>
    integration_test.go:148: gopls check ./c/c2.go: stdout does not match [c.go:2:5-6: - other declaration of C]; got <<>>
--- FAIL: TestCheck (138.99s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 20:02 x_tools-go1.23-plan9-arm tools@2587caa9 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 20:02 x_tools-go1.23-plan9-arm tools@2587caa9 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 20:02 x_tools-go1.23-plan9-arm tools@2587caa9 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 19:19 x_tools-go1.23-plan9-arm tools@3d893350 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 19:19 x_tools-go1.23-plan9-arm tools@3d893350 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 19:19 x_tools-go1.23-plan9-arm tools@3d893350 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:45 x_tools-go1.23-plan9-arm tools@51dcb32d release-branch.go1.23@f77084d1 x/tools/go/analysis/passes/unusedresult.Test (log) 
=== RUN   Test
    analysistest.go:384: loading [a typeparams]: err: exit status: 'go 54847: 2': stderr: fatal error: findrunnable: negative nmspinning
        
        runtime stack:
        runtime.throw({0x6e40ab, 0x21})
        	runtime/panic.go:1073 +0x34 fp=0x3ffffb98 sp=0x3ffffb84 pc=0x77d20
        runtime.resetspinning()
        	runtime/proc.go:3856 +0x68 fp=0x3ffffba8 sp=0x3ffffb98 pc=0x481e8
        runtime.schedule()
        	runtime/proc.go:4014 +0x144 fp=0x3ffffbc4 sp=0x3ffffba8 pc=0x48730
...
        	os/exec/exec.go:580 +0x50 fp=0x1130fb4 sp=0x1130f78 pc=0x13be1c
        os/exec.(*Cmd).Start.func2(0x111c080)
        	os/exec/exec.go:733 +0x30 fp=0x1130fe4 sp=0x1130fb4 pc=0x13ca38
        os/exec.(*Cmd).Start.gowrap1()
        	os/exec/exec.go:745 +0x30 fp=0x1130fec sp=0x1130fe4 pc=0x13c9dc
        runtime.goexit({})
        	runtime/asm_arm.s:884 +0x4 fp=0x1130fec sp=0x1130fec pc=0x7f0f4
        created by os/exec.(*Cmd).Start in goroutine 177
        	os/exec/exec.go:732 +0x94c
--- FAIL: Test (17.45s)
2025-05-08 15:45 x_tools-go1.23-plan9-arm tools@51dcb32d release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:45 x_tools-go1.23-plan9-arm tools@51dcb32d release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:22 x_tools-go1.23-plan9-arm tools@bad56196 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:22 x_tools-go1.23-plan9-arm tools@bad56196 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-08 15:22 x_tools-go1.23-plan9-arm tools@bad56196 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 10:26 x_tools-go1.23-plan9-arm tools@1ead56f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 10:26 x_tools-go1.23-plan9-arm tools@1ead56f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 10:26 x_tools-go1.23-plan9-arm tools@1ead56f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 10:26 x_tools-gotip-plan9-arm tools@1ead56f2 go@49d6777d x/tools/gopls/internal/cmd.TestDefinition (log) 
=== RUN   TestDefinition
=== PAUSE TestDefinition
=== CONT  TestDefinition
    integration_test.go:304: gopls definition -json -markdown a.go:4:7: exited with code 1, want success: true (gopls definition -json -markdown a.go:4:7: exit=1 stdout=<<>> stderr=<<2025/05/09 15:07:55 Error:2025/05/09 15:07:55 go/packages.Load #1: err: exit status: 'go 263049: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
        	duration=4.489961875s
        2025/05/09 15:07:55 Error:2025/05/09 15:07:55 initial workspace load failed: packages.Load error: err: exit status: 'go 263049: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        gopls: ./a.go:4:7: no package metadata for file file://./a.go
        >>)
    integration_test.go:1247: invalid JSON unexpected end of JSON input
--- FAIL: TestDefinition (145.28s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 10:51 x_tools-go1.23-plan9-arm tools@c89ad19f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 10:51 x_tools-go1.23-plan9-arm tools@c89ad19f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 10:51 x_tools-go1.23-plan9-arm tools@c89ad19f release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@b61ab331 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@b61ab331 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@b61ab331 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 16:55 x_tools-go1.23-plan9-arm tools@b303c1f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:55 x_tools-go1.23-plan9-arm tools@b303c1f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:55 x_tools-go1.23-plan9-arm tools@b303c1f2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:55 x_tools-go1.24-plan9-arm tools@b303c1f2 release-branch.go1.24@34c8b14c x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:1053: gopls codeaction -kind=quickfix -exec a/b.go:#40: exited with code 1, want success: true (gopls codeaction -kind=quickfix -exec a/b.go:#40: exit=1 stdout=<<>> stderr=<<2025/05/09 21:14:37 Error:2025/05/09 21:14:37 go/packages.Load #1: err: exit status: 'go 74061: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
...
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
        	duration=3.328002407s
        2025/05/09 21:14:37 Error:2025/05/09 21:14:37 initial workspace load failed: packages.Load error: err: exit status: 'go 74061: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        gopls: no matching code action at ./a/b.go:#40
--- FAIL: TestCodeAction (175.71s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 19:29 x_tools-go1.23-plan9-arm tools@a240192b release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:29 x_tools-go1.23-plan9-arm tools@a240192b release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:29 x_tools-go1.23-plan9-arm tools@a240192b release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 19:16 x_tools-go1.23-plan9-arm tools@ce6fe291 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:16 x_tools-go1.23-plan9-arm tools@ce6fe291 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:16 x_tools-go1.23-plan9-arm tools@ce6fe291 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 19:14 x_tools-go1.23-plan9-arm tools@2cf2b2ae release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:14 x_tools-go1.23-plan9-arm tools@2cf2b2ae release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:14 x_tools-go1.23-plan9-arm tools@2cf2b2ae release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 16:54 x_tools-go1.23-plan9-arm tools@d11c94a2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:54 x_tools-go1.23-plan9-arm tools@d11c94a2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:54 x_tools-go1.23-plan9-arm tools@d11c94a2 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 16:37 x_tools-go1.23-plan9-arm tools@721ad8de release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:37 x_tools-go1.23-plan9-arm tools@721ad8de release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:37 x_tools-go1.23-plan9-arm tools@721ad8de release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 16:25 x_tools-go1.23-plan9-arm tools@b4891595 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:25 x_tools-go1.23-plan9-arm tools@b4891595 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:25 x_tools-go1.23-plan9-arm tools@b4891595 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 16:19 gotip-plan9-arm go@9c170f70 os/exec (log) 
PASS
*** Test killed with quit: ran too long (49m30s).
signal: killed
FAIL	os/exec	3240.001s
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@ef35d724 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@ef35d724 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:10 x_tools-go1.23-plan9-arm tools@ef35d724 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-08 15:09 gotip-plan9-arm go@bd1f9a49 time.TestLongAdjustTimers (log) 
=== RUN   TestLongAdjustTimers
=== PAUSE TestLongAdjustTimers
=== CONT  TestLongAdjustTimers
    tick_test.go:228: timer expired
--- FAIL: TestLongAdjustTimers (60.70s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@8ee3f58c release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@8ee3f58c release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@8ee3f58c release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:37 x_tools-gotip-plan9-arm tools@721ad8de go@e282cbb1 x/tools/cmd/stringer.TestMultifileStringer/package_over_x_test_package [ABORT] (log) 
=== RUN   TestMultifileStringer/package_over_x_test_package
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 16:37 x_tools-gotip-plan9-arm tools@721ad8de go@e282cbb1 x/tools/gopls/internal/golang.TestUnify (log) 
=== RUN   TestUnify
    testfiles.go:113: err: exit status: 'go 31542: 1': stderr: go: open /tmp/TestUnify2917643460/001/go.mod: '/tmp/TestUnify2917643460/001/go.mod' exclusive lock
        
--- FAIL: TestUnify (21.15s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 16:25 x_tools-gotip-plan9-arm tools@b4891595 go@e282cbb1 x/tools/gopls/internal/cmd.TestCheck (log) 
=== RUN   TestCheck
=== PAUSE TestCheck
=== CONT  TestCheck
    integration_test.go:139: gopls check ./a.go ./b.go: stdout does not match [a.go:.* fmt.Sprintf format %s has arg 123 of wrong type int]; got <<>>
    integration_test.go:140: gopls check ./a.go ./b.go: stdout does not match [b.go:.* fmt.Sprintf format %d has arg "123" of wrong type string]; got <<>>
--- FAIL: TestCheck (214.59s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@4160b775 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@4160b775 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@4160b775 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 19:16 x_tools-gotip-plan9-arm tools@ce6fe291 go@e282cbb1 x/tools/gopls/internal/cmd.TestStats (log) 
=== RUN   TestStats
=== PAUSE TestStats
=== CONT  TestStats
    integration_test.go:917: stats.WorkspaceStats.Views[0].WorkspaceModules = 0, want 1
    integration_test.go:917: stats.WorkspaceStats.Views[0].WorkspacePackages = 0, want 2
--- FAIL: TestStats (87.33s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@d60d9304 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/deprecated.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@d60d9304 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/embeddirective.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2025-05-09 15:03 x_tools-go1.23-plan9-arm tools@d60d9304 release-branch.go1.23@f77084d1 x/tools/gopls/internal/analysis/fillreturns.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2025-05-09 15:03 x_tools-gotip-plan9-arm tools@4160b775 go@e282cbb1 x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:1043: gopls codeaction -kind=quickfix a/a.go:#15: exited with code 1, want success: true (gopls codeaction -kind=quickfix a/a.go:#15: exit=1 stdout=<<>> stderr=<<2025/05/10 23:50:50 Error:2025/05/10 23:50:50 go/packages.Load #1: err: exit status: 'go 201951: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
        	duration=2.779204872s
        2025/05/10 23:50:50 Error:2025/05/10 23:50:50 initial workspace load failed: packages.Load error: err: exit status: 'go 201951: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        gopls: ./a/a.go:#15: no package metadata for file file://./a/a.go
        >>)
    integration_test.go:1047: codeaction: got <<>>, want <<edit	"Fill in return values" [quickfix]
        >>
        stderr:
        2025/05/10 23:50:50 Error:2025/05/10 23:50:50 go/packages.Load #1: err: exit status: 'go 201951: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        	view_id="1"
        	snapshot=0
        	directory=.
        	query=[./... builtin]
        	packages=0
        	duration=2.779204872s
        2025/05/10 23:50:50 Error:2025/05/10 23:50:50 initial workspace load failed: packages.Load error: err: exit status: 'go 201951: 1': stderr: go: open ./go.mod: './go.mod' exclusive lock
        
        gopls: ./a/a.go:#15: no package metadata for file file://./a/a.go
--- FAIL: TestCodeAction (176.02s)

— watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Projects
Test Flakes
Status: Active
Milestone
Unplanned
Development

No branches or pull requests
6 participants
@bcmills @oridb @gopherbot @seankhliao @millerresearch @janderssonse