Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

all: plan9-arm builder failing frequently with a variety of errors #49338

Open
bcmills opened this issue Nov 4, 2021 · 461 comments
Open

all: plan9-arm builder failing frequently with a variety of errors #49338

bcmills opened this issue Nov 4, 2021 · 461 comments
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Milestone
Unplanned

Comments

@bcmills
Copy link
Contributor

bcmills commented Nov 4, 2021 •
edited by cherrymui
Loading 

#!watchflakes
post <- builder ~ `plan9-arm`

The one remaining plan9 builder is failing a significant fraction of build attempts.
Many of the failures follow specific known patterns (notably #49337, #46526, and #41952). However, many do not.

@millerresearch, @0intro, @fhs: is there someone who can investigate these failures and bring the plan9 port back up to par? With the 0intro builders missing (#49327, #49328), there is no longer any plan9 builder consistently passing tests.

greplogs --dashboard -md -l -e \\Aplan9. -E . --since=2021-10-01

2021-11-04T01:44:54-d9bb5f6/plan9-arm
2021-11-03T23:48:28-283373d/plan9-arm
2021-11-03T21:45:33-4a4e1f2-d3f5dd5/plan9-arm
2021-11-03T21:45:33-2c98350-d3f5dd5/plan9-arm
2021-11-03T19:32:33-74f99d0/plan9-arm
2021-11-03T18:37:22-cfd016d/plan9-arm
2021-11-03T15:59:11-5f0e5d2/plan9-arm
2021-11-03T09:23:34-6458b2e/plan9-arm
2021-11-03T05:00:00-519c0a2/plan9-arm
2021-11-03T00:49:50-a4b2c57/plan9-arm
2021-11-03T00:21:24-8f0ca7d/plan9-arm
2021-11-03T00:07:38-49a0063/plan9-arm
2021-11-03T00:06:52-32d2752/plan9-arm
2021-11-02T23:44:58-a0f373c/plan9-arm
2021-11-02T23:05:17-714668c-eb63cbd/plan9-arm
2021-11-02T21:18:39-60fd3ed/plan9-arm
2021-11-02T20:59:34-79024cf/plan9-arm
2021-11-02T19:56:02-c45c32b/plan9-arm
2021-11-02T19:37:42-1011e26/plan9-arm
2021-11-02T18:35:29-433ba58/plan9-arm
2021-11-02T18:35:22-0b37bd9/plan9-arm
2021-11-02T18:31:53-79c5240/plan9-arm
2021-11-02T18:24:18-f7a95d2/plan9-arm
2021-11-02T15:33:01-4d06874-da7173a/plan9-arm
2021-11-02T13:43:24-ee08195-4d7bf41/plan9-arm
2021-11-02T13:43:24-4ff95d6-4d7bf41/plan9-arm
2021-11-02T06:25:39-4ff95d6-088bb4b/plan9-arm
2021-11-02T06:21:44-3ee426a/plan9-arm
2021-11-02T06:20:21-c1ea339/plan9-arm
2021-11-02T06:19:33-4633b2d/plan9-arm
2021-11-02T05:35:11-6f327f7/plan9-arm
2021-11-02T03:55:19-4ff95d6-6f1e9a9/plan9-arm
2021-11-02T03:54:24-3c61cb3/plan9-arm
2021-11-02T03:53:56-b0472aa/plan9-arm
2021-11-02T03:52:33-9268565/plan9-arm
2021-11-01T22:55:50-02e5913/plan9-arm
2021-11-01T19:42:30-4ff95d6-5f1bcd1/plan9-arm
2021-11-01T18:53:06-b5a5b7b/plan9-arm
2021-11-01T16:31:02-03971e3-2bcf1c0/plan9-arm
2021-11-01T15:55:25-e2e910e/plan9-arm
2021-11-01T15:55:20-d2b5121/plan9-arm
2021-11-01T14:45:28-82f902a/plan9-arm
2021-11-01T13:12:37-4056934/plan9-arm
2021-11-01T13:08:16-732db40/plan9-arm
2021-11-01T02:47:30-fde4cc2/plan9-arm
2021-10-31T18:39:05-89c5270/plan9-arm
2021-10-31T18:13:09-fd09e88/plan9-arm
2021-10-31T17:52:41-3fa9ee4/plan9-arm
2021-10-30T18:30:34-6113dac/plan9-arm
2021-10-30T16:46:47-d1dceaf/plan9-arm
2021-10-30T12:32:06-351c04c-5d6d9f5/plan9-arm
2021-10-29T23:25:18-5d6d9f5/plan9-arm
2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-29T22:27:26-3571ab5/plan9-arm
2021-10-29T19:35:47-5ec139f/plan9-arm
2021-10-29T18:56:29-6afdf01/plan9-arm
2021-10-29T18:35:29-9da6415/plan9-arm
2021-10-29T18:23:03-413672f/plan9-arm
2021-10-29T17:44:52-353d5b6/plan9-arm
2021-10-29T04:21:07-103d89b-f288526/plan9-arm
2021-10-29T02:16:47-2c7cdec/plan9-arm
2021-10-29T02:11:42-33c392f/plan9-arm
2021-10-29T00:04:41-d6a9af8-af05d8b/plan9-arm
2021-10-28T20:50:34-d0751b1/plan9-arm
2021-10-28T20:50:34-103d89b-d0751b1/plan9-arm
2021-10-28T20:43:39-b954024/plan9-arm
2021-10-28T20:43:02-e741e2f/plan9-arm
2021-10-28T18:48:25-e7eb6f6-f229e70/plan9-arm
2021-10-28T18:10:59-ed475fe/plan9-arm
2021-10-28T18:10:50-2bc8ed8/plan9-arm
2021-10-28T17:57:57-2666262/plan9-arm
2021-10-28T17:52:59-3124968/plan9-arm
2021-10-28T02:35:22-056dfe6/plan9-arm
2021-10-28T01:15:26-b2fe2eb/plan9-arm
2021-10-28T00:11:24-a91d0b6/plan9-arm
2021-10-27T22:17:35-79ff663/plan9-arm
2021-10-27T21:37:54-749f6e9/plan9-arm
2021-10-27T21:35:48-a3c4ac0/plan9-arm
2021-10-27T21:34:20-4fefd43/plan9-arm
2021-10-27T20:25:06-bbc0595/plan9-arm
2021-10-27T20:24:34-56dcf97/plan9-arm
2021-10-27T20:03:17-68bd512/plan9-arm
2021-10-27T19:34:49-ffd2284/plan9-arm
2021-10-27T19:18:20-514ebae/plan9-arm
2021-10-27T18:24:50-259735f/plan9-amd64-0intro
2021-10-27T18:24:50-259735f/plan9-arm
2021-10-27T16:59:43-c0ac39c/plan9-arm
2021-10-27T13:12:49-cfb5321/plan9-arm
2021-10-27T08:50:27-e1e2965-bdefb77/plan9-arm
2021-10-27T08:50:27-bdefb77/plan9-arm
2021-10-26T23:12:17-13eccaa/plan9-arm
2021-10-26T22:05:53-80be4a4/plan9-386-0intro
2021-10-26T19:04:53-9626607-1dc77a3/plan9-arm
2021-10-26T19:04:53-03971e3-1dc77a3/plan9-arm
2021-10-26T18:33:39-244f92e-76cef81/plan9-386-0intro
2021-10-26T17:10:45-d418f37-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-386-0intro
2021-10-26T17:10:45-76cef81/plan9-amd64-0intro
2021-10-26T16:00:26-94870a3-1b2362b/plan9-arm
2021-10-26T14:05:47-a2b8c18/plan9-arm
2021-10-26T11:58:05-1e2820a/plan9-arm
2021-10-26T05:05:24-23fdd7f/plan9-arm
2021-10-26T01:22:47-f916b54-adfb85b/plan9-arm
2021-10-26T01:22:47-22652b4-adfb85b/plan9-arm
2021-10-26T01:07:41-41f7407/plan9-arm
2021-10-25T23:28:03-f916b54-e9eb66d/plan9-arm
2021-10-25T23:28:03-e9eb66d/plan9-arm
2021-10-25T21:03:33-60c3069/plan9-arm
2021-10-25T18:46:45-f47335e/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-25T16:07:11-fc8b4ca-c6e82e5/plan9-arm
2021-10-23T20:23:35-c96bc14-8dbf3e9/plan9-386-0intro
2021-10-23T20:23:35-8dbf3e9/plan9-arm
2021-10-23T16:18:19-d418f37-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-386-0intro
2021-10-23T16:18:19-c96bc14-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-affba50-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-386-0intro
2021-10-23T16:18:19-16318df/plan9-amd64-0intro
2021-10-23T16:18:19-16318df/plan9-arm
2021-10-23T16:18:15-12e4404/plan9-arm
2021-10-23T16:18:09-c526cf8/plan9-arm
2021-10-23T16:18:04-2d205eb/plan9-arm
2021-10-23T16:17:58-3cd28ba/plan9-arm
2021-10-23T12:44:47-b0f7eb6/plan9-arm
2021-10-22T21:48:34-ae4d67c/plan9-arm
2021-10-22T21:12:07-76dd01f/plan9-arm
2021-10-22T14:05:31-ff8115d/plan9-arm
2021-10-21T17:31:42-392bb06/plan9-arm
2021-10-21T17:23:58-02a3666/plan9-arm
2021-10-21T13:05:07-8b9c0d1/plan9-arm
2021-10-21T02:35:47-9b675d0-fca46d0/plan9-arm
2021-10-20T20:39:19-d419a80/plan9-arm
2021-10-20T20:38:59-75b73d6/plan9-arm
2021-10-20T20:38:47-3ec8d4b/plan9-arm
2021-10-20T19:30:13-cbf1d01-3ff39c5/plan9-arm
2021-10-20T19:30:13-3ff39c5/plan9-arm
2021-10-20T19:29:12-4320949/plan9-arm
2021-10-20T18:48:51-cbf1d01-4e565f7/plan9-arm
2021-10-20T05:28:45-b091189/plan9-arm
2021-10-19T23:27:41-4ea6123-2be5b84/plan9-arm
2021-10-19T22:47:35-9fa8551/plan9-arm
2021-10-19T18:56:08-07e5527/plan9-arm
2021-10-19T18:43:12-d944984/plan9-arm
2021-10-19T18:43:08-1d63052/plan9-arm
2021-10-19T18:22:59-6c3cd5d/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-19T17:12:53-404f84d/plan9-arm
2021-10-19T17:01:42-3a07ab7/plan9-arm
2021-10-19T16:19:27-98f6e03-f92a358/plan9-arm
2021-10-19T08:44:22-1e49210/plan9-arm
2021-10-19T07:45:46-281050f-ee92daa/plan9-arm
2021-10-18T22:56:07-eba0e86/plan9-arm
2021-10-18T22:55:05-7397178/plan9-arm
2021-10-18T19:46:27-98f6e03-394a1ad/plan9-arm
2021-10-18T16:32:38-543a513/plan9-arm
2021-10-18T15:38:40-74acbaf/plan9-arm
2021-10-16T16:27:40-c96bc14-640a49b/plan9-386-0intro
2021-10-16T16:27:40-98f6e03-640a49b/plan9-arm
2021-10-16T16:27:40-640a49b/plan9-arm
2021-10-16T16:27:40-4f30a5c-640a49b/plan9-386-0intro
2021-10-16T14:50:21-c96bc14-680caf1/plan9-386-0intro
2021-10-16T14:50:21-98f6e03-680caf1/plan9-386-0intro
2021-10-16T14:50:21-4f30a5c-680caf1/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-386-0intro
2021-10-15T21:46:06-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-c96bc14-ed1c8db/plan9-amd64-0intro
2021-10-15T21:46:06-4f30a5c-ed1c8db/plan9-amd64-0intro
2021-10-15T21:44:07-4a7975e/plan9-386-0intro
2021-10-15T20:29:48-85cbdda/plan9-arm
2021-10-15T20:29:36-a17b2e8/plan9-386-0intro
2021-10-15T19:54:44-22951fb/plan9-arm
2021-10-15T19:03:33-98f6e03-cfe6763/plan9-arm
2021-10-15T18:07:49-98f6e03-8331f25/plan9-arm
2021-10-15T02:45:22-288d0b3-3da0ff8/plan9-arm
2021-10-15T02:02:50-ce04ca3-3da0ff8/plan9-arm
2021-10-15T02:02:50-3da0ff8/plan9-386-0intro
2021-10-15T00:16:20-ce04ca3-9e8ed86/plan9-arm
2021-10-14T23:32:09-3a269dc-9e8ed86/plan9-arm
2021-10-14T22:15:24-281050f-b59467e/plan9-arm
2021-10-14T18:44:37-a37bebc/plan9-arm
2021-10-14T18:44:29-a8c5a99/plan9-arm
2021-10-14T15:17:03-fbdf830/plan9-arm
2021-10-14T13:09:28-88e80df-24e798e/plan9-arm
2021-10-14T13:09:28-24e798e/plan9-arm
2021-10-14T12:38:31-88e80df-2feb2cc/plan9-arm
2021-10-14T07:18:59-1349c6e/plan9-arm
2021-10-14T04:18:44-acac939-9e4dc6f/plan9-arm
2021-10-14T01:51:22-276fb27/plan9-arm
2021-10-13T22:21:08-ac2ed98-b90d258/plan9-arm
2021-10-13T20:31:25-b90d258/plan9-arm
2021-10-13T18:15:48-40f82f8/plan9-amd64-0intro
2021-10-13T18:15:48-40f82f8/plan9-arm
2021-10-13T18:15:48-281050f-40f82f8/plan9-arm
2021-10-13T17:02:43-b5904f3/plan9-arm
2021-10-13T16:39:23-3986e5c/plan9-arm
2021-10-13T16:36:59-69041c7/plan9-arm
2021-10-13T15:11:16-0454d73/plan9-arm
2021-10-13T03:12:54-24389d4-4fb2e1c/plan9-arm
2021-10-12T22:02:39-732f6fa/plan9-arm
2021-10-12T21:30:45-0b930fb-3283d1a/plan9-arm
2021-10-12T21:15:50-3d051ba/plan9-arm
2021-10-12T20:53:52-ac6d706/plan9-arm
2021-10-12T20:20:41-d032b2b/plan9-arm
2021-10-12T18:30:24-281050f-6e0adde/plan9-arm
2021-10-12T12:24:09-c8768b9-4679670/plan9-arm
2021-10-12T06:55:50-c83725b-d887d3b/plan9-arm
2021-10-11T20:46:14-7023535/plan9-arm
2021-10-11T20:46:14-18fa840-7023535/plan9-arm
2021-10-11T19:20:12-18fa840-65ffee6/plan9-arm
2021-10-11T15:48:29-2478b6f/plan9-arm
2021-10-11T12:53:11-3b03d30-34f7b1f/plan9-386-0intro
2021-10-11T12:53:11-34f7b1f/plan9-arm
2021-10-11T12:42:06-59b2f51/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-d2d21d9/plan9-amd64-0intro
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-10T15:11:26-3b03d30-d2d21d9/plan9-386-0intro
2021-10-10T15:11:26-1af23bd-d2d21d9/plan9-386-0intro
2021-10-10T13:37:52-1af23bd-b99abf3/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-386-0intro
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-08T22:21:41-ee04797-74abcab/plan9-arm
2021-10-08T19:41:16-c5188f2-7fcf9a1/plan9-arm
2021-10-08T19:41:16-7fcf9a1/plan9-386-0intro
2021-10-08T19:30:58-f430bda/plan9-arm
2021-10-08T19:19:09-b9e1e1b/plan9-386-0intro
2021-10-08T18:07:25-d480b5c/plan9-386-0intro
2021-10-08T17:58:41-16a3cef/plan9-arm
2021-10-08T17:32:31-d7ba1d2/plan9-386-0intro
2021-10-08T17:32:25-a7d3a0e/plan9-arm
2021-10-08T15:27:20-b3a4b2d/plan9-arm
2021-10-08T14:08:12-5b9206f/plan9-386-0intro
2021-10-08T14:08:12-5b9206f/plan9-arm
2021-10-07T22:19:58-1ceb723/plan9-arm
2021-10-07T21:39:17-6b4cf2b/plan9-arm
2021-10-07T20:37:43-d477ef3-ef2ebbe/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-07T18:58:33-7286502/plan9-arm
2021-10-07T18:09:53-4607ebc/plan9-arm
2021-10-07T16:38:24-be571a3/plan9-arm
2021-10-07T14:37:45-ebeab63/plan9-arm
2021-10-07T14:37:36-375a1fb/plan9-arm
2021-10-07T02:30:47-2c98350-39bbf08/plan9-arm
2021-10-06T23:26:57-c8dd89e/plan9-arm
2021-10-06T23:26:57-86761ae-c8dd89e/plan9-arm
2021-10-06T21:17:08-2e107b4/plan9-arm
2021-10-06T21:06:48-197b328/plan9-arm
2021-10-06T15:53:04-4d8db00/plan9-arm
2021-10-05T23:58:29-ac60900/plan9-arm
2021-10-05T23:36:43-e82ed0c/plan9-arm
2021-10-05T22:42:11-96fface/plan9-arm
2021-10-05T20:52:58-0d6561b/plan9-arm
2021-10-05T20:35:54-990c9c6/plan9-arm
2021-10-05T19:15:03-ae83301/plan9-arm
2021-10-05T18:31:14-5d946f1/plan9-arm
2021-10-05T17:10:45-2dc2755-5140ad1/plan9-arm
2021-10-05T15:47:57-017ffcd/plan9-arm
2021-10-05T15:47:07-cfd74f7/plan9-arm
2021-10-05T01:30:56-d4b1ae0-123393a/plan9-386-0intro
2021-10-04T22:59:44-78c2529/plan9-arm
2021-10-04T22:59:13-199ec42/plan9-arm
2021-10-04T22:54:58-7c79e8e/plan9-arm
2021-10-04T22:00:53-d9952ff/plan9-386-0intro
2021-10-04T22:00:19-739328c/plan9-arm
2021-10-04T21:10:16-db89b5a-f0db7ea/plan9-arm
2021-10-04T18:15:09-ccaa907-9f8d558/plan9-arm
2021-10-04T17:17:11-cedda3a-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-ccaa907-cc5e3de/plan9-386-0intro
2021-10-04T17:17:11-cc5e3de/plan9-amd64-0intro
2021-10-04T15:50:43-9432320/plan9-386-0intro
2021-10-04T15:50:43-9432320/plan9-amd64-0intro
2021-10-02T16:05:55-0ebff1a-a7fe161/plan9-arm
2021-10-02T13:15:42-0ebff1a-7bf7bbc/plan9-arm
2021-10-01T23:51:16-c129af9/plan9-arm
2021-10-01T21:26:43-0ebff1a-0d65c27/plan9-arm
2021-10-01T19:30:53-13c407c-0d65c27/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-10-01T17:18:20-5279e53/plan9-arm
2021-10-01T16:45:09-58ad7eb-f19b2d5/plan9-arm
2021-10-01T16:17:08-f19b2d5/plan9-arm
2021-10-01T16:01:09-558b9da-8d494b0/plan9-arm
2021-10-01T15:59:38-e5ad363/plan9-arm
2021-10-01T14:06:36-96d3ba8/plan9-arm
@bcmills bcmills added OS-Plan9 NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Nov 4, 2021
@millerresearch
Copy link
Contributor

For most of plan9-arm failures, the cause is filesystem flakiness on the builder machines (a cluster of 3 x raspberry pi 4). I've just reconfigured the build script to stop using ramfs (which has a locking bug) for /tmp, and stop using the ad hoc directory cache (which still seems to have some flaws). This should bypass most of the failures but will make the test suite a lot slower to run (by go.17 it had already regressed to about 2 hours even with these filesystem tweaks).

There are some other flakes of the "shouldn't be possible" variety, which are are rare and perplexing and impossible to replicate. They are occurring in general go runtime code, not specific to plan 9. There's a slight whiff of possible memory cache coherence trouble in some of these:
marked free object in span
attempt to clean non-empty span set
unexpected waitm - semaphore out of sync
runtime: cannot allocate memory
not inlined: unknown reason

It would be good to have a server-class ARM platform capable of running plan 9 as a more reliable builder. I don't know of one.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 10, 2021

Looks like the filesystem change did resolve at least one class of failure: the '/boot/workdir/go/src/os' does not exit failure mode hasn't occurred at all in November so far.

greplogs --dashboard -md -l -e \''/boot/workdir/go/src/os'\'' does not exist'

2021-10-29T22:29:31-c812b97/plan9-arm
2021-10-25T17:02:16-52b10ab/plan9-arm
2021-10-19T18:18:37-9820602/plan9-arm
2021-10-10T15:11:26-d2d21d9/plan9-arm
2021-10-09T23:29:26-b99abf3/plan9-arm
2021-10-07T19:56:19-4ab3c10/plan9-arm
2021-10-01T18:18:46-0d65c27/plan9-arm
2021-09-27T18:58:36-5b90958/plan9-arm
2021-09-21T20:39:31-48cf96c/plan9-arm
2021-09-21T00:59:39-d1fd3eb/plan9-arm
2021-08-28T01:49:50-f371b30/plan9-arm
2021-08-22T22:04:02-5d5e50c/plan9-arm
2021-08-13T21:43:20-a95f1b5/plan9-arm
2021-07-25T17:16:20-849b791/plan9-arm
2021-06-17T03:25:37-b0355a3/plan9-arm
2021-05-25T23:41:42-74242ba/plan9-arm
2021-03-29T20:35:19-164a626/plan9-arm
2021-03-04T06:36:33-868a110/plan9-arm
2021-02-24T19:25:49-bf48163/plan9-arm
2020-10-13T00:31:47-5ef78c4/plan9-arm
2020-10-12T14:44:34-0f53453/plan9-arm
2020-08-18T15:50:52-b58d297/plan9-arm
2020-05-05T19:42:01-0e617d3/plan9-arm

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/362975 mentions this issue: dashboard: omit the website repo on plan9

gopherbot pushed a commit to golang/build that referenced this issue Nov 11, 2021
dashboard: omit the website repo on plan9
d14234e 
The plan9 builders have relatively slow filesystems, and the website
repo is relatively filesystem-intensive — many of its tests walk and
process large trees of website content.

Instead of trying to precisely tune the x/website tests to pass on the
plan9 builders, let's skip this repo on them.

For golang/go#49338.

Change-Id: Ieaf50fb6955a6b39012a23ff72e61c1c31e4ce7c
Reviewed-on: https://go-review.googlesource.com/c/build/+/362975
Trust: Bryan C. Mills <bcmills@google.com>
Run-TryBot: Bryan C. Mills <bcmills@google.com>
TryBot-Result: Go Bot <gobot@golang.org>
Reviewed-by: Carlos Amedee <carlos@golang.org>
Reviewed-by: Dmitri Shuralyov <dmitshur@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Nov 17, 2021

Many of the failure modes seem to have cleared up around 11 Nov.; it's not clear to me what fixed them.

One of the failures visible on the dashboard today is #49653; the other is the marked free object in span failure mode.

@bcmills
Copy link
Contributor Author

bcmills commented Nov 19, 2021

A few more failure modes that remain:
#22227 (unexpected signal in os.StartProcess)
#49684 (panic during panic)
#49691 (unexpected stale targets)

@gopherbot
Copy link
Contributor

Change https://golang.org/cl/369018 mentions this issue: src/cmd/go/internal/work: lock Builder output mutex consistently

gopherbot pushed a commit that referenced this issue Dec 6, 2021
@millerresearch
src/cmd/go/internal/work: lock Builder output mutex consistently
765cc72 
To prevent interleaving of output when 'go build' compiles several
packages in parallel, the output mutex in the Builder struct must
be locked around any calls to Builder.Print which could generate
arbitrary amounts of text (ie more than is guaranteed to be written
atomically to a pipe).

Fixes #49987
For #49338

Change-Id: I7947df57667deeff3f03f231824298d823f8a943
Reviewed-on: https://go-review.googlesource.com/c/go/+/369018
Reviewed-by: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Trust: Russ Cox <rsc@golang.org>
@gopherbot
Copy link
Contributor

Change https://golang.org/cl/380414 mentions this issue: message/pipeline: skip TestFullCycle on plan9-arm

gopherbot pushed a commit to golang/text that referenced this issue Jan 24, 2022
message/pipeline: skip TestFullCycle on plan9-arm
d1c84af 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@bcmills
Copy link
Contributor Author

bcmills commented Jan 27, 2022

A sampling from the past week or so. Undiagnosed failures in bold.

greplogs --dashboard -md -l -e \\Aplan9-arm -E . --since=2022-01-20

2022-01-27T05:30:27-be5769c-a991d9d/plan9-arm

panic: test timed out after 10m0s
…
goroutine 6 [select, 9 minutes]:
…
golang.org/x/tools/go/packages.goListDriver(0x1695ab84, {0x175c8c78, 0x1, 0x1})
	/boot/workdir/gopath/src/golang.org/x/tools/go/packages/golist.go:200 +0x7b0
…
FAIL	golang.org/x/tools/gopls/doc	600.515s

That's stuck running go list:
https://cs.opensource.google/go/x/tools/+/master:go/packages/golist.go;l=447;drc=eb48d3f608bba06c3bb4f5627f9fc2562cc84dd2

2022-01-27T05:30:27-bbe1937-a991d9d/plan9-arm (#50857)
2022-01-27T05:30:27-aa10faf-a991d9d/plan9-arm (#50857)
2022-01-27T00:03:31-bbe1937-f4aa021/plan9-arm (#50857)
2022-01-26T23:43:39-be5769c-db48840/plan9-arm (probably #46520, not specific to plan9)
2022-01-26T23:43:39-bbe1937-db48840/plan9-arm (#50857)
2022-01-26T22:33:26-ef0b09c/plan9-arm (possibly #22227?)
2022-01-26T22:09:36-bbe1937-ca6a5c0/plan9-arm (#50857)
2022-01-26T21:43:32-be5769c-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T20:51:54-fe74b5f-c8b0dce/plan9-arm (#46520, not specific to plan9)
2022-01-26T17:58:00-bbe1937-719e989/plan9-arm (#50857)
2022-01-25T22:56:45-c20fd7c-6eb58cd/plan9-arm (#46520, not specific to plan9)
2022-01-25T22:04:10-c20fd7c-38729cf/plan9-arm (#46520, not specific to plan9)
2022-01-25T00:39:08-97de9ec-16d6a52/plan9-arm (#46520, not specific to plan9)
2022-01-24T21:27:20-cdd9e93/plan9-arm

--- FAIL: TestIntendedInlining (15.35s)
    inl_test.go:267: exit status: 'go 32037: 2'
FAIL
FAIL	cmd/compile/internal/test	119.720s

2022-01-24T16:42:11-2cc1836-19d819d/plan9-arm (#50775, mitigated)
2022-01-21T23:16:33-3c751cd-b7fa0f9/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-3c751cd-35b0db7/plan9-arm (#50775, mitigated)
2022-01-21T21:58:14-35b0db7/plan9-arm

panic: test timed out after 18m0s
…
goroutine 185 [chan receive, 17 minutes]:
…
os/exec.(*Cmd).CombinedOutput(0x110ae000)
	/boot/workdir/go/src/os/exec/exec.go:567 +0x98 fp=0x11105e2c sp=0x11105e18 pc=0x12b1dc
cmd/compile/internal/test.TestCode(0x10c02f00)
	/boot/workdir/go/src/cmd/compile/internal/test/ssa_test.go:171 +0x9fc fp=0x11105f98 sp=0x11105e2c pc=0x3af55c
…
FAIL	cmd/compile/internal/test	1080.192s

That's running a go test -c subprocess, but without a timeout so we don't get a useful goroutine dump to debug it 😞:
https://cs.opensource.google/go/go/+/master:src/cmd/compile/internal/test/ssa_test.go;l=171;drc=16a3cefc93d9b896b2053320e387d0e449904aba

2022-01-21T21:27:57-e7c9de2-9eba5ff/plan9-arm (#46520, not specific to plan9)
2022-01-21T21:08:53-3425967-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-21T16:59:19-9f83dd3-9eba5ff/plan9-arm (#50775, mitigated)
2022-01-20T20:23:52-80963bc-2c2e081/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:59:17-ab35822-9284279/plan9-arm (#46520, not specific to plan9)
2022-01-20T14:52:25-ab35822-e7d5857/plan9-arm (possibly #45211? if so, not specific to plan9)

@gopherbot
Copy link
Contributor

Change https://go.dev/cl/408697 mentions this issue: dashboard: add known issues for plan9-arm

gopherbot pushed a commit to golang/build that referenced this issue May 26, 2022
@gopherbot
dashboard: add known issue for plan9-arm
560d411 
For golang/go#52653.
Updates golang/go#49338.

Change-Id: Ib23be56bd79bce8b3168cb40064916a2a91dbb88
Reviewed-on: https://go-review.googlesource.com/c/build/+/408697
Auto-Submit: Bryan Mills <bcmills@google.com>
Reviewed-by: Alex Rakoczy <alex@golang.org>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
@seankhliao seankhliao added this to the Unplanned milestone Aug 20, 2022
xhit pushed a commit to xhit/text that referenced this issue Oct 10, 2022
@xhit
message/pipeline: skip TestFullCycle on plan9-arm
dfea723 
This test has timed out several times recently on this builder. The
test is pretty slow even on Linux, and may be especially
filesystem-intensive.

For golang/go#49338

Change-Id: Ife2bb399b10f369f815055bb0ad44bb007f606b7
Reviewed-on: https://go-review.googlesource.com/c/text/+/380414
Trust: Bryan Mills <bcmills@google.com>
Run-TryBot: Bryan Mills <bcmills@google.com>
TryBot-Result: Gopher Robot <gobot@golang.org>
Reviewed-by: Ian Lance Taylor <iant@golang.org>
@gopherbot

This comment was marked as resolved.

Sign in to view
@bcmills bcmills added the arch-arm Issues solely affecting the 32-bit arm architecture. label Dec 6, 2022
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-05 22:01 plan9-arm go@185e1a7b os/exec.TestExtraFilesRace (log) 
--- FAIL: TestExtraFilesRace (0.50s)
    exec_test.go:850: iteration 2, process B got:

        want:
        fd3: listener 127.0.0.1:40881

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-06 20:08 plan9-arm net@1e63c2f0 go@a4a86c7b x/net/http2.TestTransportUsesGoAwayDebugError_Body (log) 
--- FAIL: TestTransportUsesGoAwayDebugError_Body (0.03s)
    transport_test.go:2861: RoundTrip error = http2.GoAwayError: http2.GoAwayError{LastStreamID:0x5, ErrCode:0x0, DebugData:"some debug data"}, want http2.GoAwayError (http2.GoAwayError{LastStreamID:0x5, ErrCode:0xd, DebugData:"some debug data"})

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-22 15:34 plan9-arm benchmarks@03c43f28 go@f721fa3b (log) 
runtime: signal received on thread not created by Go.

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2022-12-01 20:58 plan9-arm go@cc1771e2 net/http.TestOmitHTTP2Vet (log) 
http.test 26576: warning: process exceeds 100 file descriptors
--- FAIL: TestOmitHTTP2Vet (20.57s)
    http_test.go:135: go vet failed: exit status: 'go 26635: 2', fatal error: all goroutines are asleep - deadlock!

        runtime stack:
        runtime.fatal({0x6104f8, 0x25})
        	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffc1c sp=0x3ffffc08 pc=0x3ad1c
        runtime.checkdead()
        	/boot/workdir/go/src/runtime/proc.go:5265 +0x318 fp=0x3ffffc5c sp=0x3ffffc1c pc=0x49858
        runtime.mput(0x983c000)
        	/boot/workdir/go/src/runtime/proc.go:5700 +0x44 fp=0x3ffffc60 sp=0x3ffffc5c pc=0x4b34c
        runtime.stopm()
        	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc74 sp=0x3ffffc60 pc=0x42148
        runtime.findRunnable()
        	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffd14 sp=0x3ffffc74 pc=0x43c9c
        runtime.schedule()
        	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd30 sp=0x3ffffd14 pc=0x44f94
        runtime.park_m(0x96130e0)
        	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd44 sp=0x3ffffd30 pc=0x45784
        runtime.mcall()
        	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd4c sp=0x3ffffd44 pc=0x69814
2022-12-12 22:32 plan9-arm crypto@23edec0b go@357ea858 (log) 
runtime: program exceeds 0-thread limit
fatal error: thread exhaustion

runtime stack:
runtime.throw({0x6018dc, 0x11})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffd84 sp=0x3ffffd70 pc=0x3ac58
runtime.checkmcount()
	/boot/workdir/go/src/runtime/proc.go:789 +0x94 fp=0x3ffffd94 sp=0x3ffffd84 pc=0x3eef0
runtime.mReserveID()
	/boot/workdir/go/src/runtime/proc.go:805 +0x74 fp=0x3ffffda8 sp=0x3ffffd94 pc=0x3ef90
runtime.startm(0x9433300, 0x1)
	/boot/workdir/go/src/runtime/proc.go:2403 +0xb4 fp=0x3ffffdd4 sp=0x3ffffda8 pc=0x422d4
runtime.handoffp(0x9433300)
	/boot/workdir/go/src/runtime/proc.go:2463 +0x390 fp=0x3ffffdfc sp=0x3ffffdd4 pc=0x42870
runtime.retake(0x17310608ee127184)
	/boot/workdir/go/src/runtime/proc.go:5494 +0x2f0 fp=0x3ffffe20 sp=0x3ffffdfc pc=0x4a58c
runtime.sysmon()
	/boot/workdir/go/src/runtime/proc.go:5402 +0x5c0 fp=0x3ffffe8c sp=0x3ffffe20 pc=0x4a0ac
runtime.mstart1()
	/boot/workdir/go/src/runtime/proc.go:1498 +0x7c fp=0x3ffffe9c sp=0x3ffffe8c pc=0x40b88
runtime.mstart0()
	/boot/workdir/go/src/runtime/proc.go:1455 +0x64 fp=0x3ffffeac sp=0x3ffffe9c pc=0x40afc
runtime.mstart()
	/boot/workdir/go/src/runtime/asm_arm.s:210 +0x8 fp=0x3ffffeb0 sp=0x3ffffeac pc=0x697b4
2022-12-12 23:10 plan9-arm go@b16e94d1 (log) 
fatal error: all goroutines are asleep - deadlock!

runtime stack:
runtime.fatal({0x6105a0, 0x25})
	/boot/workdir/go/src/runtime/panic.go:1066 +0x4c fp=0x3ffffbf4 sp=0x3ffffbe0 pc=0x3ad1c
runtime.checkdead()
	/boot/workdir/go/src/runtime/proc.go:5261 +0x318 fp=0x3ffffc34 sp=0x3ffffbf4 pc=0x49858
runtime.mput(0x969c240)
	/boot/workdir/go/src/runtime/proc.go:5696 +0x44 fp=0x3ffffc38 sp=0x3ffffc34 pc=0x4b34c
runtime.stopm()
	/boot/workdir/go/src/runtime/proc.go:2332 +0x5c fp=0x3ffffc4c sp=0x3ffffc38 pc=0x42148
runtime.findRunnable()
	/boot/workdir/go/src/runtime/proc.go:3007 +0xd44 fp=0x3ffffcec sp=0x3ffffc4c pc=0x43c9c
runtime.schedule()
	/boot/workdir/go/src/runtime/proc.go:3360 +0xac fp=0x3ffffd08 sp=0x3ffffcec pc=0x44f94
runtime.park_m(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3511 +0x150 fp=0x3ffffd1c sp=0x3ffffd08 pc=0x45784
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffd24 sp=0x3ffffd1c pc=0x69814
2022-12-13 21:00 plan9-arm benchmarks@555ee2b5 go@357ea858 (log) 
../../../../pkg/mod/cloud.google.com/go@v0.97.0/iam/iam.go:30:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/internal/proto/error.pb.go:27:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:40:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/google.golang.org/grpc@v1.40.0/status/status.go:34:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:28:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/iam.go:24:2: google.golang.org/genproto@v0.0.0-20211021150943-2b146023228c: read "https:/proxy.golang.org/@v/v0.0.0-20211021150943-2b146023228c.zip": unexpected EOF
2022-12-15 00:54 plan9-arm tools@5899b6a2 go@ea14d1b6 (log)
2022-12-23 17:16 plan9-arm go@38cfb3be net.TestPipe (log) 
--- FAIL: TestPipe (120.26s)
    --- FAIL: TestPipe/PresentTimeout (119.92s)
        conntest.go:57: test timed out; terminating pipe
        conntest.go:279: got *errors.errorString: io: read/write on closed pipe, want net.Error
        conntest.go:268: got *errors.errorString: io: read/write on closed pipe, want net.Error
2022-12-29 17:47 plan9-arm go@642fd5f7 net/http.TestServerReadTimeout (log) 
http.test 33195: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h1 (1.60s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:35260: write tcp 127.0.0.1:35327->127.0.0.1:35260: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:35327": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:61614: write tcp 127.0.0.1:63071->127.0.0.1:61614: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:63071": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:48011: write tcp 127.0.0.1:60477->127.0.0.1:48011: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60477": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:58029: read tcp 127.0.0.1:60830->127.0.0.1:58029: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60830": write tcp 127.0.0.1:58029->127.0.0.1:60830: write /net/tcp/106/data: i/o on hungup channel
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:64770": unexpected EOF

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 21:10 plan9-arm benchmarks@33cb3306 go@27b6ace2 (log) 
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.zip: mkdir /boot/workdir/gopath/pkg/mod/github.com/biogo/biogo@v1.0.4/align/matrix/matrices: '/boot/workdir' fossil/fossil: walk: newfid 0x414 in use
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
-> unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/google/pprof/@v/v0.0.0-20211122183932-1daafda22083.zip: open /boot/workdir/gopath/pkg/mod/github.com/google/pprof@v0.0.0-20211122183932-1daafda22083/internal/driver/driver_focus.go: '.../internal/driver/driver_focus.go' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp: '.../cache/download/cloud.google.com/go/storage/@v/v1.18.2.mod867510410.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/!roaring!bitmap' clone failed
go: writing go.mod cache: open /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp: '.../mod/cache/download/github.com/biogo/biogo/@v/v1.0.4.mod315910635.tmp' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/biogo/store/@v' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch: '/boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch' clone failed
go: writing go.mod cache: mkdir /boot/workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment: '.../workdir/gopath/pkg/mod/cache/download/github.com/blevesearch/segment' clone failed
...
sweet/benchmarks/tile38/main.go:27:2: unzip /boot/workdir/gopath/pkg/mod/cache/download/github.com/gomodule/redigo/@v/v1.8.5.zip: open /boot/workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go: '.../workdir/gopath/pkg/mod/github.com/gomodule/redigo@v1.8.5/redis/log.go' clone failed
../../../../pkg/mod/github.com/googleapis/gax-go/v2@v2.1.1/apierror/apierror.go:39:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:32:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/bucket.go:33:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/doc.go:62:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:26:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/acl.go:24:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:50:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/internal/apiv2/storage_client.go:27:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed
../../../../pkg/mod/cloud.google.com/go/storage@v1.18.2/storage.go:51:2: mkdir /boot/workdir/gopath/pkg/mod/cache/download/google.golang.org: '/boot/workdir/gopath/pkg/mod/cache/download/google.golang.org' clone failed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-05 16:42 plan9-arm net@f8411da7 go@cc82867f x/net/http2/h2c.TestPropagation (log) 
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:36015: connection error: COMPRESSION_ERROR
2023/01/25 15:10:33 http2: server connection error from 127.0.0.1:33357: connection error: COMPRESSION_ERROR
2023/01/25 15:10:34 http2: server connection error from 127.0.0.1:60254: connection error: COMPRESSION_ERROR
2023/01/25 15:10:36 http2: server connection error from 127.0.0.1:59038: connection error: COMPRESSION_ERROR
2023/01/25 15:10:40 http2: server connection error from 127.0.0.1:57344: connection error: COMPRESSION_ERROR
2023/01/25 15:10:48 http2: server connection error from 127.0.0.1:42738: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x9212160, 0x920a100, {0x920e0d0, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x92140c0, 0x920a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x92140c0, 0x920a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x920a100, {0x3c0628, 0x92140c0}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x9212100, 0x920a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x9212100, 0x920a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x948
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x92080f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x92080f0, 0x36d90c)
2023-01-19 20:43 plan9-arm go@f89badf6 (log) 
0x9abe000 0x9bc0000
fatal error: bad span state

runtime stack:
runtime.throw({0x5ff570, 0xe})
	/boot/workdir/go/src/runtime/panic.go:1047 +0x4c fp=0x3ffffbdc sp=0x3ffffbc8 pc=0x3ac58
runtime.stackfree({0x9bc0000, 0x9be0000})
	/boot/workdir/go/src/runtime/stack.go:502 +0x1d0 fp=0x3ffffc20 sp=0x3ffffbdc pc=0x524a0
runtime.gfput(0x9436000, 0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:4395 +0x5c fp=0x3ffffc50 sp=0x3ffffc20 pc=0x47a78
runtime.goexit0(0x94033b0)
	/boot/workdir/go/src/runtime/proc.go:3671 +0x2e8 fp=0x3ffffc88 sp=0x3ffffc50 pc=0x460f0
runtime.mcall()
	/boot/workdir/go/src/runtime/asm_arm.s:265 +0x48 fp=0x3ffffc90 sp=0x3ffffc88 pc=0x69814
2023-01-19 20:46 plan9-arm go@e08642ca (log)
2023-01-20 02:42 plan9-arm tools@a7f033af go@c641d48a x/tools/gopls/internal/lsp/filecache.TestConcurrency (log) 
--- FAIL: TestConcurrency (2.30s)
    filecache_test.go:99: open /tmp/gopls/eb948799/TestConcurrency/e0/e05ac03a87bbe7ab6768fe0fb083c0bbd4d325061645abf87964477a4bd35143: '/tmp/gopls' mount rpc error
2023-01-20 17:52 plan9-arm go@1011ccad os.TestDirFS (log) 
os.test 38819: warning: process exceeds 100 file descriptors
os.test 38819: warning: process exceeds 200 file descriptors
os.test 38819: warning: process exceeds 300 file descriptors
os.test 38819: warning: process exceeds 400 file descriptors
os.test 38819: warning: process exceeds 500 file descriptors
os.test 38819: warning: process exceeds 600 file descriptors
os.test 38819: warning: process exceeds 700 file descriptors
os.test 38819: warning: process exceeds 800 file descriptors
os.test 38819: warning: process exceeds 900 file descriptors
os.test 38819: warning: process exceeds 1000 file descriptors
os.test 38819: warning: process exceeds 1100 file descriptors
os.test 38819: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.11s)
    os_test.go:2799: TestFS found errors:
        b: fsys.Stat: stat b: './testdata' file does not exist
2023-01-20 19:38 plan9-arm go@f07910bd os.TestDirFS (log) 
os.test 38798: warning: process exceeds 100 file descriptors
os.test 38798: warning: process exceeds 200 file descriptors
os.test 38798: warning: process exceeds 300 file descriptors
os.test 38798: warning: process exceeds 400 file descriptors
os.test 38798: warning: process exceeds 500 file descriptors
os.test 38798: warning: process exceeds 600 file descriptors
os.test 38798: warning: process exceeds 700 file descriptors
os.test 38798: warning: process exceeds 800 file descriptors
os.test 38798: warning: process exceeds 900 file descriptors
os.test 38798: warning: process exceeds 1000 file descriptors
os.test 38798: warning: process exceeds 1100 file descriptors
os.test 38798: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: fsys.Stat: stat dir: './testdata' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3257637846/testdata/dirfs/a: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3257637846/testdata/issue37161: '/tmp/test3257637846/testdata' does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-20 22:42 plan9-arm go@0518e33f os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.02s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.00s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023-01-20 22:42 plan9-arm go@0518e33f os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023/01/21 02:05:04 open testdata/hello: 'testdata' file does not exist
2023-01-23 18:50 plan9-arm go@b90971b2 os.TestDirFS (log) 
os.test 38679: warning: process exceeds 100 file descriptors
os.test 38679: warning: process exceeds 200 file descriptors
os.test 38679: warning: process exceeds 300 file descriptors
os.test 38679: warning: process exceeds 400 file descriptors
os.test 38679: warning: process exceeds 500 file descriptors
os.test 38679: warning: process exceeds 600 file descriptors
os.test 38679: warning: process exceeds 700 file descriptors
os.test 38679: warning: process exceeds 800 file descriptors
os.test 38679: warning: process exceeds 900 file descriptors
os.test 38679: warning: process exceeds 1000 file descriptors
os.test 38679: warning: process exceeds 1100 file descriptors
os.test 38679: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.13s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        .: fs.ReadDir: open .: './testdata' file does not exist

— watchflakes

@bcmills bcmills mentioned this issue Jan 25, 2023
Closed
@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-24 19:29 plan9-arm go@083d94f6 (log) 
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 24782: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-01-20 09:27 plan9-arm go@1bef0707 os.TestDirFS (log) 
os.test 38845: warning: process exceeds 100 file descriptors
os.test 38845: warning: process exceeds 200 file descriptors
os.test 38845: warning: process exceeds 300 file descriptors
os.test 38845: warning: process exceeds 400 file descriptors
os.test 38845: warning: process exceeds 500 file descriptors
os.test 38845: warning: process exceeds 600 file descriptors
os.test 38845: warning: process exceeds 700 file descriptors
os.test 38845: warning: process exceeds 800 file descriptors
os.test 38845: warning: process exceeds 900 file descriptors
os.test 38845: warning: process exceeds 1000 file descriptors
os.test 38845: warning: process exceeds 1100 file descriptors
os.test 38845: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.08s)
    os_test.go:2799: TestFS found errors:
        b: second Open: open b: './testdata' file does not exist
2023-01-25 16:38 plan9-arm go@1d3088ef os.TestFileReadDir (log) 
os.test 38568: warning: process exceeds 100 file descriptors
os.test 38568: warning: process exceeds 200 file descriptors
os.test 38568: warning: process exceeds 300 file descriptors
os.test 38568: warning: process exceeds 400 file descriptors
os.test 38568: warning: process exceeds 500 file descriptors
os.test 38568: warning: process exceeds 600 file descriptors
os.test 38568: warning: process exceeds 700 file descriptors
os.test 38568: warning: process exceeds 800 file descriptors
os.test 38568: warning: process exceeds 900 file descriptors
os.test 38568: warning: process exceeds 1000 file descriptors
os.test 38568: warning: process exceeds 1100 file descriptors
os.test 38568: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.01s)
        os_test.go:436: stat ./env.go: './env.go' file does not exist
2023-01-25 18:50 plan9-arm go@3c7884a2 (log)
2023-01-26 01:06 plan9-arm go@89de906a os.TestDirFS (log) 
os.test 38675: warning: process exceeds 100 file descriptors
os.test 38675: warning: process exceeds 200 file descriptors
os.test 38675: warning: process exceeds 300 file descriptors
os.test 38675: warning: process exceeds 400 file descriptors
os.test 38675: warning: process exceeds 500 file descriptors
os.test 38675: warning: process exceeds 600 file descriptors
os.test 38675: warning: process exceeds 700 file descriptors
os.test 38675: warning: process exceeds 800 file descriptors
os.test 38675: warning: process exceeds 900 file descriptors
os.test 38675: warning: process exceeds 1000 file descriptors
os.test 38675: warning: process exceeds 1100 file descriptors
os.test 38675: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.07s)
    os_test.go:2799: TestFS found errors:
        dir: Open: open dir: './testdata' file does not exist
2023-01-26 19:45 plan9-arm go@627f1286 os.TestFileReadDir (log) 
os.test 38900: warning: process exceeds 100 file descriptors
os.test 38900: warning: process exceeds 200 file descriptors
os.test 38900: warning: process exceeds 300 file descriptors
os.test 38900: warning: process exceeds 400 file descriptors
os.test 38900: warning: process exceeds 500 file descriptors
os.test 38900: warning: process exceeds 600 file descriptors
os.test 38900: warning: process exceeds 700 file descriptors
os.test 38900: warning: process exceeds 800 file descriptors
os.test 38900: warning: process exceeds 900 file descriptors
os.test 38900: warning: process exceeds 1000 file descriptors
os.test 38900: warning: process exceeds 1100 file descriptors
os.test 38900: warning: process exceeds 1200 file descriptors
--- FAIL: TestFileReadDir (0.00s)
    --- FAIL: TestFileReadDir/. (0.02s)
        os_test.go:436: stat ./dir_unix.go: './dir_unix.go' file does not exist
2023-01-26 21:33 plan9-arm net@296f09aa go@dd44d981 x/net/http2/h2c.TestPropagation (log) 
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:38262: connection error: COMPRESSION_ERROR
2023/02/02 01:48:51 http2: server connection error from 127.0.0.1:61518: connection error: COMPRESSION_ERROR
panic: test timed out after 30m0s
running tests:
	TestPropagation (30m0s)

golang.org/x/net/http2.(*clientConnPool).getClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf}, 0x1)
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:97 +0x1e4
golang.org/x/net/http2.(*clientConnPool).GetClientConn(0x918e1a0, 0x918a100, {0x9184110, 0xf})
	/boot/workdir/gopath/src/golang.org/x/net/http2/client_conn_pool.go:55 +0x3c
golang.org/x/net/http2.(*Transport).RoundTripOpt(0x918c120, 0x918a100, {0x0})
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:554 +0x198
golang.org/x/net/http2.(*Transport).RoundTrip(0x918c120, 0x918a100)
	/boot/workdir/gopath/src/golang.org/x/net/http2/transport.go:513 +0x2c
net/http.send(0x918a100, {0x3bb8b0, 0x918c120}, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:252 +0x52c
net/http.(*Client).send(0x918e140, 0x918a100, {0x0, 0x0, 0x0})
	/boot/workdir/go/src/net/http/client.go:176 +0x94
net/http.(*Client).do(0x918e140, 0x918a100)
	/boot/workdir/go/src/net/http/client.go:716 +0x944
net/http.(*Client).Do(...)
	/boot/workdir/go/src/net/http/client.go:582
golang.org/x/net/http2/h2c.TestPropagation(0x91940f0)
	/boot/workdir/gopath/src/golang.org/x/net/http2/h2c/h2c_test.go:133 +0x500
testing.tRunner(0x91940f0, 0x367b44)
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestWriteAtInAppendMode (log) 
--- FAIL: TestWriteAtInAppendMode (0.00s)
    os_test.go:920: chtmpdir: chdir /boot/workdir/go/src/os: '/boot/workdir/go/src/os' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestOpenFileLimit (log) 
--- FAIL: TestOpenFileLimit (0.00s)
    rlimit_test.go:31: open rlimit.go: 'rlimit.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadDir (log) 
--- FAIL: TestReadDir (0.00s)
    read_test.go:129: ReadDir .: read_test.go file not found
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReadFile (log) 
--- FAIL: TestReadFile (0.00s)
    read_test.go:36: ReadFile read_test.go: open read_test.go: 'read_test.go' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFSRootDir (log) 
--- FAIL: TestDirFSRootDir (0.00s)
    os_test.go:2846: open tmp/test3691254424/testdata/dirfs/a: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestDirFS (log) 
--- FAIL: TestDirFS (0.00s)
    os_test.go:2799: TestFS found errors:
        .: Open: open .: './testdata' file does not exist
        expected but not found: a
        expected but not found: b
        expected but not found: dir/x
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestReaddirSmallSeek (log) 
--- FAIL: TestReaddirSmallSeek (0.00s)
    os_test.go:2706: open /tmp/test3691254424/testdata/issue37161: '/tmp/test3691254424/testdata' does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReadDir (log) 
--- FAIL: TestFileReadDir (0.01s)
    --- FAIL: TestFileReadDir/. (0.00s)
        os_test.go:454: could not find dir_unix.go
        os_test.go:454: could not find env.go
        os_test.go:454: could not find error.go
        os_test.go:454: could not find file.go
        os_test.go:454: could not find os_test.go
        os_test.go:454: could not find types.go
        os_test.go:454: could not find stat_darwin.go
        os_test.go:454: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddir (log) 
--- FAIL: TestFileReaddir (0.01s)
    --- FAIL: TestFileReaddir/. (0.00s)
        os_test.go:399: could not find dir_unix.go
        os_test.go:399: could not find env.go
        os_test.go:399: could not find error.go
        os_test.go:399: could not find file.go
        os_test.go:399: could not find os_test.go
        os_test.go:399: could not find types.go
        os_test.go:399: could not find stat_darwin.go
        os_test.go:399: could not find stat_linux.go
2023-01-26 21:54 plan9-arm go@ea6d4b0e os.TestFileReaddirnames (log) 
--- FAIL: TestFileReaddirnames (0.01s)
    --- FAIL: TestFileReaddirnames/. (0.00s)
        os_test.go:362: could not find dir_unix.go
        os_test.go:362: could not find env.go
        os_test.go:362: could not find error.go
        os_test.go:362: could not find file.go
        os_test.go:362: could not find os_test.go
        os_test.go:362: could not find types.go
        os_test.go:362: could not find stat_darwin.go
        os_test.go:362: could not find stat_linux.go
2023/01/28 18:19:03 open testdata/hello: 'testdata' file does not exist
2023-01-26 21:54 plan9-arm go@ea6d4b0e os/exec (log) 
fork/exec /tmp/go-build985727719/b124/exec.test: '/boot/workdir/go/src/os' does not exist
2023-01-27 03:32 plan9-arm go@4e3abee2 os.TestDirFS (log) 
os.test 36915: warning: process exceeds 100 file descriptors
os.test 36915: warning: process exceeds 200 file descriptors
os.test 36915: warning: process exceeds 300 file descriptors
os.test 36915: warning: process exceeds 400 file descriptors
os.test 36915: warning: process exceeds 500 file descriptors
os.test 36915: warning: process exceeds 600 file descriptors
os.test 36915: warning: process exceeds 700 file descriptors
os.test 36915: warning: process exceeds 800 file descriptors
os.test 36915: warning: process exceeds 900 file descriptors
os.test 36915: warning: process exceeds 1000 file descriptors
os.test 36915: warning: process exceeds 1100 file descriptors
os.test 36915: warning: process exceeds 1200 file descriptors
--- FAIL: TestDirFS (0.16s)
    os_test.go:2799: testing fs.Sub(fsys, dir): TestFS found errors:
        x: Open: open x: './testdata' file does not exist
2023-01-30 16:32 plan9-arm go@87860873 net/http.TestServerReadTimeout (log) 
http.test 28542: warning: process exceeds 100 file descriptors
--- FAIL: TestServerReadTimeout (0.00s)
    --- FAIL: TestServerReadTimeout/h2 (1.22s)
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:43789: write tcp 127.0.0.1:40901->127.0.0.1:43789: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:40901": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:65498: write tcp 127.0.0.1:48431->127.0.0.1:65498: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:48431": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:55311: write tcp 127.0.0.1:60716->127.0.0.1:55311: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:60716": EOF
        clientserver_test.go:210: server log: http: TLS handshake error from 127.0.0.1:56933: write tcp 127.0.0.1:57942->127.0.0.1:56933: i/o timeout
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:57942": EOF
        serve_test.go:746: server timed out reading request body: got err client disconnected; want os.ErrDeadlineExceeded
        serve_test.go:756: Get error, retrying: Post "https://127.0.0.1:41059": local error: tls: bad record MAC
2023-01-30 20:09 plan9-arm go@45bee5e7 os.TestReadFile (log) 
os.test 31035: warning: process exceeds 100 file descriptors
os.test 31035: warning: process exceeds 200 file descriptors
os.test 31035: warning: process exceeds 300 file descriptors
os.test 31035: warning: process exceeds 400 file descriptors
os.test 31035: warning: process exceeds 500 file descriptors
os.test 31035: warning: process exceeds 600 file descriptors
os.test 31035: warning: process exceeds 700 file descriptors
os.test 31035: warning: process exceeds 800 file descriptors
os.test 31035: warning: process exceeds 900 file descriptors
os.test 31035: warning: process exceeds 1000 file descriptors
os.test 31035: warning: process exceeds 1100 file descriptors
os.test 31035: warning: process exceeds 1200 file descriptors
--- FAIL: TestReadFile (0.01s)
    read_test.go:17: Stat "read_test.go" (looking for size 3171): stat read_test.go: 'read_test.go' file does not exist
2023-01-31 19:43 plan9-arm go@b89a840d (log) 
go: no such tool "vet"
go: no such tool "compile"
go tool dist: Failed: exit status: 'go 15678: 2'

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
default <- builder == "plan9-arm"
2023-02-02 23:42 plan9-arm tools@81111180 go@a9648761 x/tools/cmd/bundle.TestBundle (log) 
--- FAIL: TestBundle (5.10s)
    --- FAIL: TestBundle/Modules (1.30s)
        main_test.go:50: failed to load source package

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 16:34 gotip-plan9-arm go@4c3aa5d3 cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2555970042/001/blob.bin: '/tmp/TestTransform2555970042/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (2.74s)
2024-12-04 16:34 gotip-plan9-arm go@4c3aa5d3 cmd/vet.TestVet/assign (log) 
=== RUN   TestVet/assign
=== PAUSE TestVet/assign
=== CONT  TestVet/assign
    vet_test.go:195: error check failed: 
        assign.go:18: missing error "self-assignment of x to x"
        assign.go:20: missing error "self-assignment of s.x to s.x"
        assign.go:22: missing error "self-assignment of s.l.0. to s.l.0."
        Unmatched Errors:
        go: error obtaining buildID for go tool compile: exit status: 'compile 42183: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
--- FAIL: TestVet/assign (3.41s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-03 23:32 x_tools-gotip-plan9-arm tools@61b24083 go@2a0aeb12 x/tools/go/analysis/passes/httpmux.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed
2024-12-04 18:17 x_tools-gotip-plan9-arm tools@e3346967 go@4c3aa5d3 x/tools/go/ssa.TestGenericBodies/p15 [ABORT] (log) 
=== RUN   TestGenericBodies/p15
=== PAUSE TestGenericBodies/p15
=== CONT  TestGenericBodies/p15
2024-12-04 18:17 x_tools-gotip-plan9-arm tools@e3346967 go@4c3aa5d3 x/tools/internal/refactor/inline.TestData/dotimport.txtar [ABORT] (log) 
=== RUN   TestData/dotimport.txtar
=== PAUSE TestData/dotimport.txtar
=== CONT  TestData/dotimport.txtar
2024-12-04 20:58 x_tools-gotip-plan9-arm tools@7eebab3f go@61232096 x/tools/go/callgraph/vta.TestVTAGraphConstruction/testdata/src/maps.go (log) 
=== RUN   TestVTAGraphConstruction/testdata/src/maps.go
    helpers_test.go:70: err: exit status: 'go 110828: 1': stderr: go: error obtaining buildID for go tool compile: exit status: 'compile 110836: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
        
--- FAIL: TestVTAGraphConstruction/testdata/src/maps.go (1.15s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 18:13 gotip-plan9-arm go@6f42fe91 cmd/objdump.TestGoobjFileNumber (log) 
=== RUN   TestGoobjFileNumber
=== PAUSE TestGoobjFileNumber
=== CONT  TestGoobjFileNumber
    objdump_test.go:352: build failed: exit status: 'go 79194: 1'
        cmd/objdump/testdata/testfilenum: /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: exit status: 'compile 79384: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: fd out o'
--- FAIL: TestGoobjFileNumber (6.06s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 22:20 x_tools-gotip-plan9-arm tools@44670c7f go@c46ba1f9 x/tools/gopls/internal/cmd.TestCodeAction (log) 
=== RUN   TestCodeAction
=== PAUSE TestCodeAction
=== CONT  TestCodeAction
    integration_test.go:994: gopls codeaction -kind=source a.go: exited with code 1, want success: true (gopls codeaction -kind=source a.go: exit=1 stdout=<<>> stderr=<<2024/12/05 04:04:39 Error:2024/12/05 04:04:39 warning: diagnostics failed: read /home/swarming/.swarming/w/ir/x/w/goroot/src/internal/goos/nonunix.go: Bad fid
        	view_id="1"
        	snapshot=0
        	directory=.
        gopls: ./a.go: read /home/swarming/.swarming/w/ir/x/w/goroot/src/internal/goos/nonunix.go: Bad fid
        >>)
    integration_test.go:999: codeaction: got <<>>, want <<command	"Browse documentation for package a" [source.doc]
        >>
        stderr:
        2024/12/05 04:04:39 Error:2024/12/05 04:04:39 warning: diagnostics failed: read /home/swarming/.swarming/w/ir/x/w/goroot/src/internal/goos/nonunix.go: Bad fid
        	view_id="1"
        	snapshot=0
        	directory=.
        gopls: ./a.go: read /home/swarming/.swarming/w/ir/x/w/goroot/src/internal/goos/nonunix.go: Bad fid
--- FAIL: TestCodeAction (168.47s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-03 18:35 x_tools-go1.23-plan9-arm tools@7a4f3b03 release-branch.go1.23@194de8fb x/tools/gopls/internal/cmd.TestStats (log) 
=== RUN   TestStats
=== PAUSE TestStats
=== CONT  TestStats
    integration_test.go:909: gopls stats -anon: exited with code 1, want success: true (gopls stats -anon: exit=1 stdout=<<>> stderr=<<Initializing workspace...     panic: /home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build2439615286/b695/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 138 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        panic: /home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build2439615286/b695/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 137 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/check.go:1074 +0x2b4
        panic({0xb5cc20, 0x19fcfc8})
        	/home/swarming/.swarming/w/ir/x/w/goroot/src/runtime/panic.go:785 +0xfc
...
        	/home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/check.go:1120 +0x360
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo521803466/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.9.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 127
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.9.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:913: failed to unmarshal JSON output of stats command: unexpected end of JSON input
--- FAIL: TestStats (24.31s)
2024-12-04 22:20 x_tools-gotip-plan9-arm tools@44670c7f go@795d95d6 x/tools/gopls/internal/cmd.TestFormat (log) 
=== RUN   TestFormat
=== PAUSE TestFormat
=== CONT  TestFormat
    integration_test.go:426: gopls format a.go:1-2: stderr does not match [only full file formatting supported]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo320628810/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build779497728/b721/cmd.test: fd out of range or not open
        	panic: invalid handle
        
        goroutine 110 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo320628810/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x1b7e528, {0xfdf570, 0x1801d40}, 0x1a7c280)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo320628810/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo320628810/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 150
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestFormat (56.02s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 22:20 x_tools-gotip-plan9-arm tools@44670c7f go@32ff485c x/tools/go/analysis/passes/tests.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 17:30 gotip-plan9-arm go@d241ea8d cmd/link/internal/ld.TestUndefinedRelocErrors (log) 
=== RUN   TestUndefinedRelocErrors
=== PAUSE TestUndefinedRelocErrors
=== CONT  TestUndefinedRelocErrors
    ld_test.go:66: unmatched error: function main is undeclared in the main package (x1)
    ld_test.go:66: unmatched error: main.defined1: relocation target main.undefined not defined (x1)
    ld_test.go:66: unmatched error: main.defined2: relocation target main.undefined not defined (x1)
    ld_test.go:75: unexpected error: go: error obtaining buildID for go tool compile: exit status: 'compile 36859: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid' (x1)
--- FAIL: TestUndefinedRelocErrors (3.74s)
2024-12-04 20:58 x_tools-gotip-plan9-arm tools@7eebab3f go@c46ba1f9 x/tools/cmd/stringer.TestMultifileStringer/package_over_test_package (log) 
=== RUN   TestMultifileStringer/package_over_test_package
    multifile_test.go:406: stringer: starting GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 133.159471ms for GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestMultifileStringerpackage_over_test_package1646115854/001
        stringer: 1.161554574s for GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 4.472727055s for GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/tmp/TestMultifileStringerpackage_over_test_package1646115854/001 go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestMultifileStringerpackage_over_test_package1646115854/001
        stringer: error: no packages matching /tmp/TestMultifileStringerpackage_over_test_package1646115854/001
    multifile_test.go:408: run stringer: /home/swarming/.swarming/w/ir/x/t/go-build1305727155/b402/stringer.test -type=Foo /tmp/TestMultifileStringerpackage_over_test_package1646115854/001: exit status: 'stringer.test 15436: 1'
--- FAIL: TestMultifileStringer/package_over_test_package (4.70s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 18:17 x_tools-gotip-plan9-arm tools@e3346967 go@c46ba1f9 x/tools/gopls/internal/cmd.TestCodeLens [ABORT] (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-03 21:57 x_tools-gotip-plan9-arm tools@399ee16d go@c46ba1f9 x/tools/refactor/eg.Test/testdata/g.txtar (log) 
=== RUN   Test/testdata/g.txtar
    eg_test.go:82: err: exit status: 'go 162154: 2': stderr: panic: runtime.errorString("integer divide by zero")
        fatal error: panic on system stack
        
        runtime stack:
        runtime.throw({0x73bcde, 0x15})
        	runtime/panic.go:1099 +0x34 fp=0x3ffffb44 sp=0x3ffffb30 pc=0x7464c
        panic({0x6cbd00, 0xbacf00})
        	runtime/panic.go:751 +0x2f8 fp=0x3ffffb98 sp=0x3ffffb44 pc=0x7449c
        runtime.panicdivide()
...
        os/exec.(*Cmd).Start.func2(0x1348160)
        	os/exec/exec.go:749 +0x30 fp=0x1268fe4 sp=0x1268fb4 pc=0x14183c
        os/exec.(*Cmd).Start.gowrap1()
        	os/exec/exec.go:761 +0x30 fp=0x1268fec sp=0x1268fe4 pc=0x1417e0
        runtime.goexit({})
        	runtime/asm_arm.s:884 +0x4 fp=0x1268fec sp=0x1268fec pc=0x7ac24
        created by os/exec.(*Cmd).Start in goroutine 81
        	os/exec/exec.go:748 +0x8f8
        
--- FAIL: Test/testdata/g.txtar (1.75s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-03 21:26 x_tools-gotip-plan9-arm tools@25b0003b go@c46ba1f9 x/tools/cmd/stringer.TestEndToEnd/day.go (log) 
=== RUN   TestEndToEnd/day.go
    endtoend_test.go:343: run: day.go Day
    endtoend_test.go:351: stringer: starting GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 122.405747ms for GOROOT= GOPATH= GO111MODULE=off GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -e -f {{context.ReleaseTags}} -- unsafe
        stringer: starting GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestEndToEndday.go887940820/001/day.go
        stringer: 1.317068717s for GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -tags= -f "{{context.GOARCH}} {{context.Compiler}}" -- unsafe
        stringer: 8.346280728s for GOROOT= GOPATH= GO111MODULE=auto GOPROXY= PWD=/home/swarming/.swarming/w/ir/x/w/targetrepo2979839965/cmd/stringer go list -tags= -e -json=Name,ImportPath,Error,Dir,GoFiles,IgnoredGoFiles,IgnoredOtherFiles,CFiles,CgoFiles,CXXFiles,MFiles,HFiles,FFiles,SFiles,SwigFiles,SwigCXXFiles,SysoFiles,TestGoFiles,XTestGoFiles,CompiledGoFiles,DepOnly,Imports,ImportMap,TestImports,XTestImports,Export,Module -compiled=true -test=true -export=true -deps=true -find=false -pgo=off -tags= -- /tmp/TestEndToEndday.go887940820/001/day.go
    endtoend_test.go:356: wirep: p->m=19341320(6) p->status=1
        fatal error: wirep: invalid p state
...
        os/exec.(*Cmd).Start.func2(0x142e930)
        	os/exec/exec.go:749 +0x30 fp=0x146efe4 sp=0x146efb4 pc=0x14183c
        os/exec.(*Cmd).Start.gowrap1()
        	os/exec/exec.go:761 +0x30 fp=0x146efec sp=0x146efe4 pc=0x1417e0
        runtime.goexit({})
        	runtime/asm_arm.s:884 +0x4 fp=0x146efec sp=0x146efec pc=0x7ac24
        created by os/exec.(*Cmd).Start in goroutine 38
        	os/exec/exec.go:748 +0x8f8
    endtoend_test.go:358: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go run /tmp/TestEndToEndday.go887940820/001/Day_string.go /tmp/TestEndToEndday.go887940820/001/day.go: exit status: 'go 6544: 2'
--- FAIL: TestEndToEnd/day.go (11.00s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-04 22:20 gotip-plan9-arm go@c46ba1f9 cmd/cover.TestCoverWithToolExec/FuncWithDuplicateLines (log) 
=== RUN   TestCoverWithToolExec/FuncWithDuplicateLines
=== PAUSE TestCoverWithToolExec/FuncWithDuplicateLines
=== CONT  TestCoverWithToolExec/FuncWithDuplicateLines
    cover_test.go:542: running [/home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -toolexec=/home/swarming/.swarming/w/ir/x/t/go-build1279992165/b2932/cover.test -cover -covermode count -coverprofile /tmp/cmd-cover-test-2535617772/004/linedup/linedup.out]
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -toolexec=/home/swarming/.swarming/w/ir/x/t/go-build1279992165/b2932/cover.test -cover -covermode count -coverprofile /tmp/cmd-cover-test-2535617772/004/linedup/linedup.out
    cover_test.go:542: exit status: 'go 67055: kill'
--- FAIL: TestCoverWithToolExec/FuncWithDuplicateLines (2427.88s)
2024-12-04 22:20 gotip-plan9-arm go@c46ba1f9 internal/trace.TestTraceAnnotations/Default (log) 
=== RUN   TestTraceAnnotations/Default
    trace_test.go:608: stderr: # runtime
        ../../runtime/mheap.go:2360:11: I/O error: read ../../runtime/mheap.go: Bad fid
        ../../runtime/mheap.go:2360:11: syntax error: unexpected EOF, expected (
    trace_test.go:610: exit status: 'go 54088: 1'
--- FAIL: TestTraceAnnotations/Default (19.29s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-05 17:15 gotip-plan9-arm go@be0c4547 cmd/compile/internal/test.TestIntendedInlining (log) 
=== RUN   TestIntendedInlining
=== PAUSE TestIntendedInlining
=== CONT  TestIntendedInlining
    inl_test.go:351: exit status: 'go 68914: 1'
--- FAIL: TestIntendedInlining (20.04s)
2024-12-05 17:48 gotip-plan9-arm go@be297ba9 net/http.Test304Responses/h1 [ABORT] (log) 
=== RUN   Test304Responses/h1
=== PAUSE Test304Responses/h1
2024-12-05 19:35 gotip-plan9-arm go@32e19fc4 cmd/compile/internal/test.TestScanfRemoval (log) 
=== RUN   TestScanfRemoval
=== PAUSE TestScanfRemoval
=== CONT  TestScanfRemoval
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /tmp/TestScanfRemoval3342483565/001/test /tmp/TestScanfRemoval3342483565/001/test.go
    global_test.go:47: could not build target: exit status: 'go 73065: kill'
--- FAIL: TestScanfRemoval (2284.87s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-06 00:07 gotip-plan9-arm go@ea867378 cmd/link.TestLargeReloc (log) 
=== RUN   TestLargeReloc
=== PAUSE TestLargeReloc
=== CONT  TestLargeReloc
    link_test.go:1179: build failed: exit status: 'go 78882: 1'. output:
        # command-line-arguments
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/4c/4c8bdbd36e816b26071dae277f9fc146c12c81f51c82b3bd323b4185b1932d99-d: Bad fid
--- FAIL: TestLargeReloc (29.04s)
2024-12-06 00:35 gotip-plan9-arm go@4da905bc cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform1346921287/001/blob.bin: '/tmp/TestTransform1346921287/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform1346921287/001/blob.bin: '/tmp/TestTransform1346921287/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform1346921287/001/blob.bin: '/tmp/TestTransform1346921287/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform1346921287/001/blob.bin: '/tmp/TestTransform1346921287/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform1346921287/001/blob.bin: '/tmp/TestTransform1346921287/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (2.22s)
2024-12-06 00:35 gotip-plan9-arm go@4da905bc cmd/link.TestTrampoline (log) 
=== RUN   TestTrampoline
=== PAUSE TestTrampoline
=== CONT  TestTrampoline
    link_test.go:771: build (default) failed: exit status: 'go 31410: 1'
        # command-line-arguments
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/bd/bd09ad1bd9e29306c9c0aed5c33baf7a2b2f4b954605ba4f7a2f4729e9ed9204-d: fd out of range or not open
--- FAIL: TestTrampoline (11.32s)
2024-12-06 02:16 gotip-plan9-arm go@3ae00f5d cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3082881086/001/blob.bin: '/tmp/TestTransform3082881086/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (2.91s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-05 19:15 gotip-plan9-arm go@1fe65836 cmd/compile/internal/importer.TestIssue13898 (log) 
=== RUN   TestIssue13898
    gcimporter_test.go:475: can't find import: "go/internal/gcimporter": go: error obtaining buildID for go tool asm: exit status: 'asm 70105: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
        
--- FAIL: TestIssue13898 (3.53s)
2024-12-05 21:03 gotip-plan9-arm go@5213e1e5 cmd/objdump.TestGoobjFileNumber (log) 
=== RUN   TestGoobjFileNumber
=== PAUSE TestGoobjFileNumber
=== CONT  TestGoobjFileNumber
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /tmp/TestGoobjFileNumber2076408253/001/p.a
    objdump_test.go:352: build failed: exit status: 'go 80259: kill'
--- FAIL: TestGoobjFileNumber (2413.94s)
2024-12-05 21:03 gotip-plan9-arm go@5213e1e5 runtime.TestFakeTime (log) 
=== RUN   TestFakeTime
=== PAUSE TestFakeTime
=== CONT  TestFakeTime
    crash_test.go:169: running /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /tmp/go-build1921196518/testfaketime_-tags=faketime.exe -tags=faketime
    time_test.go:32: building testfaketime [-tags=faketime]: exit status: 'go 64857: 2'
        fatal error: runtime.SetFinalizer: pointer not in allocated block
        
        goroutine 27 gp=0x117b688 m=4 mp=0x104f808 [running]:
        runtime.throw({0x75566c, 0x34})
        	runtime/panic.go:1099 +0x34 fp=0x11d6eec sp=0x11d6ed8 pc=0x7464c
...
        cmd/go/internal/work.(*Builder).Do.func3({0x84dac8, 0xbc6608}, 0x141eb68)
        	cmd/go/internal/work/exec.go:153 +0x86c fp=0x10f3f80 sp=0x10f3e98 pc=0x531a20
        cmd/go/internal/work.(*Builder).Do.func4()
        	cmd/go/internal/work/exec.go:225 +0xc0 fp=0x10f3fec sp=0x10f3f80 pc=0x531018
        runtime.goexit({})
        	runtime/asm_arm.s:884 +0x4 fp=0x10f3fec sp=0x10f3fec pc=0x7ac24
        created by cmd/go/internal/work.(*Builder).Do in goroutine 1
        	cmd/go/internal/work/exec.go:211 +0x36c
        
--- FAIL: TestFakeTime (5.07s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-05 18:54 gotip-plan9-arm go@c3a706e1 compress/zlib (log) 
cpu: can't authenticate: pi4h: fd out of range or not open
FAIL	compress/zlib	0.078s

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-05 18:27 gotip-plan9-arm go@aa464fb9 cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3994276109/001/blob.bin: '/tmp/TestTransform3994276109/001/blob.bin' mountrpc: Rerror
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform3994276109/001/blob.bin: '/tmp/TestTransform3994276109/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (2.27s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-06 21:00 gotip-plan9-arm go@0d453232 cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform4115774830/001/blob.bin: '/tmp/TestTransform4115774830/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (2.16s)
2024-12-06 21:15 gotip-plan9-arm go@312f7c1b cmd/compile/internal/test.TestPGOIntendedInliningShiftedLines (log) 
=== RUN   TestPGOIntendedInliningShiftedLines
=== PAUSE TestPGOIntendedInliningShiftedLines
=== CONT  TestPGOIntendedInliningShiftedLines
    pgo_inl_test.go:40: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -o /tmp/TestPGOIntendedInliningShiftedLines2508510384/001/test.exe -gcflags=-m -m -pgoprofile=inline_hot.pprof -d=pgoinlinebudget=160,pgoinlinecdfthreshold=90
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -o /tmp/TestPGOIntendedInliningShiftedLines2508510384/001/test.exe -gcflags=-m -m -pgoprofile=inline_hot.pprof -d=pgoinlinebudget=160,pgoinlinecdfthreshold=90
    pgo_inl_test.go:43: build failed: exit status: 'go 74523: kill', output:
--- FAIL: TestPGOIntendedInliningShiftedLines (2224.66s)
2024-12-07 00:43 gotip-plan9-arm go@04cdaa99 cmd/compile/internal/test.TestIntendedInlining (log) 
=== RUN   TestIntendedInlining
=== PAUSE TestIntendedInlining
=== CONT  TestIntendedInlining
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -gcflags=-m -m -tags=math_big_pure_go bytes internal/abi encoding/base64 sync/atomic internal/runtime/math compress/flate unicode/utf8 sync unicode/utf16 reflect regexp runtime internal/runtime/sys math/big math/rand net
    inl_test.go:351: exit status: 'go 116945: kill'
--- FAIL: TestIntendedInlining (2254.46s)
2024-12-07 02:32 gotip-plan9-arm go@8c3e3915 cmd/compile/internal/test.TestDashS (log) 
=== RUN   TestDashS
=== PAUSE TestDashS
=== CONT  TestDashS
    global_test.go:88: could not build target: exit status: 'go 28199: 1'
        # command-line-arguments
        main.main STEXT size=112 args=0x0 locals=0x28 funcid=0x0 align=0x0
        	0x0000 00000 (/tmp/TestDashS3660662836/001/test.go:4)	TEXT	main.main(SB), ABIInternal, $40-0
        	0x0000 00000 (/tmp/TestDashS3660662836/001/test.go:4)	MOVW	8(g), R1
        	0x0004 00004 (/tmp/TestDashS3660662836/001/test.go:4)	PCDATA	$0, $-2
        	0x0004 00004 (/tmp/TestDashS3660662836/001/test.go:4)	CMP	R1, R13
...
        	rel 16+4 t=R_ADDROFF runtime.gcbits.02000000+0
        gclocals·3JsCmIFFkMo//DqIlUb8iw== SRODATA dupok size=10
        	0x0000 02 00 00 00 02 00 00 00 03 00                    ..........
        gclocals·acF1O9X4FQHZUTLQivBEZA== SRODATA dupok size=8
        	0x0000 02 00 00 00 00 00 00 00                          ........
        type:.eq.sync/atomic.Pointer[os.dirInfo].arginfo1 SRODATA static dupok size=3
        	0x0000 04 04 ff                                         ...
        # command-line-arguments
        link: cannot read object file:read /home/swarming/.swarming/w/ir/x/w/gocache/ab/ab8f5048556a06e5e6b12099b1989f0b633652219c90970310f1c0d59c6b0be8-d: Bad fid
--- FAIL: TestDashS (18.93s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-06 19:33 gotip-plan9-arm go@24407179 cmd/go/internal/lockedfile.TestTransform (log) 
=== RUN   TestTransform
    transform_test.go:95: unexpected error from Transform: open /tmp/TestTransform2750564468/001/blob.bin: '/tmp/TestTransform2750564468/001/blob.bin' mountrpc: Rerror
--- FAIL: TestTransform (3.90s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-06 19:32 gotip-plan9-arm go@1a193b43 cmd/nm.TestGoLib (log) 
=== RUN   TestGoLib
=== PAUSE TestGoLib
=== CONT  TestGoLib
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -buildmode=archive -o mylib.a .
    nm_test.go:229: building test lib failed: exit status: 'go 35344: kill' 
--- FAIL: TestGoLib (2428.98s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-06 19:32 gotip-plan9-arm go@1a193b43 internal/trace.TestTraceCPUProfile/Default (log) 
=== RUN   TestTraceCPUProfile/Default
    trace_test.go:608: stderr: # strings
        ../../strings/iter.go:149:1: I/O error: read ../../strings/iter.go: Bad fid
    trace_test.go:610: exit status: 'go 12347: 1'
--- FAIL: TestTraceCPUProfile/Default (9.55s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 18:37 x_tools-go1.23-plan9-arm tools@bf32f4d8 release-branch.go1.23@194de8fb x/tools/go/analysis/passes/unusedresult.Test [ABORT] (log) 
=== RUN   Test
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 18:41 gotip-plan9-arm go@6705ac68 cmd/compile/internal/test.TestPGOPreprocessDevirtualize (log) 
=== RUN   TestPGOPreprocessDevirtualize
=== PAUSE TestPGOPreprocessDevirtualize
=== CONT  TestPGOPreprocessDevirtualize
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go test .
    pgo_devirtualize_test.go:45: Test without PGO:
    pgo_devirtualize_test.go:47: Test failed without PGO: exit status: 'go 26853: kill'
--- FAIL: TestPGOPreprocessDevirtualize (2262.06s)
2024-12-09 18:41 gotip-plan9-arm go@6705ac68 cmd/link.TestRandLayout (log) 
=== RUN   TestRandLayout
=== PAUSE TestRandLayout
=== CONT  TestRandLayout
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -ldflags=-randlayout=456 -o /tmp/TestRandLayout2652293682/001/hello456.exe /tmp/TestRandLayout2652293682/001/hello.go
    link_test.go:1480: seed=456: build failed: exit status: 'go 33917: kill'
--- FAIL: TestRandLayout (2390.12s)
2024-12-09 18:41 gotip-plan9-arm go@6705ac68 internal/trace.TestTraceAnnotations/Default (log) 
=== RUN   TestTraceAnnotations/Default
    trace_test.go:608: stderr: # syscall
        ../../syscall/syscall_plan9.go:237:11: undefined: Stat
        ../../syscall/syscall_plan9.go:403:3: undefined: d
        ../../syscall/syscall_plan9.go:403:4: I/O error: read ../../syscall/syscall_plan9.go: Bad fid
        ../../syscall/syscall_plan9.go:403:4: missing return
    trace_test.go:610: exit status: 'go 10962: 1'
--- FAIL: TestTraceAnnotations/Default (49.20s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 18:37 x_tools-gotip-plan9-arm tools@bf32f4d8 go@07398d2e x/tools/go/ssa.TestGenericBodies/p12 [ABORT] (log) 
=== RUN   TestGenericBodies/p12
=== PAUSE TestGenericBodies/p12
=== CONT  TestGenericBodies/p12
2024-12-09 18:37 x_tools-gotip-plan9-arm tools@bf32f4d8 go@07398d2e x/tools/gopls/internal/cmd.TestCodeLens [ABORT] (log) 
=== RUN   TestCodeLens
=== PAUSE TestCodeLens
=== CONT  TestCodeLens
2024-12-09 21:41 x_tools-gotip-plan9-arm tools@c2df0efd go@d87878c6 x/tools/gopls/internal/analysis/useany.Test (log) 
=== RUN   Test
    analysistest.go:352: go tool not available: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /dev/null /tmp/testenv-494626130/main.go: exit status: 'go 35241: 1'
        go: error obtaining buildID for go tool asm: exit status: 'asm 35316: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: Bad fid'
--- FAIL: Test (4.93s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 19:46 x_tools-go1.24-plan9-arm tools@98c17f1e release-branch.go1.24@26682773 x/tools/go/ssa/ssautil.TestCreateProgram (log) 
=== RUN   TestCreateProgram
read /home/swarming/.swarming/w/ir/x/w/goroot/src/internal/goos/nonunix.go: Bad fid
    deprecated_test.go:34: couldn't load packages due to errors: internal/goos
--- FAIL: TestCreateProgram (25.64s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 20:00 x_tools-gotip-plan9-arm tools@ecb0abc0 go@d87878c6 x/tools/internal/refactor/inline.TestData/embed.txtar (log) 
=== RUN   TestData/embed.txtar
=== PAUSE TestData/embed.txtar
=== CONT  TestData/embed.txtar
    inline_test.go:138: /tmp/TestDataembed.txtar791580475/001/a/a.go:6:11: @inline(F, in x.F, implicit reference to unexported field .unexported cannot be made explicit): callee package had errors
--- FAIL: TestData/embed.txtar (5.97s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 23:42 x_tools-go1.24-plan9-arm tools@3689f0b0 release-branch.go1.24@26682773 x/tools/gopls/internal/cmd.TestSymbols (log) 
=== RUN   TestSymbols
=== PAUSE TestSymbols
=== CONT  TestSymbols
    integration_test.go:786: gopls symbols a.go:123:456: exited with code 1, want success: true (gopls symbols a.go:123:456: exit=1 stdout=<<>> stderr=<<Error: Error loading workspace folders (expected 1, got 0)
        failed to load view for file://.: err: exit status: 'go 80832: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/bin/go: Bad fid': stderr: 
        
        gopls: no views
        >>)
    integration_test.go:787: gopls symbols a.go:123:456: stdout does not match [f Function 2:6-2:7]; got <<>>
    integration_test.go:788: gopls symbols a.go:123:456: stdout does not match [v Variable 3:5-3:6]; got <<>>
    integration_test.go:789: gopls symbols a.go:123:456: stdout does not match [c Constant 4:7-4:8]; got <<>>
--- FAIL: TestSymbols (1.52s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 23:42 x_tools-gotip-plan9-arm tools@3689f0b0 go@d87878c6 x/tools/gopls/internal/cmd.TestDefinition (log) 
=== RUN   TestDefinition
=== PAUSE TestDefinition
=== CONT  TestDefinition
    integration_test.go:269: gopls definition a.go:7:2: exited with code 1, want success: true (gopls definition a.go:7:2: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo4255770036/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build2177921232/b724/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 606 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo4255770036/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        	/home/swarming/.swarming/w/ir/x/w/targetrepo4255770036/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo4255770036/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 557
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:270: gopls definition a.go:7:2: stdout does not match [a.go:3:6-7: defined here as func f]; got <<>>
--- FAIL: TestDefinition (81.30s)
2024-12-10 18:15 x_tools-gotip-plan9-arm tools@5e47a3db go@fce17b0c x/tools/cmd/stringer.TestMultifileStringer/package_over_test_package [ABORT] (log) 
=== RUN   TestMultifileStringer/package_over_test_package
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-09 23:22 x_tools-go1.23-plan9-arm tools@2cc4218b release-branch.go1.23@194de8fb x/tools/gopls/internal/cmd.TestDefinition (log) 
=== RUN   TestDefinition
=== PAUSE TestDefinition
=== CONT  TestDefinition
    integration_test.go:275: gopls definition a.go:4:7: exited with code 1, want success: true (gopls definition a.go:4:7: exit=1 stdout=<<>> stderr=<<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo305770924/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build1097227957/b698/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 589 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo305770924/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo305770924/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 568
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>)
    integration_test.go:276: gopls definition a.go:4:7: stdout does not match [print.go.* defined here as func fmt.Println]; got <<>>
    integration_test.go:277: gopls definition a.go:4:7: stdout does not match [Println formats using the default formats for its operands]; got <<>>
--- FAIL: TestDefinition (54.14s)
2024-12-09 23:42 x_tools-go1.23-plan9-arm tools@3689f0b0 release-branch.go1.23@194de8fb x/tools/gopls/internal/cmd.TestLinks [ABORT] (log) 
=== RUN   TestLinks
=== PAUSE TestLinks
=== CONT  TestLinks
2024-12-10 18:15 x_tools-go1.23-plan9-arm tools@5e47a3db release-branch.go1.23@194de8fb x/tools/internal/refactor/inline.TestData/std-internal.txtar (log) 
=== RUN   TestData/std-internal.txtar
=== PAUSE TestData/std-internal.txtar
=== CONT  TestData/std-internal.txtar
    inline_test.go:76: Load: err: exit status: 'go 24382: 1': stderr: go: error obtaining buildID for go tool asm: exit status: 'asm 24538: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/asm: fd out of range '
--- FAIL: TestData/std-internal.txtar (3.44s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-10 18:14 gotip-plan9-arm go@fce17b0c cmd/vet.TestVet/copylock (log) 
=== RUN   TestVet/copylock
=== PAUSE TestVet/copylock
=== CONT  TestVet/copylock
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go vet -vettool=/home/swarming/.swarming/w/ir/x/t/go-build1908413302/b3319/vet.test -printfuncs=Warn,Warnf cmd/vet/testdata/copylock
    vet_test.go:195: error check failed: copylock.go:14: missing error "assignment copies lock value to \\*p: sync.Mutex"
--- FAIL: TestVet/copylock (2385.99s)
2024-12-10 19:03 gotip-plan9-arm go@e6de1b2d cmd/compile/internal/test.TestPGOIntendedInliningShiftedLines (log) 
=== RUN   TestPGOIntendedInliningShiftedLines
=== PAUSE TestPGOIntendedInliningShiftedLines
=== CONT  TestPGOIntendedInliningShiftedLines
    pgo_inl_test.go:40: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go test -c -o /tmp/TestPGOIntendedInliningShiftedLines3777430539/001/test.exe -gcflags=-m -m -pgoprofile=inline_hot.pprof -d=pgoinlinebudget=160,pgoinlinecdfthreshold=90
    pgo_inl_test.go:43: build failed: exit status: 'go 68189: 1', output:
        # example.com/pgo/inline [example.com/pgo/inline.test]
        ./inline_hot.go:26:6: can inline D with cost 7 as: func(uint) int { return int((i + uint(63)) >> uint(6)) }
        ./inline_hot.go:30:6: can inline N with cost 20 as: func(uint) *BS { bs = &BS{...}; return bs }
        ./inline_hot.go:39:6: can inline (*BS).S with cost 14 as: method(*BS) func(uint) *BS { b.s[i >> uint(6)] |= uint64(1) << (i & uint(63)); return b }
        ./inline_hot.go:51:6: can inline T with cost 12 as: func(uint64) uint { return uint(jn[v & -v * uint64(285870213051353865) >> uint(58)]) }
...
        ./inline_hot.go:52:16: index bounds check elided
        ./inline_hot.go:63:15: index bounds check elided
        ./inline_hot.go:68:28: index bounds check elided
        ./inline_hot.go:83:19: index bounds check elided
        ./inline_hot.go:83:19: index bounds check elided
        ./inline_hot.go:83:38: index bounds check elided
        ./inline_hot.go:83:38: index bounds check elided
        # example.com/pgo/inline.test
        $WORK/b001/_testmain.go:9:2: could not import testing (read /home/swarming/.swarming/w/ir/x/w/gocache/80/8018acc5b20d08ac3543450a98b8f7b9eb50c799015993f6ef845ed0702ec1df-d: Bad fid)
--- FAIL: TestPGOIntendedInliningShiftedLines (23.27s)
2024-12-10 19:03 gotip-plan9-arm go@e6de1b2d cmd/link.TestCheckLinkname/push.go (log) 
=== RUN   TestCheckLinkname/push.go
=== PAUSE TestCheckLinkname/push.go
=== CONT  TestCheckLinkname/push.go
    exec.go:213: test timed out while running command: /home/swarming/.swarming/w/ir/x/w/goroot/bin/go build -o /tmp/TestCheckLinkname1924947604/001/push.go.exe testdata/linkname/push.go
    link_test.go:1534: build failed unexpectedly: exit status: 'go 75269: kill':
--- FAIL: TestCheckLinkname/push.go (2326.64s)
2024-12-10 19:03 gotip-plan9-arm go@e6de1b2d go/build.TestVendorPackages (log) 
=== RUN   TestVendorPackages
    vendor_test.go:34: exit status: 'go 45744: 1'
--- FAIL: TestVendorPackages (60.30s)

— watchflakes

@gopherbot
Copy link
Contributor

Found new dashboard test flakes for:

#!watchflakes
post <- builder ~ `plan9-arm`
2024-12-10 18:15 x_tools-gotip-plan9-arm tools@5e47a3db go@4ce116a8 x/tools/go/ssa.TestGenericBodies/p02 (log) 
=== RUN   TestGenericBodies/p02
=== PAUSE TestGenericBodies/p02
=== CONT  TestGenericBodies/p02
    testutil_test.go:117: err: exit status: 'go 22429: 1': stderr: go: error obtaining buildID for go tool compile: exit status: 'compile 22458: i/o error in demand load accessing /home/swarming/.swarming/w/ir/x/w/goroot/pkg/tool/plan9_arm/compile: Bad fid'
        
--- FAIL: TestGenericBodies/p02 (1.69s)
2024-12-10 18:15 x_tools-gotip-plan9-arm tools@5e47a3db go@4ce116a8 x/tools/gopls/internal/cmd.TestRename (log) 
=== RUN   TestRename
=== PAUSE TestRename
=== CONT  TestRename
    integration_test.go:751: gopls rename a.go:1:9 newname: stderr does not match [cannot rename package: module path .* same as the package path, so .* no effect]; got <<panic: /home/swarming/.swarming/w/ir/x/w/targetrepo712180008/gopls/internal/cache/check.go:1291: internal error reading typerefs data: can't hash gopls executable: can't read executable: read /home/swarming/.swarming/w/ir/x/t/go-build2692494402/b724/cmd.test: Bad fid
        	panic: invalid handle
        
        goroutine 46 [running]:
        golang.org/x/tools/gopls/internal/cache.assert(...)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo712180008/gopls/internal/cache/debug.go:10
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle.func1()
...
        golang.org/x/tools/gopls/internal/cache.(*packageHandleBuilder).evaluatePackageHandle(0x1aba4c8, {0xfe0778, 0x201fc20}, 0x19f5e80)
        	/home/swarming/.swarming/w/ir/x/w/targetrepo712180008/gopls/internal/cache/check.go:1120 +0x354
        golang.org/x/tools/gopls/internal/cache.(*Snapshot).getPackageHandles.func2.1()
        	/home/swarming/.swarming/w/ir/x/w/targetrepo712180008/gopls/internal/cache/check.go:896 +0xd4
        golang.org/x/sync/errgroup.(*Group).Go.func1()
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:78 +0x50
        created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 44
        	/home/swarming/.swarming/w/ir/x/w/gopath/pkg/mod/golang.org/x/sync@v0.10.0/errgroup/errgroup.go:75 +0xa0
        >>
--- FAIL: TestRename (25.80s)
2024-12-10 18:15 x_tools-gotip-plan9-arm tools@5e47a3db go@4ce116a8 x/tools/internal/drivertest.TestDriverConformance/std [ABORT] (log) 
=== RUN   TestDriverConformance/std
*** Test killed with quit: ran too long (11m0s).
signal: killed

— watchflakes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-arm Issues solely affecting the 32-bit arm architecture. NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Projects
Test Flakes
Status: Active
Milestone
Unplanned
Development

No branches or pull requests
5 participants
@bcmills @oridb @gopherbot @seankhliao @millerresearch