Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jobs: TestJobControlByType failed #101427

Closed
cockroach-teamcity opened this issue Apr 13, 2023 · 13 comments
Closed

jobs: TestJobControlByType failed #101427

cockroach-teamcity opened this issue Apr 13, 2023 · 13 comments
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Apr 13, 2023

jobs.TestJobControlByType failed with artifacts on master @ 678cfd4cbebbf3cced16747baf42a4c54cb2a92d:

        	            	856244052251607041  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-13 08:42:27.586576 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.586576 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.586576 +0000 +0000  0  NULL  NULL
        	            	856244052497989633  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:27.661769 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.661769 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.661769 +0000 +0000  0  NULL  NULL
        	            	856244052748337153  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:27.738167 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.738167 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.738167 +0000 +0000  0  NULL  NULL
        	            	856244052988362753  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:27.811409 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.811409 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.811409 +0000 +0000  0  NULL  NULL
        	            	856244053214134273  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:27.880313 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.880313 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.880313 +0000 +0000  0  NULL  NULL
        	            	856244053437054977  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:27.948349 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:27.948349 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:27.948349 +0000 +0000  0  NULL  NULL
        	            	856244053676195841  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:28.021323 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.021323 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.021323 +0000 +0000  0  NULL  NULL
        	            	856244053911535617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:28.093148 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.093148 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.093148 +0000 +0000  0  NULL  NULL
        	            	856244054188949505  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:28.177809 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.177809 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.177809 +0000 +0000  0  NULL  NULL
        	            	856244054199533569  AUTO CREATE STATS                Table statistics refresh for system.public.zones                                             CREATE STATISTICS __auto__ FROM [5] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'   root      {}  succeeded         NULL  2023-04-13 08:42:28.181027 +0000 +0000  2023-04-13 08:42:28.332668 +0000 +0000  2023-04-13 08:42:28.887459 +0000 +0000  2023-04-13 08:42:28.887522 +0000 +0000  1  NULL    1     7535424326656802504  2023-04-13 08:42:28.332683 +0000 +0000  2023-04-14 08:42:28.332683 +0000 +0000  1  NULL  NULL
        	            	856244054435430401  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:28.253033 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.253033 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.253033 +0000 +0000  0  NULL  NULL
        	            	856244054664019969  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:28.322787 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.322787 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.322787 +0000 +0000  0  NULL  NULL
        	            	856244054906404865  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:28.396765 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.396765 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.396765 +0000 +0000  0  NULL  NULL
        	            	856244055147249665  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:28.470258 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.470258 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.470258 +0000 +0000  0  NULL  NULL
        	            	856244055376527361  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:28.540226 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.540226 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.540226 +0000 +0000  0  NULL  NULL
        	            	856244055602659329  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:28.609242 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.609242 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.609242 +0000 +0000  0  NULL  NULL
        	            	856244055828791297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:28.678246 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.678246 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.678246 +0000 +0000  0  NULL  NULL
        	            	856244056077107201  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:28.754031 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.754031 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.754031 +0000 +0000  0  NULL  NULL
        	            	856244056320114689  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:28.828182 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.828182 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.828182 +0000 +0000  0  NULL  NULL
        	            	856244056544411649  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:28.896639 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.896639 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.896639 +0000 +0000  0  NULL  NULL
        	            	856244056775753729  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 08:42:28.967237 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:28.967237 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:28.967237 +0000 +0000  0  NULL  NULL
        	            	856244057002344449  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 08:42:29.036386 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.036386 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.036386 +0000 +0000  0  NULL  NULL
        	            	856244057227558913  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 08:42:29.10511 +0000 +0000   NULL                                    NULL                                    2023-04-13 08:42:29.10511 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.10511 +0000 +0000   0  NULL  NULL
        	            	856244057453559809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.174149 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.174149 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.174149 +0000 +0000  0  NULL  NULL
        	            	856244057658032129  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.23649 +0000 +0000   NULL                                    NULL                                    2023-04-13 08:42:29.23649 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.23649 +0000 +0000   0  NULL  NULL
        	            	856244057867124737  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.300296 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.300296 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.300296 +0000 +0000  0  NULL  NULL
        	            	856244058084081665  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.366498 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.366498 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.366498 +0000 +0000  0  NULL  NULL
        	            	856244058299105281  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.432131 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.432131 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.432131 +0000 +0000  0  NULL  NULL
        	            	856244058523074561  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 08:42:29.500478 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.500478 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.500478 +0000 +0000  0  NULL  NULL
        	            	856244058539720705  AUTO CREATE STATS                Table statistics refresh for system.public.tenants                                           CREATE STATISTICS __auto__ FROM [8] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'   root      {}  succeeded         NULL  2023-04-13 08:42:29.505537 +0000 +0000  2023-04-13 08:42:29.652395 +0000 +0000  2023-04-13 08:42:30.387035 +0000 +0000  2023-04-13 08:42:30.38709 +0000 +0000   1  NULL    1     3759566828776646065  2023-04-13 08:42:29.65245 +0000 +0000   2023-04-14 08:42:29.65245 +0000 +0000   1  NULL  NULL
        	            	856244058751074305  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:29.570052 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.570052 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.570052 +0000 +0000  0  NULL  NULL
        	            	856244058985037825  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:29.641452 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.641452 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.641452 +0000 +0000  0  NULL  NULL
        	            	856244059234697217  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 08:42:29.717642 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.717642 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.717642 +0000 +0000  0  NULL  NULL
        	            	856244059478523905  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:29.792055 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.792055 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.792055 +0000 +0000  0  NULL  NULL
        	            	856244059745812481  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:29.87362 +0000 +0000   NULL                                    NULL                                    2023-04-13 08:42:29.87362 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.87362 +0000 +0000   0  NULL  NULL
        	            	856244059963260929  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 08:42:29.939988 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:29.939988 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:29.939988 +0000 +0000  0  NULL  NULL
        	            	856244060212330497  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:30.015996 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.015996 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.015996 +0000 +0000  0  NULL  NULL
        	            	856244060450324481  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:30.088627 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.088627 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.088627 +0000 +0000  0  NULL  NULL
        	            	856244060681437185  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 08:42:30.159155 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.159155 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.159155 +0000 +0000  0  NULL  NULL
        	            	856244060938698753  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:30.23766 +0000 +0000   NULL                                    NULL                                    2023-04-13 08:42:30.23766 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.23766 +0000 +0000   0  NULL  NULL
        	            	856244061175775233  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:30.310015 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.310015 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.310015 +0000 +0000  0  NULL  NULL
        	            	856244061416259585  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 08:42:30.383404 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.383404 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.383404 +0000 +0000  0  NULL  NULL
        	            	856244061654843393  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:30.456228 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.456228 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.456228 +0000 +0000  0  NULL  NULL
        	            	856244061882056705  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:30.525561 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.525561 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.525561 +0000 +0000  0  NULL  NULL
        	            	856244062118838273  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 08:42:30.597813 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.597813 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.597813 +0000 +0000  0  NULL  NULL
        	            	856244062344511489  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:30.66669 +0000 +0000   NULL                                    NULL                                    2023-04-13 08:42:30.66669 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.66669 +0000 +0000   0  NULL  NULL
        	            	856244062579032065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:30.738271 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.738271 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.738271 +0000 +0000  0  NULL  NULL
        	            	856244062710300673  AUTO CREATE STATS                Table statistics refresh for system.public.span_stats_unique_keys                            CREATE STATISTICS __auto__ FROM [54] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-13 08:42:30.778308 +0000 +0000  2023-04-13 08:42:30.927478 +0000 +0000  NULL                                    2023-04-13 08:42:30.877361 +0000 +0000  0  NULL    1     274420133712231749   2023-04-13 08:42:30.927494 +0000 +0000  2023-04-14 08:42:30.927494 +0000 +0000  1  NULL  NULL
        	            	856244062816043009  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 08:42:30.810579 +0000 +0000  NULL                                    NULL                                    2023-04-13 08:42:30.810579 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 08:42:30.810579 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_RESTORE_JOBS (8.79s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

/cc @cockroachdb/jobs @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-26945

@cockroach-teamcity cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels Apr 13, 2023
@cockroach-teamcity cockroach-teamcity added this to the 23.1 milestone Apr 13, 2023
@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 678cfd4cbebbf3cced16747baf42a4c54cb2a92d:

        	            	856247503602810881  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-13 09:00:00.855416 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:00.855416 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:00.855416 +0000 +0000  0  NULL  NULL
        	            	856247503763668993  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-13 09:00:00.904499 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:00.904499 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:00.904499 +0000 +0000  0  NULL  NULL
        	            	856247503919349761  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-13 09:00:00.951989 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:00.951989 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:00.951989 +0000 +0000  0  NULL  NULL
        	            	856247504075030529  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:00.99954 +0000 +0000   NULL                                    NULL                                    2023-04-13 09:00:00.99954 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:00.99954 +0000 +0000   0  NULL  NULL
        	            	856247504218292225  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:01.043241 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.043241 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.043241 +0000 +0000  0  NULL  NULL
        	            	856247504375021569  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:01.091041 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.091041 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.091041 +0000 +0000  0  NULL  NULL
        	            	856247504531718145  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:01.138884 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.138884 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.138884 +0000 +0000  0  NULL  NULL
        	            	856247504674455553  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:01.182427 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.182427 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.182427 +0000 +0000  0  NULL  NULL
        	            	856247504825253889  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:01.228456 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.228456 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.228456 +0000 +0000  0  NULL  NULL
        	            	856247504974151681  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:01.273886 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.273886 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.273886 +0000 +0000  0  NULL  NULL
        	            	856247505113481217  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:01.316439 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.316439 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.316439 +0000 +0000  0  NULL  NULL
        	            	856247505262936065  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:01.362024 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.362024 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.362024 +0000 +0000  0  NULL  NULL
        	            	856247505430085633  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:01.413042 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.413042 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.413042 +0000 +0000  0  NULL  NULL
        	            	856247505581539329  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:01.459269 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.459269 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.459269 +0000 +0000  0  NULL  NULL
        	            	856247505722146817  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:01.50216 +0000 +0000   NULL                                    NULL                                    2023-04-13 09:00:01.50216 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.50216 +0000 +0000   0  NULL  NULL
        	            	856247505854922753  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:01.542677 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.542677 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.542677 +0000 +0000  0  NULL  NULL
        	            	856247506011127809  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:01.590341 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.590341 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.590341 +0000 +0000  0  NULL  NULL
        	            	856247506156486657  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:01.634701 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.634701 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.634701 +0000 +0000  0  NULL  NULL
        	            	856247506309644289  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:01.681442 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.681442 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.681442 +0000 +0000  0  NULL  NULL
        	            	856247506458050561  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:01.726747 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.726747 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.726747 +0000 +0000  0  NULL  NULL
        	            	856247506604130305  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:01.771314 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.771314 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.771314 +0000 +0000  0  NULL  NULL
        	            	856247506738348033  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 09:00:01.812311 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.812311 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.812311 +0000 +0000  0  NULL  NULL
        	            	856247506871451649  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 09:00:01.852915 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.852915 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.852915 +0000 +0000  0  NULL  NULL
        	            	856247507007832065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-13 09:00:01.894518 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.894518 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.894518 +0000 +0000  0  NULL  NULL
        	            	856247507139756033  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:01.934791 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.934791 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.934791 +0000 +0000  0  NULL  NULL
        	            	856247507286425601  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:01.979531 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:01.979531 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:01.979531 +0000 +0000  0  NULL  NULL
        	            	856247507412385793  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:02.017975 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.017975 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.017975 +0000 +0000  0  NULL  NULL
        	            	856247507541655553  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:02.057428 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.057428 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.057428 +0000 +0000  0  NULL  NULL
        	            	856247507679543297  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:02.099505 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.099505 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.099505 +0000 +0000  0  NULL  NULL
        	            	856247507812810753  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-13 09:00:02.140173 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.140173 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.140173 +0000 +0000  0  NULL  NULL
        	            	856247507947225089  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:02.181192 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.181192 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.181192 +0000 +0000  0  NULL  NULL
        	            	856247508085833729  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:02.223494 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.223494 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.223494 +0000 +0000  0  NULL  NULL
        	            	856247508227194881  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-13 09:00:02.266639 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.266639 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.266639 +0000 +0000  0  NULL  NULL
        	            	856247508358430721  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:02.306695 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.306695 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.306695 +0000 +0000  0  NULL  NULL
        	            	856247508489043969  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:02.346549 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.346549 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.346549 +0000 +0000  0  NULL  NULL
        	            	856247508623753217  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-13 09:00:02.387653 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.387653 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.387653 +0000 +0000  0  NULL  NULL
        	            	856247508751286273  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:02.426573 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.426573 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.426573 +0000 +0000  0  NULL  NULL
        	            	856247508879966209  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:02.465843 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.465843 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.465843 +0000 +0000  0  NULL  NULL
        	            	856247509006024705  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-13 09:00:02.504328 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.504328 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.504328 +0000 +0000  0  NULL  NULL
        	            	856247509133197313  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:02.543151 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.543151 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.543151 +0000 +0000  0  NULL  NULL
        	            	856247509280129025  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:02.587964 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.587964 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.587964 +0000 +0000  0  NULL  NULL
        	            	856247509412315137  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-13 09:00:02.628311 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.628311 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.628311 +0000 +0000  0  NULL  NULL
        	            	856247509535916033  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:02.666033 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.666033 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.666033 +0000 +0000  0  NULL  NULL
        	            	856247509661384705  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:02.70432 +0000 +0000   NULL                                    NULL                                    2023-04-13 09:00:02.70432 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.70432 +0000 +0000   0  NULL  NULL
        	            	856247509787017217  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-13 09:00:02.74266 +0000 +0000   NULL                                    NULL                                    2023-04-13 09:00:02.74266 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.74266 +0000 +0000   0  NULL  NULL
        	            	856247509911535617  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:02.780664 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.780664 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.780664 +0000 +0000  0  NULL  NULL
        	            	856247510040608769  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:02.820063 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.820063 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.820063 +0000 +0000  0  NULL  NULL
        	            	856247510208380929  AUTO CREATE STATS                Table statistics refresh for system.public.database_role_settings                            CREATE STATISTICS __auto__ FROM [44] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-13 09:00:02.871225 +0000 +0000  2023-04-13 09:00:02.973143 +0000 +0000  NULL                                    2023-04-13 09:00:02.939336 +0000 +0000  0  NULL    1     5740139508248560329  2023-04-13 09:00:02.973148 +0000 +0000  2023-04-14 09:00:02.973148 +0000 +0000  1  NULL  NULL
        	            	856247510267822081  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-13 09:00:02.889379 +0000 +0000  NULL                                    NULL                                    2023-04-13 09:00:02.889379 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-13 09:00:02.889379 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_RESTORE_JOBS (7.81s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 8e6cdbd8b3d12ba5d65db101a3abfeb2cb1bf470:

        	            	856537279879151617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:33:53.556894 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.556894 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.556894 +0000 +0000  0  NULL  NULL
        	            	856537280106659841  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:53.62634 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:33:53.62634 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.62634 +0000 +0000   0  NULL  NULL
        	            	856537280339771393  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:53.697478 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.697478 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.697478 +0000 +0000  0  NULL  NULL
        	            	856537280582713345  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:53.771608 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.771608 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.771608 +0000 +0000  0  NULL  NULL
        	            	856537280797736961  AUTO CREATE STATS                Table statistics refresh for system.public.protected_ts_meta                                 CREATE STATISTICS __auto__ FROM [31] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-14 09:33:53.83721 +0000 +0000   2023-04-14 09:33:53.987447 +0000 +0000  2023-04-14 09:33:54.619433 +0000 +0000  2023-04-14 09:33:54.619483 +0000 +0000  1  NULL    1     367938187135144525   2023-04-14 09:33:53.987466 +0000 +0000  2023-04-15 09:33:53.987466 +0000 +0000  1  NULL  NULL
        	            	856537280817135617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:33:53.843142 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.843142 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.843142 +0000 +0000  0  NULL  NULL
        	            	856537281046839297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:33:53.913245 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.913245 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.913245 +0000 +0000  0  NULL  NULL
        	            	856537281291059201  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:33:53.987793 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:53.987793 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:53.987793 +0000 +0000  0  NULL  NULL
        	            	856537281523154945  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:54.058606 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.058606 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.058606 +0000 +0000  0  NULL  NULL
        	            	856537281769439233  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:54.133765 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.133765 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.133765 +0000 +0000  0  NULL  NULL
        	            	856537282014773249  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:54.208639 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.208639 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.208639 +0000 +0000  0  NULL  NULL
        	            	856537282244640769  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:54.27879 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:33:54.27879 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.27879 +0000 +0000   0  NULL  NULL
        	            	856537282483945473  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:54.351814 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.351814 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.351814 +0000 +0000  0  NULL  NULL
        	            	856537282723151873  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:54.424812 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.424812 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.424812 +0000 +0000  0  NULL  NULL
        	            	856537283002597377  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:54.510093 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.510093 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.510093 +0000 +0000  0  NULL  NULL
        	            	856537283229876225  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:54.579456 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.579456 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.579456 +0000 +0000  0  NULL  NULL
        	            	856537283466067969  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:54.651535 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.651535 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.651535 +0000 +0000  0  NULL  NULL
        	            	856537283699998721  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:54.722927 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.722927 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.722927 +0000 +0000  0  NULL  NULL
        	            	856537284013752321  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:54.818697 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:54.818697 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.818697 +0000 +0000  0  NULL  NULL
        	            	856537284270620673  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:54.89708 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:33:54.89708 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.89708 +0000 +0000   0  NULL  NULL
        	            	856537284475256833  AUTO CREATE STATS                Table statistics refresh for system.public.protected_ts_records                              CREATE STATISTICS __auto__ FROM [32] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-14 09:33:54.959507 +0000 +0000  2023-04-14 09:33:55.104247 +0000 +0000  2023-04-14 09:33:55.848255 +0000 +0000  2023-04-14 09:33:55.848304 +0000 +0000  1  NULL    1     7113032043484842463  2023-04-14 09:33:55.104263 +0000 +0000  2023-04-15 09:33:55.104263 +0000 +0000  1  NULL  NULL
        	            	856537284524081153  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:54.974416 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.046063 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:54.974416 +0000 +0000  0  NULL  NULL
        	            	856537284750868481  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.043636 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.135203 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.043636 +0000 +0000  0  NULL  NULL
        	            	856537284987060225  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.115704 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.222669 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.115704 +0000 +0000  0  NULL  NULL
        	            	856537285240487937  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.193047 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.621994 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.193047 +0000 +0000  0  NULL  NULL
        	            	856537285467963393  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.262479 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.707078 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.262479 +0000 +0000  0  NULL  NULL
        	            	856537285702451201  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.334035 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.795111 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.334035 +0000 +0000  0  NULL  NULL
        	            	856537285961580545  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:33:55.41312 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:33:55.41312 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.41312 +0000 +0000   0  NULL  NULL
        	            	856537286196199425  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:33:55.484708 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:55.484708 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.484708 +0000 +0000  0  NULL  NULL
        	            	856537286429016065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:33:55.555776 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:55.555776 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.555776 +0000 +0000  0  NULL  NULL
        	            	856537286653804545  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:55.624358 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:55.624358 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.624358 +0000 +0000  0  NULL  NULL
        	            	856537286888685569  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:55.696047 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:55.696047 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.696047 +0000 +0000  0  NULL  NULL
        	            	856537287121960961  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:33:55.767227 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:55.767227 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.767227 +0000 +0000  0  NULL  NULL
        	            	856537287367262209  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.842096 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.353913 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.842096 +0000 +0000  0  NULL  NULL
        	            	856537287607025665  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:55.915259 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.440374 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:55.915259 +0000 +0000  0  NULL  NULL
        	            	856537287890829313  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:56.001869 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:58.527386 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.001869 +0000 +0000  0  NULL  NULL
        	            	856537288120795137  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:56.07205 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:33:56.07205 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.07205 +0000 +0000   0  NULL  NULL
        	            	856537288371175425  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:56.148461 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.148461 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.148461 +0000 +0000  0  NULL  NULL
        	            	856537288596652033  AUTO CREATE STATS                Table statistics refresh for system.public.sqlliveness                                       CREATE STATISTICS __auto__ FROM [39] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-14 09:33:56.21725 +0000 +0000   2023-04-14 09:33:56.365939 +0000 +0000  2023-04-14 09:33:56.969323 +0000 +0000  2023-04-14 09:33:56.969369 +0000 +0000  1  NULL    1     6875751753018300026  2023-04-14 09:33:56.365953 +0000 +0000  2023-04-15 09:33:56.365953 +0000 +0000  1  NULL  NULL
        	            	856537288613724161  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:33:56.222474 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.222474 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.222474 +0000 +0000  0  NULL  NULL
        	            	856537288840085505  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:56.291563 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.291563 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.291563 +0000 +0000  0  NULL  NULL
        	            	856537289074966529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:56.363244 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.363244 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.363244 +0000 +0000  0  NULL  NULL
        	            	856537289304309761  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:33:56.433227 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.433227 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.433227 +0000 +0000  0  NULL  NULL
        	            	856537289536503809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:56.504089 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.504089 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.504089 +0000 +0000  0  NULL  NULL
        	            	856537289788162049  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:56.580889 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.580889 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.580889 +0000 +0000  0  NULL  NULL
        	            	856537290040606721  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:33:56.657928 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.657928 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.657928 +0000 +0000  0  NULL  NULL
        	            	856537290277748737  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:56.730297 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.730297 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.730297 +0000 +0000  0  NULL  NULL
        	            	856537290515611649  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:56.802886 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.802886 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.802886 +0000 +0000  0  NULL  NULL
        	            	856537290740596737  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:33:56.871544 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:33:56.871544 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:33:56.871544 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/pause_ALL_RESTORE_JOBS (10.39s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 8e6cdbd8b3d12ba5d65db101a3abfeb2cb1bf470:

        	            	856540192436453377  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:42.398866 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.398866 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.398866 +0000 +0000  0  NULL  NULL
        	            	856540192584728577  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:42.444108 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.444108 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.444108 +0000 +0000  0  NULL  NULL
        	            	856540192721305601  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:42.485796 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.485796 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.485796 +0000 +0000  0  NULL  NULL
        	            	856540192874496001  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:42.532537 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.532537 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.532537 +0000 +0000  0  NULL  NULL
        	            	856540193024311297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:42.578258 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.578258 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.578258 +0000 +0000  0  NULL  NULL
        	            	856540193174880257  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:42.624213 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.624213 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.624213 +0000 +0000  0  NULL  NULL
        	            	856540193312440321  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:48:42.666186 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.666186 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.666186 +0000 +0000  0  NULL  NULL
        	            	856540193449771009  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:48:42.708106 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.708106 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.708106 +0000 +0000  0  NULL  NULL
        	            	856540193603977217  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-14 09:48:42.755159 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.755159 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.755159 +0000 +0000  0  NULL  NULL
        	            	856540193750089729  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:42.799748 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.799748 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.799748 +0000 +0000  0  NULL  NULL
        	            	856540193893122049  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:42.8434 +0000 +0000    NULL                                    NULL                                    2023-04-14 09:48:42.8434 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.8434 +0000 +0000    0  NULL  NULL
        	            	856540194031730689  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:42.885693 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.885693 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.885693 +0000 +0000  0  NULL  NULL
        	            	856540194176499713  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:42.929887 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.929887 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.929887 +0000 +0000  0  NULL  NULL
        	            	856540194326609921  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:42.975685 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:42.975685 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:42.975685 +0000 +0000  0  NULL  NULL
        	            	856540194469707777  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:43.019369 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.019369 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.019369 +0000 +0000  0  NULL  NULL
        	            	856540194629943297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:43.068284 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.068284 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.068284 +0000 +0000  0  NULL  NULL
        	            	856540194834219009  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:43.130599 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.130599 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.130599 +0000 +0000  0  NULL  NULL
        	            	856540194851618817  AUTO CREATE STATS                Table statistics refresh for system.public.statement_diagnostics                             CREATE STATISTICS __auto__ FROM [36] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-14 09:48:43.135886 +0000 +0000  2023-04-14 09:48:43.238102 +0000 +0000  2023-04-14 09:48:45.133091 +0000 +0000  2023-04-14 09:48:45.133223 +0000 +0000  1  NULL    1     8396028096655328381  2023-04-14 09:48:43.238108 +0000 +0000  2023-04-15 09:48:43.238108 +0000 +0000  1  NULL  NULL
        	            	856540194972729345  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:43.172881 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.172881 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.172881 +0000 +0000  0  NULL  NULL
        	            	856540195107864577  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.214106 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.214106 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.214106 +0000 +0000  0  NULL  NULL
        	            	856540195252273153  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.258187 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.258187 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.258187 +0000 +0000  0  NULL  NULL
        	            	856540195410673665  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.306526 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.306526 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.306526 +0000 +0000  0  NULL  NULL
        	            	856540195569303553  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.354926 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:48.640651 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.354926 +0000 +0000  0  NULL  NULL
        	            	856540195712532481  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.398646 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:48.713866 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.398646 +0000 +0000  0  NULL  NULL
        	            	856540195897016321  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.454937 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:48.792965 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.454937 +0000 +0000  0  NULL  NULL
        	            	856540196077305857  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.509988 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.564665 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.509988 +0000 +0000  0  NULL  NULL
        	            	856540196216406017  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.552421 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.642887 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.552421 +0000 +0000  0  NULL  NULL
        	            	856540196357799937  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.595561 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.717318 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.595561 +0000 +0000  0  NULL  NULL
        	            	856540196492967937  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:43.636815 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.636815 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.636815 +0000 +0000  0  NULL  NULL
        	            	856540196666179585  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:43.689664 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.689664 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.689664 +0000 +0000  0  NULL  NULL
        	            	856540196802985985  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-14 09:48:43.731422 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.731422 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.731422 +0000 +0000  0  NULL  NULL
        	            	856540196946477057  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:43.775217 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.775217 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.775217 +0000 +0000  0  NULL  NULL
        	            	856540197090394113  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:43.819127 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.819127 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.819127 +0000 +0000  0  NULL  NULL
        	            	856540197263802369  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-14 09:48:43.872049 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:43.872049 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.872049 +0000 +0000  0  NULL  NULL
        	            	856540197510905857  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:43.947457 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.338422 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:43.947457 +0000 +0000  0  NULL  NULL
        	            	856540197746147329  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:44.019256 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.410971 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.019256 +0000 +0000  0  NULL  NULL
        	            	856540197895110657  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:44.064717 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:49.483256 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.064717 +0000 +0000  0  NULL  NULL
        	            	856540198101221377  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:44.127614 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.127614 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.127614 +0000 +0000  0  NULL  NULL
        	            	856540198252281857  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:44.173706 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.173706 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.173706 +0000 +0000  0  NULL  NULL
        	            	856540198401048577  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-14 09:48:44.219145 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.219145 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.219145 +0000 +0000  0  NULL  NULL
        	            	856540198545489921  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:44.263187 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.263187 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.263187 +0000 +0000  0  NULL  NULL
        	            	856540198701137921  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:44.31069 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:48:44.31069 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.31069 +0000 +0000   0  NULL  NULL
        	            	856540198872547329  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-14 09:48:44.363009 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.363009 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.363009 +0000 +0000  0  NULL  NULL
        	            	856540199023050753  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:44.408931 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.408931 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.408931 +0000 +0000  0  NULL  NULL
        	            	856540199166017537  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:44.45256 +0000 +0000   NULL                                    NULL                                    2023-04-14 09:48:44.45256 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.45256 +0000 +0000   0  NULL  NULL
        	            	856540199311048705  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-14 09:48:44.496816 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.496816 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.496816 +0000 +0000  0  NULL  NULL
        	            	856540199452540929  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:44.539998 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.539998 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.539998 +0000 +0000  0  NULL  NULL
        	            	856540199593082881  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:44.582895 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.582895 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.582895 +0000 +0000  0  NULL  NULL
        	            	856540199733723137  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-14 09:48:44.625811 +0000 +0000  NULL                                    NULL                                    2023-04-14 09:48:44.625811 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-14 09:48:44.625811 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/pause_ALL_RESTORE_JOBS (11.92s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 51fcf796c5595549e90fca3cc1fd8165ee14fd6c:

        	            	856816799335415809  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:15:36.125335 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.125335 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.125335 +0000 +0000  0  NULL  NULL
        	            	856816799573573633  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:15:36.198015 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.198015 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.198015 +0000 +0000  0  NULL  NULL
        	            	856816799825690625  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:36.274952 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.274952 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.274952 +0000 +0000  0  NULL  NULL
        	            	856816800073318401  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:36.350532 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.350532 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.350532 +0000 +0000  0  NULL  NULL
        	            	856816800363151361  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:36.43898 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:15:36.43898 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.43898 +0000 +0000   0  NULL  NULL
        	            	856816800605536257  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:36.512955 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.512955 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.512955 +0000 +0000  0  NULL  NULL
        	            	856816800862502913  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:36.591367 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.591367 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.591367 +0000 +0000  0  NULL  NULL
        	            	856816801104625665  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:36.665248 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.665248 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.665248 +0000 +0000  0  NULL  NULL
        	            	856816801343471617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:36.738146 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.738146 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.738146 +0000 +0000  0  NULL  NULL
        	            	856816801596604417  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:36.815399 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.815399 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.815399 +0000 +0000  0  NULL  NULL
        	            	856816801839415297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:36.8895 +0000 +0000    NULL                                    NULL                                    2023-04-15 09:15:36.8895 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.8895 +0000 +0000    0  NULL  NULL
        	            	856816802080653313  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:36.963121 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:36.963121 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:36.963121 +0000 +0000  0  NULL  NULL
        	            	856816802316484609  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:37.035089 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.035089 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.035089 +0000 +0000  0  NULL  NULL
        	            	856816802579644417  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:37.115408 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.115408 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.115408 +0000 +0000  0  NULL  NULL
        	            	856816802670215169  AUTO CREATE STATS                Table statistics refresh for system.public.statement_activity                                CREATE STATISTICS __auto__ FROM [60] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-15 09:15:37.143019 +0000 +0000  2023-04-15 09:15:37.29231 +0000 +0000   2023-04-15 09:15:39.170981 +0000 +0000  2023-04-15 09:15:39.171114 +0000 +0000  1  NULL    1     2066778565261286400  2023-04-15 09:15:37.292325 +0000 +0000  2023-04-16 09:15:37.292325 +0000 +0000  1  NULL  NULL
        	            	856816802823995393  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.189973 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.189973 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.189973 +0000 +0000  0  NULL  NULL
        	            	856816803061727233  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.262516 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.262516 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.262516 +0000 +0000  0  NULL  NULL
        	            	856816803298902017  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.334897 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.334897 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.334897 +0000 +0000  0  NULL  NULL
        	            	856816803556130817  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:37.413425 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.413425 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.413425 +0000 +0000  0  NULL  NULL
        	            	856816803832430593  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:37.497735 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.497735 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.497735 +0000 +0000  0  NULL  NULL
        	            	856816804089331713  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:37.576115 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.576115 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.576115 +0000 +0000  0  NULL  NULL
        	            	856816804328800257  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.649205 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.649205 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.649205 +0000 +0000  0  NULL  NULL
        	            	856816804562567169  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.720546 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.720546 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.720546 +0000 +0000  0  NULL  NULL
        	            	856816804790927361  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.79023 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:15:37.79023 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.79023 +0000 +0000   0  NULL  NULL
        	            	856816805035606017  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.864906 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.864906 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.864906 +0000 +0000  0  NULL  NULL
        	            	856816805274124289  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:37.937694 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:37.937694 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:37.937694 +0000 +0000  0  NULL  NULL
        	            	856816805510643713  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:38.009867 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.009867 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.009867 +0000 +0000  0  NULL  NULL
        	            	856816805745852417  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:38.081644 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.081644 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.081644 +0000 +0000  0  NULL  NULL
        	            	856816805981782017  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:38.153648 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.153648 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.153648 +0000 +0000  0  NULL  NULL
        	            	856816806216728577  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:38.225352 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.225352 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.225352 +0000 +0000  0  NULL  NULL
        	            	856816806451511297  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:38.297 +0000 +0000     NULL                                    NULL                                    2023-04-15 09:15:38.297 +0000 +0000     0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.297 +0000 +0000     0  NULL  NULL
        	            	856816806684721153  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:38.368174 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.368174 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.368174 +0000 +0000  0  NULL  NULL
        	            	856816806920192001  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:15:38.440032 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.440032 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.440032 +0000 +0000  0  NULL  NULL
        	            	856816807193968641  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:38.523579 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.523579 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.523579 +0000 +0000  0  NULL  NULL
        	            	856816807432192001  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:38.596281 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.596281 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.596281 +0000 +0000  0  NULL  NULL
        	            	856816807671988225  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:15:38.669452 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.669452 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.669452 +0000 +0000  0  NULL  NULL
        	            	856816807915880449  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:38.743885 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.743885 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.743885 +0000 +0000  0  NULL  NULL
        	            	856816808161345537  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:38.8188 +0000 +0000    NULL                                    NULL                                    2023-04-15 09:15:38.8188 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.8188 +0000 +0000    0  NULL  NULL
        	            	856816808429715457  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:15:38.900699 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.900699 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.900699 +0000 +0000  0  NULL  NULL
        	            	856816808668495873  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:38.973575 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:38.973575 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:38.973575 +0000 +0000  0  NULL  NULL
        	            	856816808901476353  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:39.044672 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.044672 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.044672 +0000 +0000  0  NULL  NULL
        	            	856816809130557441  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:15:39.114576 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.114576 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.114576 +0000 +0000  0  NULL  NULL
        	            	856816809411936257  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:39.200457 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.200457 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.200457 +0000 +0000  0  NULL  NULL
        	            	856816809667985409  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:39.278582 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.278582 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.278582 +0000 +0000  0  NULL  NULL
        	            	856816809901555713  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:15:39.349876 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.349876 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.349876 +0000 +0000  0  NULL  NULL
        	            	856816810144759809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:39.424091 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.424091 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.424091 +0000 +0000  0  NULL  NULL
        	            	856816810414833665  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:39.506515 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.506515 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.506515 +0000 +0000  0  NULL  NULL
        	            	856816810467524609  AUTO CREATE STATS                Table statistics refresh for system.public.settings                                          CREATE STATISTICS __auto__ FROM [6] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'   root      {}  succeeded         NULL  2023-04-15 09:15:39.522575 +0000 +0000  2023-04-15 09:15:39.676413 +0000 +0000  2023-04-15 09:15:40.333762 +0000 +0000  2023-04-15 09:15:40.333818 +0000 +0000  1  NULL    1     273142358059464744   2023-04-15 09:15:39.676428 +0000 +0000  2023-04-16 09:15:39.676428 +0000 +0000  1  NULL  NULL
        	            	856816810668392449  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:15:39.583879 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:15:39.583879 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:15:39.583879 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/cancel_ALL_RESTORE_JOBS (9.85s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 51fcf796c5595549e90fca3cc1fd8165ee14fd6c:

        	            	856817281786839041  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:03.357832 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.357832 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.357832 +0000 +0000  0  NULL  NULL
        	            	856817281928265729  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:03.400989 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.400989 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.400989 +0000 +0000  0  NULL  NULL
        	            	856817282068676609  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:03.443838 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.443838 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.443838 +0000 +0000  0  NULL  NULL
        	            	856817282205777921  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:03.485686 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.485686 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.485686 +0000 +0000  0  NULL  NULL
        	            	856817282333310977  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:03.52461 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:18:03.52461 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.52461 +0000 +0000   0  NULL  NULL
        	            	856817282463793153  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:03.564418 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.564418 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.564418 +0000 +0000  0  NULL  NULL
        	            	856817282595127297  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:18:03.604498 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.604498 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.604498 +0000 +0000  0  NULL  NULL
        	            	856817282600239105  AUTO CREATE STATS                Table statistics refresh for system.public.statement_diagnostics_requests                    CREATE STATISTICS __auto__ FROM [35] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-15 09:18:03.606048 +0000 +0000  2023-04-15 09:18:03.706632 +0000 +0000  2023-04-15 09:18:05.396211 +0000 +0000  2023-04-15 09:18:05.396347 +0000 +0000  1  NULL    1     1979563430549724742  2023-04-15 09:18:03.706637 +0000 +0000  2023-04-16 09:18:03.706637 +0000 +0000  1  NULL  NULL
        	            	856817282743336961  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:18:03.649737 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.649737 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.649737 +0000 +0000  0  NULL  NULL
        	            	856817282883387393  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-15 09:18:03.692476 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.692476 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.692476 +0000 +0000  0  NULL  NULL
        	            	856817283020292097  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:03.734291 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.734291 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.734291 +0000 +0000  0  NULL  NULL
        	            	856817283174400001  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:03.781285 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.781285 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.781285 +0000 +0000  0  NULL  NULL
        	            	856817283318087681  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:03.825157 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.825157 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.825157 +0000 +0000  0  NULL  NULL
        	            	856817283450339329  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:03.865503 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.865503 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.865503 +0000 +0000  0  NULL  NULL
        	            	856817283609821185  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:03.914179 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.914179 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.914179 +0000 +0000  0  NULL  NULL
        	            	856817283762159617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:03.960651 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:03.960651 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:03.960651 +0000 +0000  0  NULL  NULL
        	            	856817283946610689  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:04.016944 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.016944 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.016944 +0000 +0000  0  NULL  NULL
        	            	856817284096786433  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:04.062783 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.062783 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.062783 +0000 +0000  0  NULL  NULL
        	            	856817284218028033  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:04.09978 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:18:04.09978 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.09978 +0000 +0000   0  NULL  NULL
        	            	856817284368236545  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.145609 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.145609 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.145609 +0000 +0000  0  NULL  NULL
        	            	856817284500160513  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.185886 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.185886 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.185886 +0000 +0000  0  NULL  NULL
        	            	856817284644503553  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.229916 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.229916 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.229916 +0000 +0000  0  NULL  NULL
        	            	856817284802936833  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.278275 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:07.668669 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.278275 +0000 +0000  0  NULL  NULL
        	            	856817284932730881  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.317887 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:07.740141 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.317887 +0000 +0000  0  NULL  NULL
        	            	856817285051547649  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.354142 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:07.814158 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.354142 +0000 +0000  0  NULL  NULL
        	            	856817285171871745  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.390866 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.541715 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.390866 +0000 +0000  0  NULL  NULL
        	            	856817285290754049  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.427146 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.617835 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.427146 +0000 +0000  0  NULL  NULL
        	            	856817285415632897  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.465255 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.712489 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.465255 +0000 +0000  0  NULL  NULL
        	            	856817285539725313  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:04.503121 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.503121 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.503121 +0000 +0000  0  NULL  NULL
        	            	856817285665193985  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:04.541427 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.541427 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.541427 +0000 +0000  0  NULL  NULL
        	            	856817285784567809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-15 09:18:04.577847 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.577847 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.577847 +0000 +0000  0  NULL  NULL
        	            	856817285904662529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:04.614497 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.614497 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.614497 +0000 +0000  0  NULL  NULL
        	            	856817286037045249  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:04.654904 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.654904 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.654904 +0000 +0000  0  NULL  NULL
        	            	856817286163169281  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-15 09:18:04.693379 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.693379 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.693379 +0000 +0000  0  NULL  NULL
        	            	856817286289719297  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.732002 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.321974 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.732002 +0000 +0000  0  NULL  NULL
        	            	856817286413123585  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.769659 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.389248 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.769659 +0000 +0000  0  NULL  NULL
        	            	856817286537347073  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:04.807572 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:08.465285 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.807572 +0000 +0000  0  NULL  NULL
        	            	856817286663471105  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:04.846065 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.846065 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.846065 +0000 +0000  0  NULL  NULL
        	            	856817286788743169  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:04.88431 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:18:04.88431 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.88431 +0000 +0000   0  NULL  NULL
        	            	856817286910705665  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-15 09:18:04.921518 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.921518 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.921518 +0000 +0000  0  NULL  NULL
        	            	856817287038271489  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:04.960447 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:04.960447 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:04.960447 +0000 +0000  0  NULL  NULL
        	            	856817287192313857  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:05.007457 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.007457 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.007457 +0000 +0000  0  NULL  NULL
        	            	856817287326564353  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-15 09:18:05.048426 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.048426 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.048426 +0000 +0000  0  NULL  NULL
        	            	856817287458291713  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:05.088628 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.088628 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.088628 +0000 +0000  0  NULL  NULL
        	            	856817287594704897  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:05.130251 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.130251 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.130251 +0000 +0000  0  NULL  NULL
        	            	856817287741702145  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-15 09:18:05.175122 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.175122 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.175122 +0000 +0000  0  NULL  NULL
        	            	856817287882047489  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:05.217941 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.217941 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.217941 +0000 +0000  0  NULL  NULL
        	            	856817288009252865  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:05.25678 +0000 +0000   NULL                                    NULL                                    2023-04-15 09:18:05.25678 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.25678 +0000 +0000   0  NULL  NULL
        	            	856817288143503361  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-15 09:18:05.297735 +0000 +0000  NULL                                    NULL                                    2023-04-15 09:18:05.297735 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-15 09:18:05.297735 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/pause_ALL_RESTORE_JOBS (9.68s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ c08946af1f935d543a033de6b7b585c4d65288c4:

        	            	857109182528815105  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-16 10:02:44.394821 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.394821 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.394821 +0000 +0000  0  NULL  NULL
        	            	857109182816747521  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:44.482679 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.482679 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.482679 +0000 +0000  0  NULL  NULL
        	            	857109183082070017  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:44.563653 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.563653 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.563653 +0000 +0000  0  NULL  NULL
        	            	857109183337857025  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:44.641707 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.641707 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.641707 +0000 +0000  0  NULL  NULL
        	            	857109183645941761  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:44.735725 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.735725 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.735725 +0000 +0000  0  NULL  NULL
        	            	857109183953731585  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:44.829653 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.829653 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.829653 +0000 +0000  0  NULL  NULL
        	            	857109184125829121  AUTO CREATE STATS                Table statistics refresh for system.public.statement_bundle_chunks                           CREATE STATISTICS __auto__ FROM [34] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-16 10:02:44.882165 +0000 +0000  2023-04-16 10:02:45.05131 +0000 +0000   2023-04-16 10:02:45.664978 +0000 +0000  2023-04-16 10:02:45.66503 +0000 +0000   1  NULL    1     426069333490359816   2023-04-16 10:02:45.051326 +0000 +0000  2023-04-17 10:02:45.051326 +0000 +0000  1  NULL  NULL
        	            	857109184201457665  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:44.905262 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.905262 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.905262 +0000 +0000  0  NULL  NULL
        	            	857109184459571201  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:44.984089 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:44.984089 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:44.984089 +0000 +0000  0  NULL  NULL
        	            	857109184716832769  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:45.062536 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.062536 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.062536 +0000 +0000  0  NULL  NULL
        	            	857109184964460545  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:45.138106 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.138106 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.138106 +0000 +0000  0  NULL  NULL
        	            	857109185218838529  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:45.215747 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.215747 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.215747 +0000 +0000  0  NULL  NULL
        	            	857109185472397313  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:45.293129 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.293129 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.293129 +0000 +0000  0  NULL  NULL
        	            	857109185716092929  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:45.367505 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.367505 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.367505 +0000 +0000  0  NULL  NULL
        	            	857109185967685633  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:45.444271 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.444271 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.444271 +0000 +0000  0  NULL  NULL
        	            	857109186221146113  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:45.521625 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.521625 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.521625 +0000 +0000  0  NULL  NULL
        	            	857109186462679041  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:45.595318 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.595318 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.595318 +0000 +0000  0  NULL  NULL
        	            	857109186711093249  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:45.671141 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.671141 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.671141 +0000 +0000  0  NULL  NULL
        	            	857109186959245313  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:45.746868 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.746868 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.746868 +0000 +0000  0  NULL  NULL
        	            	857109187211100161  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:45.823722 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.823722 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.823722 +0000 +0000  0  NULL  NULL
        	            	857109187454992385  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-16 10:02:45.898166 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.898166 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.898166 +0000 +0000  0  NULL  NULL
        	            	857109187728736257  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-16 10:02:45.981705 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:45.981705 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:45.981705 +0000 +0000  0  NULL  NULL
        	            	857109187980066817  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-16 10:02:46.058403 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.058403 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.058403 +0000 +0000  0  NULL  NULL
        	            	857109188290609153  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.153179 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.153179 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.153179 +0000 +0000  0  NULL  NULL
        	            	857109188533190657  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.227206 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.227206 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.227206 +0000 +0000  0  NULL  NULL
        	            	857109188698800129  AUTO CREATE STATS                Table statistics refresh for system.public.statement_diagnostics_requests                    CREATE STATISTICS __auto__ FROM [35] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-16 10:02:46.277726 +0000 +0000  2023-04-16 10:02:46.440425 +0000 +0000  2023-04-16 10:02:47.318807 +0000 +0000  2023-04-16 10:02:47.31886 +0000 +0000   1  NULL    1     3457732111517703179  2023-04-16 10:02:46.440442 +0000 +0000  2023-04-17 10:02:46.440442 +0000 +0000  1  NULL  NULL
        	            	857109188783472641  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.30358 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:02:46.30358 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.30358 +0000 +0000   0  NULL  NULL
        	            	857109189032902657  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.379699 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.379699 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.379699 +0000 +0000  0  NULL  NULL
        	            	857109189293670401  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.459281 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.459281 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.459281 +0000 +0000  0  NULL  NULL
        	            	857109189550538753  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-16 10:02:46.53768 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:02:46.53768 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.53768 +0000 +0000   0  NULL  NULL
        	            	857109189811765249  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:46.61739 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:02:46.61739 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.61739 +0000 +0000   0  NULL  NULL
        	            	857109190059524097  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:46.692997 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.692997 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.692997 +0000 +0000  0  NULL  NULL
        	            	857109190302957569  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:02:46.767297 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.767297 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.767297 +0000 +0000  0  NULL  NULL
        	            	857109190555926529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:46.844492 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.844492 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.844492 +0000 +0000  0  NULL  NULL
        	            	857109190811385857  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:46.922456 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.922456 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.922456 +0000 +0000  0  NULL  NULL
        	            	857109191059865601  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:02:46.998282 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:46.998282 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:46.998282 +0000 +0000  0  NULL  NULL
        	            	857109191307952129  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:47.073988 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.073988 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.073988 +0000 +0000  0  NULL  NULL
        	            	857109191555284993  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:47.149472 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.149472 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.149472 +0000 +0000  0  NULL  NULL
        	            	857109191801307137  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:02:47.224549 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.224549 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.224549 +0000 +0000  0  NULL  NULL
        	            	857109192106573825  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:47.317709 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.317709 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.317709 +0000 +0000  0  NULL  NULL
        	            	857109192383627265  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:47.402258 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.402258 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.402258 +0000 +0000  0  NULL  NULL
        	            	857109192661663745  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:02:47.487118 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.487118 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.487118 +0000 +0000  0  NULL  NULL
        	            	857109192986755073  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:47.586332 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.586332 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.586332 +0000 +0000  0  NULL  NULL
        	            	857109193230385153  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:47.660679 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.660679 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.660679 +0000 +0000  0  NULL  NULL
        	            	857109193472475137  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:02:47.73455 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:02:47.73455 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.73455 +0000 +0000   0  NULL  NULL
        	            	857109193752444929  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:47.819992 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.819992 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.819992 +0000 +0000  0  NULL  NULL
        	            	857109194020159489  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:47.901695 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.901695 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.901695 +0000 +0000  0  NULL  NULL
        	            	857109194166992897  AUTO CREATE STATS                Table statistics refresh for system.public.tenant_settings                                   CREATE STATISTICS __auto__ FROM [50] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-16 10:02:47.946488 +0000 +0000  2023-04-16 10:02:48.109724 +0000 +0000  NULL                                    2023-04-16 10:02:48.057546 +0000 +0000  0  NULL    1     2088715123305607370  2023-04-16 10:02:48.109738 +0000 +0000  2023-04-17 10:02:48.109738 +0000 +0000  1  NULL  NULL
        	            	857109194269032449  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:02:47.977643 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:02:47.977643 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:02:47.977643 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_RESTORE_JOBS (9.60s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ c08946af1f935d543a033de6b7b585c4d65288c4:

        	            	857111188771373057  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-16 10:12:56.651448 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.651448 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.651448 +0000 +0000  0  NULL  NULL
        	            	857111188889370625  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-16 10:12:56.687459 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.687459 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.687459 +0000 +0000  0  NULL  NULL
        	            	857111189019230209  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:56.72709 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:12:56.72709 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.72709 +0000 +0000   0  NULL  NULL
        	            	857111189155840001  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:56.768794 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.768794 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.768794 +0000 +0000  0  NULL  NULL
        	            	857111189319942145  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:56.818871 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.818871 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.818871 +0000 +0000  0  NULL  NULL
        	            	857111189438464001  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:56.855032 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.855032 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.855032 +0000 +0000  0  NULL  NULL
        	            	857111189563998209  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:56.893342 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:56.893342 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.893342 +0000 +0000  0  NULL  NULL
        	            	857111189650374657  AUTO CREATE STATS                Table statistics refresh for system.public.span_stats_samples                                CREATE STATISTICS __auto__ FROM [56] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-16 10:12:56.919683 +0000 +0000  2023-04-16 10:12:57.021306 +0000 +0000  2023-04-16 10:12:58.771342 +0000 +0000  2023-04-16 10:12:58.771483 +0000 +0000  1  NULL    1     7269177089085588454  2023-04-16 10:12:57.021314 +0000 +0000  2023-04-17 10:12:57.021314 +0000 +0000  1  NULL  NULL
        	            	857111189703393281  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:56.9359 +0000 +0000    NULL                                    NULL                                    2023-04-16 10:12:56.9359 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.9359 +0000 +0000    0  NULL  NULL
        	            	857111189839708161  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:56.97748 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:12:56.97748 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:56.97748 +0000 +0000   0  NULL  NULL
        	            	857111189974941697  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:57.018751 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.018751 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.018751 +0000 +0000  0  NULL  NULL
        	            	857111190127083521  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:57.065181 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.065181 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.065181 +0000 +0000  0  NULL  NULL
        	            	857111190295379969  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:57.116546 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.116546 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.116546 +0000 +0000  0  NULL  NULL
        	            	857111190417408001  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:57.15378 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:12:57.15378 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.15378 +0000 +0000   0  NULL  NULL
        	            	857111190595633153  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:57.208176 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.208176 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.208176 +0000 +0000  0  NULL  NULL
        	            	857111190723756033  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.247276 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.247276 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.247276 +0000 +0000  0  NULL  NULL
        	            	857111190849912833  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.285777 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.285777 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.285777 +0000 +0000  0  NULL  NULL
        	            	857111191023517697  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.338751 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.338751 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.338751 +0000 +0000  0  NULL  NULL
        	            	857111191145480193  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:57.375984 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.375984 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.375984 +0000 +0000  0  NULL  NULL
        	            	857111191272816641  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:57.414831 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.414831 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.414831 +0000 +0000  0  NULL  NULL
        	            	857111191438884865  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:57.465509 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.465509 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.465509 +0000 +0000  0  NULL  NULL
        	            	857111191568875521  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.505184 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.505184 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.505184 +0000 +0000  0  NULL  NULL
        	            	857111191691296769  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.542545 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.542545 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.542545 +0000 +0000  0  NULL  NULL
        	            	857111191863361537  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.595067 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.595067 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.595067 +0000 +0000  0  NULL  NULL
        	            	857111192026087425  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.64472 +0000 +0000   NULL                                    NULL                                    2023-04-16 10:12:57.64472 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.64472 +0000 +0000   0  NULL  NULL
        	            	857111192160600065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.685767 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.685767 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.685767 +0000 +0000  0  NULL  NULL
        	            	857111192294457345  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.726621 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.726621 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.726621 +0000 +0000  0  NULL  NULL
        	            	857111192416681985  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.763926 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.763926 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.763926 +0000 +0000  0  NULL  NULL
        	            	857111192554602497  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.806003 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.806003 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.806003 +0000 +0000  0  NULL  NULL
        	            	857111192676073473  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:57.843084 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.843084 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.843084 +0000 +0000  0  NULL  NULL
        	            	857111192798625793  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:57.880482 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.880482 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.880482 +0000 +0000  0  NULL  NULL
        	            	857111192918425601  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:57.917031 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.917031 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.917031 +0000 +0000  0  NULL  NULL
        	            	857111193039339521  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-16 10:12:57.953934 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.953934 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.953934 +0000 +0000  0  NULL  NULL
        	            	857111193160548353  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:57.990921 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:57.990921 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:57.990921 +0000 +0000  0  NULL  NULL
        	            	857111193285165057  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:58.028961 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.028961 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.028961 +0000 +0000  0  NULL  NULL
        	            	857111193409650689  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-16 10:12:58.066944 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.066944 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.066944 +0000 +0000  0  NULL  NULL
        	            	857111193532661761  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:58.104489 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.104489 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.104489 +0000 +0000  0  NULL  NULL
        	            	857111193662849025  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:58.144216 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.144216 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.144216 +0000 +0000  0  NULL  NULL
        	            	857111193798574081  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-16 10:12:58.185668 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.185668 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.185668 +0000 +0000  0  NULL  NULL
        	            	857111193928859649  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:58.225401 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.225401 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.225401 +0000 +0000  0  NULL  NULL
        	            	857111194057277441  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:58.264583 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.264583 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.264583 +0000 +0000  0  NULL  NULL
        	            	857111194182156289  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-16 10:12:58.302701 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.302701 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.302701 +0000 +0000  0  NULL  NULL
        	            	857111194317619201  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:58.344046 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.344046 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.344046 +0000 +0000  0  NULL  NULL
        	            	857111194453180417  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:58.3854 +0000 +0000    NULL                                    NULL                                    2023-04-16 10:12:58.3854 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.3854 +0000 +0000    0  NULL  NULL
        	            	857111194619543553  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-16 10:12:58.436175 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.436175 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.436175 +0000 +0000  0  NULL  NULL
        	            	857111194743013377  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:58.473854 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.473854 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.473854 +0000 +0000  0  NULL  NULL
        	            	857111194867040257  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:58.511702 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.511702 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.511702 +0000 +0000  0  NULL  NULL
        	            	857111194993688577  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-16 10:12:58.550361 +0000 +0000  NULL                                    NULL                                    2023-04-16 10:12:58.550361 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-16 10:12:58.550361 +0000 +0000  0  NULL  NULL
        	            	857111202328510465  AUTO CREATE STATS                Table statistics refresh for system.public.tenant_tasks                                      CREATE STATISTICS __auto__ FROM [59] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-16 10:13:00.788745 +0000 +0000  2023-04-16 10:13:00.893579 +0000 +0000  NULL                                    2023-04-16 10:13:00.855212 +0000 +0000  0  NULL    1     5826317567179280822  2023-04-16 10:13:00.893587 +0000 +0000  2023-04-17 10:13:00.893587 +0000 +0000  1  NULL  NULL
    --- FAIL: TestJobControlByType/cancel_ALL_RESTORE_JOBS (9.04s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 3382b2737ceb72de9b14d1d5923773718be5bca7:

        	            	857374842225557505  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:33:57.300332 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.300332 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.300332 +0000 +0000  0  NULL  NULL
        	            	857374842366459905  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:33:57.343324 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.343324 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.343324 +0000 +0000  0  NULL  NULL
        	            	857374842513981441  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:33:57.388343 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.388343 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.388343 +0000 +0000  0  NULL  NULL
        	            	857374842662977537  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:57.433812 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.433812 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.433812 +0000 +0000  0  NULL  NULL
        	            	857374842808532993  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:57.478244 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.478244 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.478244 +0000 +0000  0  NULL  NULL
        	            	857374842952581121  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:57.522184 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.522184 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.522184 +0000 +0000  0  NULL  NULL
        	            	857374843094695937  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:57.565573 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.565573 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.565573 +0000 +0000  0  NULL  NULL
        	            	857374843260436481  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:57.616142 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.616142 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.616142 +0000 +0000  0  NULL  NULL
        	            	857374843424899073  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:57.666343 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.666343 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.666343 +0000 +0000  0  NULL  NULL
        	            	857374843573469185  AUTO CREATE STATS                Table statistics refresh for system.public.sqlliveness                                       CREATE STATISTICS __auto__ FROM [39] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-17 08:33:57.711641 +0000 +0000  2023-04-17 08:33:57.834568 +0000 +0000  2023-04-17 08:33:59.831152 +0000 +0000  2023-04-17 08:33:59.831263 +0000 +0000  1  NULL    1     6131347089787396267  2023-04-17 08:33:57.834574 +0000 +0000  2023-04-18 08:33:57.834574 +0000 +0000  1  NULL  NULL
        	            	857374843587362817  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:57.715917 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.715917 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.715917 +0000 +0000  0  NULL  NULL
        	            	857374843765227521  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:57.770184 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.770184 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.770184 +0000 +0000  0  NULL  NULL
        	            	857374843912355841  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:57.815086 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.815086 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.815086 +0000 +0000  0  NULL  NULL
        	            	857374844051554305  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:57.857564 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.857564 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.857564 +0000 +0000  0  NULL  NULL
        	            	857374844316909569  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:57.938554 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.938554 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.938554 +0000 +0000  0  NULL  NULL
        	            	857374844481372161  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:57.988743 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:57.988743 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:57.988743 +0000 +0000  0  NULL  NULL
        	            	857374844610969601  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:58.028289 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.028289 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.028289 +0000 +0000  0  NULL  NULL
        	            	857374844748431361  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:58.070241 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.070241 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.070241 +0000 +0000  0  NULL  NULL
        	            	857374844899065857  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:58.116219 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.116219 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.116219 +0000 +0000  0  NULL  NULL
        	            	857374845055303681  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:58.163887 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.163887 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.163887 +0000 +0000  0  NULL  NULL
        	            	857374845197418497  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:58.207251 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.207251 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.207251 +0000 +0000  0  NULL  NULL
        	            	857374845338222593  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:58.250236 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.250236 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.250236 +0000 +0000  0  NULL  NULL
        	            	857374845481091073  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:33:58.29383 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:33:58.29383 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.29383 +0000 +0000   0  NULL  NULL
        	            	857374845653549057  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:33:58.346472 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.346472 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.346472 +0000 +0000  0  NULL  NULL
        	            	857374845797367809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:33:58.39035 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:33:58.39035 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.39035 +0000 +0000   0  NULL  NULL
        	            	857374845938892801  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.433554 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.433554 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.433554 +0000 +0000  0  NULL  NULL
        	            	857374846070980609  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.473859 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.473859 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.473859 +0000 +0000  0  NULL  NULL
        	            	857374846203330561  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.514232 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.514232 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.514232 +0000 +0000  0  NULL  NULL
        	            	857374846340694017  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.556161 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.556161 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.556161 +0000 +0000  0  NULL  NULL
        	            	857374846539005953  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.616677 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.616677 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.616677 +0000 +0000  0  NULL  NULL
        	            	857374846691082241  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:33:58.663086 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.663086 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.663086 +0000 +0000  0  NULL  NULL
        	            	857374846851219457  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:58.711961 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.711961 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.711961 +0000 +0000  0  NULL  NULL
        	            	857374847011323905  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:58.760827 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.760827 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.760827 +0000 +0000  0  NULL  NULL
        	            	857374847171100673  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:33:58.809584 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.809584 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.809584 +0000 +0000  0  NULL  NULL
        	            	857374847317016577  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:58.85411 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:33:58.85411 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.85411 +0000 +0000   0  NULL  NULL
        	            	857374847457820673  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:58.897085 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.897085 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.897085 +0000 +0000  0  NULL  NULL
        	            	857374847607570433  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:33:58.94279 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:33:58.94279 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.94279 +0000 +0000   0  NULL  NULL
        	            	857374847753289729  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:58.987251 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:58.987251 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:58.987251 +0000 +0000  0  NULL  NULL
        	            	857374847892193281  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:59.029638 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.029638 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.029638 +0000 +0000  0  NULL  NULL
        	            	857374848039911425  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:33:59.074713 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.074713 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.074713 +0000 +0000  0  NULL  NULL
        	            	857374848177700865  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:59.116775 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.116775 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.116775 +0000 +0000  0  NULL  NULL
        	            	857374848321290241  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:59.160629 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.160629 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.160629 +0000 +0000  0  NULL  NULL
        	            	857374848469434369  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:33:59.205802 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.205802 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.205802 +0000 +0000  0  NULL  NULL
        	            	857374848621805569  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:59.252302 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.252302 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.252302 +0000 +0000  0  NULL  NULL
        	            	857374848780304385  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:59.300663 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.300663 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.300663 +0000 +0000  0  NULL  NULL
        	            	857374848925204481  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:33:59.344883 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.344883 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.344883 +0000 +0000  0  NULL  NULL
        	            	857374849070202881  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:59.389138 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.389138 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.389138 +0000 +0000  0  NULL  NULL
        	            	857374849226113025  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:59.436721 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:33:59.436721 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.436721 +0000 +0000  0  NULL  NULL
        	            	857374849375535105  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:33:59.48233 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:33:59.48233 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:33:59.48233 +0000 +0000   0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_RESTORE_JOBS (7.89s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 3382b2737ceb72de9b14d1d5923773718be5bca7:

        	            	857374505900179457  BACKUP                           fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:32:14.661949 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:14.661949 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:14.661949 +0000 +0000  0  NULL  NULL
        	            	857374506167140353  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:14.743418 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:14.743418 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:14.743418 +0000 +0000  0  NULL  NULL
        	            	857374506433085441  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:14.824585 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:14.824585 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:14.824585 +0000 +0000  0  NULL  NULL
        	            	857374506728292353  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:14.914666 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:14.914666 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:14.914666 +0000 +0000  0  NULL  NULL
        	            	857374507066884097  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:15.018005 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.018005 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.018005 +0000 +0000  0  NULL  NULL
        	            	857374507401838593  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:15.120231 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.120231 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.120231 +0000 +0000  0  NULL  NULL
        	            	857374507613388801  AUTO CREATE STATS                Table statistics refresh for system.public.tenant_usage                                      CREATE STATISTICS __auto__ FROM [45] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-17 08:32:15.184762 +0000 +0000  2023-04-17 08:32:15.35551 +0000 +0000   2023-04-17 08:32:16.520901 +0000 +0000  2023-04-17 08:32:16.520974 +0000 +0000  1  NULL    1     8047440242319027768  2023-04-17 08:32:15.35553 +0000 +0000   2023-04-18 08:32:15.35553 +0000 +0000   1  NULL  NULL
        	            	857374507682496513  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:15.205867 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.205867 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.205867 +0000 +0000  0  NULL  NULL
        	            	857374507964039169  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:15.291793 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.291793 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.291793 +0000 +0000  0  NULL  NULL
        	            	857374508237848577  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:15.37536 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:15.37536 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.37536 +0000 +0000   0  NULL  NULL
        	            	857374508523388929  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:15.462511 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.462511 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.462511 +0000 +0000  0  NULL  NULL
        	            	857374508788645889  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:15.543458 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.543458 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.543458 +0000 +0000  0  NULL  NULL
        	            	857374509091061761  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:15.635729 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.635729 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.635729 +0000 +0000  0  NULL  NULL
        	            	857374509376372737  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:15.722808 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.722808 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.722808 +0000 +0000  0  NULL  NULL
        	            	857374509676199937  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:15.814306 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.814306 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.814306 +0000 +0000  0  NULL  NULL
        	            	857374509985005569  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:15.908556 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:15.908556 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.908556 +0000 +0000  0  NULL  NULL
        	            	857374510271594497  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:15.996 +0000 +0000     NULL                                    NULL                                    2023-04-17 08:32:15.996 +0000 +0000     0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:15.996 +0000 +0000     0  NULL  NULL
        	            	857374510569226241  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:16.086833 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.086833 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.086833 +0000 +0000  0  NULL  NULL
        	            	857374510885535745  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:16.183372 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.183372 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.183372 +0000 +0000  0  NULL  NULL
        	            	857374511218950145  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:16.285116 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.285116 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.285116 +0000 +0000  0  NULL  NULL
        	            	857374511515959297  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:32:16.37576 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:16.37576 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.37576 +0000 +0000   0  NULL  NULL
        	            	857374511790292993  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:32:16.459606 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.459606 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.459606 +0000 +0000  0  NULL  NULL
        	            	857374512106799105  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-17 08:32:16.556068 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.556068 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.556068 +0000 +0000  0  NULL  NULL
        	            	857374512448733185  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:32:16.66042 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:16.66042 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.66042 +0000 +0000   0  NULL  NULL
        	            	857374512742825985  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:32:16.750171 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.750171 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.750171 +0000 +0000  0  NULL  NULL
        	            	857374513036034049  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-17 08:32:16.839653 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.839653 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.839653 +0000 +0000  0  NULL  NULL
        	            	857374513247518721  AUTO CREATE STATS                Table statistics refresh for system.public.eventlog                                          CREATE STATISTICS __auto__ FROM [12] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-17 08:32:16.904175 +0000 +0000  2023-04-17 08:32:17.101706 +0000 +0000  2023-04-17 08:32:17.961336 +0000 +0000  2023-04-17 08:32:17.961423 +0000 +0000  1  NULL    1     5354130103912385993  2023-04-17 08:32:17.101738 +0000 +0000  2023-04-18 08:32:17.101738 +0000 +0000  1  NULL  NULL
        	            	857374513357520897  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:32:16.937755 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:16.937755 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:16.937755 +0000 +0000  0  NULL  NULL
        	            	857374513654824961  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:32:17.028496 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.028496 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.028496 +0000 +0000  0  NULL  NULL
        	            	857374513969397761  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-17 08:32:17.124483 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.124483 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.124483 +0000 +0000  0  NULL  NULL
        	            	857374514234523649  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:17.205396 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.205396 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.205396 +0000 +0000  0  NULL  NULL
        	            	857374514506006529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:17.288245 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.288245 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.288245 +0000 +0000  0  NULL  NULL
        	            	857374514783911937  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-17 08:32:17.373065 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.373065 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.373065 +0000 +0000  0  NULL  NULL
        	            	857374515085737985  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:17.46519 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:17.46519 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.46519 +0000 +0000   0  NULL  NULL
        	            	857374515370852353  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:17.55217 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:17.55217 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.55217 +0000 +0000   0  NULL  NULL
        	            	857374515669336065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-17 08:32:17.643259 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.643259 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.643259 +0000 +0000  0  NULL  NULL
        	            	857374515950551041  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:17.729082 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.729082 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.729082 +0000 +0000  0  NULL  NULL
        	            	857374516221739009  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:17.811843 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.811843 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.811843 +0000 +0000  0  NULL  NULL
        	            	857374516493058049  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-17 08:32:17.894633 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.894633 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.894633 +0000 +0000  0  NULL  NULL
        	            	857374516770734081  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:17.979385 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:17.979385 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:17.979385 +0000 +0000  0  NULL  NULL
        	            	857374517105623041  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:18.081587 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.081587 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.081587 +0000 +0000  0  NULL  NULL
        	            	857374517402238977  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-17 08:32:18.172097 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.172097 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.172097 +0000 +0000  0  NULL  NULL
        	            	857374517684568065  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:18.258296 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.258296 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.258296 +0000 +0000  0  NULL  NULL
        	            	857374517963554817  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:18.343407 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.343407 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.343407 +0000 +0000  0  NULL  NULL
        	            	857374518220324865  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-17 08:32:18.42177 +0000 +0000   NULL                                    NULL                                    2023-04-17 08:32:18.42177 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.42177 +0000 +0000   0  NULL  NULL
        	            	857374518492102657  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:18.504701 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.504701 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.504701 +0000 +0000  0  NULL  NULL
        	            	857374518759260161  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:18.586239 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.586239 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.586239 +0000 +0000  0  NULL  NULL
        	            	857374518794059777  AUTO CREATE STATS                Table statistics refresh for system.public.span_stats_buckets                                CREATE STATISTICS __auto__ FROM [55] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-17 08:32:18.596833 +0000 +0000  2023-04-17 08:32:18.769385 +0000 +0000  NULL                                    2023-04-17 08:32:18.708804 +0000 +0000  0  NULL    1     7314910770453569823  2023-04-17 08:32:18.7694 +0000 +0000    2023-04-18 08:32:18.7694 +0000 +0000    1  NULL  NULL
        	            	857374519031037953  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-17 08:32:18.669261 +0000 +0000  NULL                                    NULL                                    2023-04-17 08:32:18.669261 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-17 08:32:18.669261 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_BACKUP_JOBS (10.63s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ 1cd507a7c6582fd91bb56123e62bd4fde45c4d22:

        	            	857676737626701825  BACKUP                           fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-18 10:09:28.465211 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.465211 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.465211 +0000 +0000  0  NULL  NULL
        	            	857676737850933249  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:28.533634 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.533634 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.533634 +0000 +0000  0  NULL  NULL
        	            	857676738065956865  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:28.599268 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.599268 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.599268 +0000 +0000  0  NULL  NULL
        	            	857676738295562241  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:28.669333 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.669333 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.669333 +0000 +0000  0  NULL  NULL
        	            	857676738590507009  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:28.759337 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.759337 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.759337 +0000 +0000  0  NULL  NULL
        	            	857676738814181377  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:28.827601 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.827601 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.827601 +0000 +0000  0  NULL  NULL
        	            	857676739048734721  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:28.899177 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.899177 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.899177 +0000 +0000  0  NULL  NULL
        	            	857676739281813505  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:28.970308 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:28.970308 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:28.970308 +0000 +0000  0  NULL  NULL
        	            	857676739547529217  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:29.0514 +0000 +0000    NULL                                    NULL                                    2023-04-18 10:09:29.0514 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.0514 +0000 +0000    0  NULL  NULL
        	            	857676739781230593  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:29.122718 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.122718 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.122718 +0000 +0000  0  NULL  NULL
        	            	857676740002906113  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:29.190377 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.190377 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.190377 +0000 +0000  0  NULL  NULL
        	            	857676740236607489  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:29.261684 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.261684 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.261684 +0000 +0000  0  NULL  NULL
        	            	857676740459790337  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:29.329803 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.329803 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.329803 +0000 +0000  0  NULL  NULL
        	            	857676740612259841  AUTO CREATE STATS                Table statistics refresh for system.public.reports_meta                                      CREATE STATISTICS __auto__ FROM [28] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-18 10:09:29.376308 +0000 +0000  2023-04-18 10:09:29.520758 +0000 +0000  2023-04-18 10:09:30.042665 +0000 +0000  2023-04-18 10:09:30.04272 +0000 +0000   1  NULL    1     7089658710702823270  2023-04-18 10:09:29.520772 +0000 +0000  2023-04-19 10:09:29.520772 +0000 +0000  1  NULL  NULL
        	            	857676740688642049  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:29.399638 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.399638 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.399638 +0000 +0000  0  NULL  NULL
        	            	857676740918575105  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:29.469808 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.469808 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.469808 +0000 +0000  0  NULL  NULL
        	            	857676741144969217  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:29.538962 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.538962 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.538962 +0000 +0000  0  NULL  NULL
        	            	857676741367398401  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:29.606771 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.606771 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.606771 +0000 +0000  0  NULL  NULL
        	            	857676741595365377  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:29.676352 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.676352 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.676352 +0000 +0000  0  NULL  NULL
        	            	857676741819367425  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:29.744711 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.744711 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.744711 +0000 +0000  0  NULL  NULL
        	            	857676742057852929  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-18 10:09:29.817485 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.817485 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.817485 +0000 +0000  0  NULL  NULL
        	            	857676742298566657  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-18 10:09:29.890979 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.890979 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.890979 +0000 +0000  0  NULL  NULL
        	            	857676742559825921  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pending           NULL  2023-04-18 10:09:29.970676 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:29.970676 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:29.970676 +0000 +0000  0  NULL  NULL
        	            	857676742845988865  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-18 10:09:30.058001 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.058001 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.058001 +0000 +0000  0  NULL  NULL
        	            	857676743085490177  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-18 10:09:30.131101 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.131101 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.131101 +0000 +0000  0  NULL  NULL
        	            	857676743311949825  RESTORE                          fake job                                                                                                                                                                                testuser  {}  running           NULL  2023-04-18 10:09:30.20021 +0000 +0000   NULL                                    NULL                                    2023-04-18 10:09:30.20021 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.20021 +0000 +0000   0  NULL  NULL
        	            	857676743554039809  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-18 10:09:30.274089 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.274089 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.274089 +0000 +0000  0  NULL  NULL
        	            	857676743806189569  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-18 10:09:30.351036 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.351036 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.351036 +0000 +0000  0  NULL  NULL
        	            	857676743815888897  AUTO CREATE STATS                Table statistics refresh for system.public.protected_ts_meta                                 CREATE STATISTICS __auto__ FROM [31] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-18 10:09:30.353984 +0000 +0000  2023-04-18 10:09:30.490376 +0000 +0000  2023-04-18 10:09:31.103248 +0000 +0000  2023-04-18 10:09:31.103303 +0000 +0000  1  NULL    1     4366930655157206992  2023-04-18 10:09:30.490392 +0000 +0000  2023-04-19 10:09:30.490392 +0000 +0000  1  NULL  NULL
        	            	857676744024653825  RESTORE                          fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-18 10:09:30.417702 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.417702 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.417702 +0000 +0000  0  NULL  NULL
        	            	857676744244559873  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:30.484813 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.484813 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.484813 +0000 +0000  0  NULL  NULL
        	            	857676744472854529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:30.554495 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.554495 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.554495 +0000 +0000  0  NULL  NULL
        	            	857676744705835009  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-18 10:09:30.625589 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.625589 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.625589 +0000 +0000  0  NULL  NULL
        	            	857676744946450433  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:30.699016 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.699016 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.699016 +0000 +0000  0  NULL  NULL
        	            	857676745173237761  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:30.768225 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.768225 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.768225 +0000 +0000  0  NULL  NULL
        	            	857676745382920193  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-18 10:09:30.832218 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.832218 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.832218 +0000 +0000  0  NULL  NULL
        	            	857676745613869057  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:30.902697 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:30.902697 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.902697 +0000 +0000  0  NULL  NULL
        	            	857676745842393089  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:30.97244 +0000 +0000   NULL                                    NULL                                    2023-04-18 10:09:30.97244 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:30.97244 +0000 +0000   0  NULL  NULL
        	            	857676746078486529  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-18 10:09:31.044496 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.044496 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.044496 +0000 +0000  0  NULL  NULL
        	            	857676746372743169  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:31.134286 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.134286 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.134286 +0000 +0000  0  NULL  NULL
        	            	857676746620272641  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:31.209825 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.209825 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.209825 +0000 +0000  0  NULL  NULL
        	            	857676746863902721  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-18 10:09:31.28418 +0000 +0000   NULL                                    NULL                                    2023-04-18 10:09:31.28418 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.28418 +0000 +0000   0  NULL  NULL
        	            	857676747093213185  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:31.354168 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.354168 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.354168 +0000 +0000  0  NULL  NULL
        	            	857676747364139009  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:31.436838 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.436838 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.436838 +0000 +0000  0  NULL  NULL
        	            	857676747591221249  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-18 10:09:31.506136 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.506136 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.506136 +0000 +0000  0  NULL  NULL
        	            	857676747823054849  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:31.576883 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.576883 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.576883 +0000 +0000  0  NULL  NULL
        	            	857676748067110913  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:31.651361 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.651361 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.651361 +0000 +0000  0  NULL  NULL
        	            	857676748106334209  AUTO CREATE STATS                Table statistics refresh for system.public.database_role_settings                            CREATE STATISTICS __auto__ FROM [44] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-18 10:09:31.663358 +0000 +0000  2023-04-18 10:09:31.818516 +0000 +0000  NULL                                    2023-04-18 10:09:31.768053 +0000 +0000  0  NULL    1     4394080372442387822  2023-04-18 10:09:31.818533 +0000 +0000  2023-04-19 10:09:31.818533 +0000 +0000  1  NULL  NULL
        	            	857676748289310721  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-18 10:09:31.719176 +0000 +0000  NULL                                    NULL                                    2023-04-18 10:09:31.719176 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-18 10:09:31.719176 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_BACKUP_JOBS (8.57s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ a4ab6b6243f509e62993b4d81855f23470d9901a:

        	            	857950082619998209  BACKUP                           fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:46.737087 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:46.737087 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:46.737087 +0000 +0000  0  NULL  NULL
        	            	857950082807496705  BACKUP                           fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:46.7943 +0000 +0000    NULL                                    NULL                                    2023-04-19 09:19:46.7943 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:46.7943 +0000 +0000    0  NULL  NULL
        	            	857950082986311681  BACKUP                           fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:46.848881 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:46.848881 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:46.848881 +0000 +0000  0  NULL  NULL
        	            	857950083162898433  BACKUP                           fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:46.902768 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:46.902768 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:46.902768 +0000 +0000  0  NULL  NULL
        	            	857950083362390017  BACKUP                           fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:46.963657 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:46.963657 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:46.963657 +0000 +0000  0  NULL  NULL
        	            	857950083541139457  BACKUP                           fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:47.018212 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.018212 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.018212 +0000 +0000  0  NULL  NULL
        	            	857950083749249025  BACKUP                           fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:47.081729 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.081729 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.081729 +0000 +0000  0  NULL  NULL
        	            	857950083952279553  BACKUP                           fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:47.143668 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.143668 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.143668 +0000 +0000  0  NULL  NULL
        	            	857950084133060609  BACKUP                           fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:47.198838 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.198838 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.198838 +0000 +0000  0  NULL  NULL
        	            	857950084320428033  BACKUP                           fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:47.256012 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.256012 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.256012 +0000 +0000  0  NULL  NULL
        	            	857950084498194433  BACKUP                           fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:47.310277 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.310277 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.310277 +0000 +0000  0  NULL  NULL
        	            	857950084688150529  BACKUP                           fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:47.36824 +0000 +0000   NULL                                    NULL                                    2023-04-19 09:19:47.36824 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.36824 +0000 +0000   0  NULL  NULL
        	            	857950084871880705  BACKUP                           fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:47.424299 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.424299 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.424299 +0000 +0000  0  NULL  NULL
        	            	857950085038342145  BACKUP                           fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:47.475115 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.475115 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.475115 +0000 +0000  0  NULL  NULL
        	            	857950085224562689  BACKUP                           fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:47.531939 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.531939 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.531939 +0000 +0000  0  NULL  NULL
        	            	857950085419171841  BACKUP                           fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:47.591333 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.591333 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.591333 +0000 +0000  0  NULL  NULL
        	            	857950085599166465  BACKUP                           fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:47.648546 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.648546 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.648546 +0000 +0000  0  NULL  NULL
        	            	857950085788532737  BACKUP                           fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:47.704046 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.704046 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.704046 +0000 +0000  0  NULL  NULL
        	            	857950085960433665  BACKUP                           fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:47.756518 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.756518 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.756518 +0000 +0000  0  NULL  NULL
        	            	857950086149767169  BACKUP                           fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:47.814297 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.814297 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.814297 +0000 +0000  0  NULL  NULL
        	            	857950086350176257  BACKUP                           fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:47.875456 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.875456 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.875456 +0000 +0000  0  NULL  NULL
        	            	857950086530269185  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pending           NULL  2023-04-19 09:19:47.930419 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.930419 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.930419 +0000 +0000  0  NULL  NULL
        	            	857950086706888705  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pending           NULL  2023-04-19 09:19:47.984313 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:47.984313 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:47.984313 +0000 +0000  0  NULL  NULL
        	            	857950086928957441  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pending           NULL  2023-04-19 09:19:48.052077 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.052077 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.052077 +0000 +0000  0  NULL  NULL
        	            	857950087106723841  RESTORE                          fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:48.106336 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.106336 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.106336 +0000 +0000  0  NULL  NULL
        	            	857950087280394241  RESTORE                          fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:48.159332 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.159332 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.159332 +0000 +0000  0  NULL  NULL
        	            	857950087465074689  RESTORE                          fake job                                                                                                                                                                               testuser  {}  running           NULL  2023-04-19 09:19:48.215686 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.215686 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.215686 +0000 +0000  0  NULL  NULL
        	            	857950087650476033  RESTORE                          fake job                                                                                                                                                                               testuser  {}  paused            NULL  2023-04-19 09:19:48.272266 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.272266 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.272266 +0000 +0000  0  NULL  NULL
        	            	857950087816511489  RESTORE                          fake job                                                                                                                                                                               testuser  {}  paused            NULL  2023-04-19 09:19:48.322941 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.322941 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.322941 +0000 +0000  0  NULL  NULL
        	            	857950087994802177  RESTORE                          fake job                                                                                                                                                                               testuser  {}  paused            NULL  2023-04-19 09:19:48.377349 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.377349 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.377349 +0000 +0000  0  NULL  NULL
        	            	857950088166277121  RESTORE                          fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:48.429682 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.429682 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.429682 +0000 +0000  0  NULL  NULL
        	            	857950088350072833  RESTORE                          fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:48.485776 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.485776 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.485776 +0000 +0000  0  NULL  NULL
        	            	857950088525611009  RESTORE                          fake job                                                                                                                                                                               testuser  {}  failed            NULL  2023-04-19 09:19:48.53935 +0000 +0000   NULL                                    NULL                                    2023-04-19 09:19:48.53935 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.53935 +0000 +0000   0  NULL  NULL
        	            	857950088717303809  RESTORE                          fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:48.597843 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.597843 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.597843 +0000 +0000  0  NULL  NULL
        	            	857950088914272257  RESTORE                          fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:48.657956 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.657956 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.657956 +0000 +0000  0  NULL  NULL
        	            	857950089090990081  RESTORE                          fake job                                                                                                                                                                               testuser  {}  reverting         NULL  2023-04-19 09:19:48.711885 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.711885 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.711885 +0000 +0000  0  NULL  NULL
        	            	857950089293725697  RESTORE                          fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:48.77376 +0000 +0000   NULL                                    NULL                                    2023-04-19 09:19:48.77376 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.77376 +0000 +0000   0  NULL  NULL
        	            	857950089472311297  RESTORE                          fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:48.828242 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.828242 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.828242 +0000 +0000  0  NULL  NULL
        	            	857950089656598529  RESTORE                          fake job                                                                                                                                                                               testuser  {}  succeeded         NULL  2023-04-19 09:19:48.884494 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.884494 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.884494 +0000 +0000  0  NULL  NULL
        	            	857950089831809025  RESTORE                          fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:48.93797 +0000 +0000   NULL                                    NULL                                    2023-04-19 09:19:48.93797 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.93797 +0000 +0000   0  NULL  NULL
        	            	857950090013245441  RESTORE                          fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:48.993341 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:48.993341 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:48.993341 +0000 +0000  0  NULL  NULL
        	            	857950090210574337  RESTORE                          fake job                                                                                                                                                                               testuser  {}  canceled          NULL  2023-04-19 09:19:49.053547 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.053547 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.053547 +0000 +0000  0  NULL  NULL
        	            	857950090509844481  RESTORE                          fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:49.144897 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.144897 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.144897 +0000 +0000  0  NULL  NULL
        	            	857950090745413633  RESTORE                          fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:49.216768 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.216768 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.216768 +0000 +0000  0  NULL  NULL
        	            	857950091058216961  RESTORE                          fake job                                                                                                                                                                               testuser  {}  cancel-requested  NULL  2023-04-19 09:19:49.312227 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.312227 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.312227 +0000 +0000  0  NULL  NULL
        	            	857950091293032449  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:49.383885 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.383885 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.383885 +0000 +0000  0  NULL  NULL
        	            	857950091514118145  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:49.451368 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.451368 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.451368 +0000 +0000  0  NULL  NULL
        	            	857950091633131521  AUTO CREATE STATS                Table statistics refresh for system.public.users                                             CREATE STATISTICS __auto__ FROM [4] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-19 09:19:49.487661 +0000 +0000  2023-04-19 09:19:49.629528 +0000 +0000  NULL                                    2023-04-19 09:19:49.580714 +0000 +0000  0  NULL    1     7609420324559961919  2023-04-19 09:19:49.629546 +0000 +0000  2023-04-20 09:19:49.629546 +0000 +0000  1  NULL  NULL
        	            	857950091766595585  RESTORE                          fake job                                                                                                                                                                               testuser  {}  pause-requested   NULL  2023-04-19 09:19:49.528412 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:19:49.528412 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:19:49.528412 +0000 +0000  0  NULL  NULL
    --- FAIL: TestJobControlByType/resume_ALL_BACKUP_JOBS (7.15s)

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

jobs.TestJobControlByType failed with artifacts on master @ a4ab6b6243f509e62993b4d81855f23470d9901a:

        	            	857954859833360385  AUTO CREATE STATS                Table statistics refresh for system.public.statement_diagnostics_requests                    CREATE STATISTICS __auto__ FROM [35] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  succeeded         NULL  2023-04-19 09:44:04.626886 +0000 +0000  2023-04-19 09:44:04.716423 +0000 +0000  2023-04-19 09:44:06.456732 +0000 +0000  2023-04-19 09:44:06.456852 +0000 +0000  1  NULL    1     4901452718986661710  2023-04-19 09:44:04.716428 +0000 +0000  2023-04-20 09:44:04.716428 +0000 +0000  1  NULL  NULL
        	            	857954859937071105  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-19 09:44:04.658557 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.658557 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.658557 +0000 +0000  0  NULL  NULL
        	            	857954860052250625  BACKUP                           fake job                                                                                                                                                                                testuser  {}  paused            NULL  2023-04-19 09:44:04.693718 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.693718 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.693718 +0000 +0000  0  NULL  NULL
        	            	857954860267208705  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:04.759314 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.759314 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.759314 +0000 +0000  0  NULL  NULL
        	            	857954860398870529  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:04.799493 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.799493 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.799493 +0000 +0000  0  NULL  NULL
        	            	857954860546064385  BACKUP                           fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:04.844402 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.844402 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.844402 +0000 +0000  0  NULL  NULL
        	            	857954860655214593  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:04.877716 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.877716 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.877716 +0000 +0000  0  NULL  NULL
        	            	857954860770656257  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:04.912946 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.912946 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.912946 +0000 +0000  0  NULL  NULL
        	            	857954860885999617  BACKUP                           fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:04.948155 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.948155 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.948155 +0000 +0000  0  NULL  NULL
        	            	857954861006094337  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:04.984803 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:04.984803 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:04.984803 +0000 +0000  0  NULL  NULL
        	            	857954861122256897  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:05.020256 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.020256 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.020256 +0000 +0000  0  NULL  NULL
        	            	857954861261881345  BACKUP                           fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:05.062861 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.062861 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.062861 +0000 +0000  0  NULL  NULL
        	            	857954861370015745  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:05.095861 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.095861 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.095861 +0000 +0000  0  NULL  NULL
        	            	857954861483065345  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:05.130357 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.130357 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.130357 +0000 +0000  0  NULL  NULL
        	            	857954861590249473  BACKUP                           fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:05.163069 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.163069 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.163069 +0000 +0000  0  NULL  NULL
        	            	857954861698351105  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.196058 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.196058 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.196058 +0000 +0000  0  NULL  NULL
        	            	857954861804388353  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.228417 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.228417 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.228417 +0000 +0000  0  NULL  NULL
        	            	857954861950730241  BACKUP                           fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.273083 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.273083 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.273083 +0000 +0000  0  NULL  NULL
        	            	857954862060568577  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:05.306592 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.306592 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.306592 +0000 +0000  0  NULL  NULL
        	            	857954862185906177  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:05.344846 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.344846 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.344846 +0000 +0000  0  NULL  NULL
        	            	857954862304722945  BACKUP                           fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:05.381115 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.381115 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.381115 +0000 +0000  0  NULL  NULL
        	            	857954862411874305  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.413807 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.413807 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.413807 +0000 +0000  0  NULL  NULL
        	            	857954862522630145  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.447609 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.447609 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.447609 +0000 +0000  0  NULL  NULL
        	            	857954862639185921  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.483177 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.483177 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.483177 +0000 +0000  0  NULL  NULL
        	            	857954862758592513  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.519624 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.519624 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.519624 +0000 +0000  0  NULL  NULL
        	            	857954862909456385  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.565666 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.565666 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.565666 +0000 +0000  0  NULL  NULL
        	            	857954863030468609  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.602595 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.602595 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.602595 +0000 +0000  0  NULL  NULL
        	            	857954863155838977  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.640851 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.640851 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.640851 +0000 +0000  0  NULL  NULL
        	            	857954863275737089  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.677439 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.677439 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.677439 +0000 +0000  0  NULL  NULL
        	            	857954863391342593  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:05.712729 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.712729 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.712729 +0000 +0000  0  NULL  NULL
        	            	857954863521071105  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:05.752309 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.752309 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.752309 +0000 +0000  0  NULL  NULL
        	            	857954863636676609  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:05.787591 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.787591 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.787591 +0000 +0000  0  NULL  NULL
        	            	857954863744024577  RESTORE                          fake job                                                                                                                                                                                testuser  {}  failed            NULL  2023-04-19 09:44:05.820349 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.820349 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.820349 +0000 +0000  0  NULL  NULL
        	            	857954863847407617  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:05.8519 +0000 +0000    NULL                                    NULL                                    2023-04-19 09:44:05.8519 +0000 +0000    0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.8519 +0000 +0000    0  NULL  NULL
        	            	857954863952855041  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:05.884076 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.884076 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.884076 +0000 +0000  0  NULL  NULL
        	            	857954864059645953  RESTORE                          fake job                                                                                                                                                                                testuser  {}  reverting         NULL  2023-04-19 09:44:05.916668 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.916668 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.916668 +0000 +0000  0  NULL  NULL
        	            	857954864165584897  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:05.949001 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.949001 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.949001 +0000 +0000  0  NULL  NULL
        	            	857954864277716993  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:05.983222 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:05.983222 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:05.983222 +0000 +0000  0  NULL  NULL
        	            	857954864387325953  RESTORE                          fake job                                                                                                                                                                                testuser  {}  succeeded         NULL  2023-04-19 09:44:06.016672 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.016672 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.016672 +0000 +0000  0  NULL  NULL
        	            	857954864493494273  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:06.049066 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.049066 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.049066 +0000 +0000  0  NULL  NULL
        	            	857954864601661441  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:06.082078 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.082078 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.082078 +0000 +0000  0  NULL  NULL
        	            	857954864707993601  RESTORE                          fake job                                                                                                                                                                                testuser  {}  canceled          NULL  2023-04-19 09:44:06.114531 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.114531 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.114531 +0000 +0000  0  NULL  NULL
        	            	857954864813539329  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:06.146745 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.146745 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.146745 +0000 +0000  0  NULL  NULL
        	            	857954864920494081  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:06.179384 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.179384 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.179384 +0000 +0000  0  NULL  NULL
        	            	857954865026301953  RESTORE                          fake job                                                                                                                                                                                testuser  {}  cancel-requested  NULL  2023-04-19 09:44:06.211661 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.211661 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.211661 +0000 +0000  0  NULL  NULL
        	            	857954865135779841  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:06.245072 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.245072 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.245072 +0000 +0000  0  NULL  NULL
        	            	857954865253285889  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:06.280937 +0000 +0000  NULL                                    NULL                                    2023-04-19 09:44:06.280937 +0000 +0000  0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.280937 +0000 +0000  0  NULL  NULL
        	            	857954865369088001  RESTORE                          fake job                                                                                                                                                                                testuser  {}  pause-requested   NULL  2023-04-19 09:44:06.31628 +0000 +0000   NULL                                    NULL                                    2023-04-19 09:44:06.31628 +0000 +0000   0  NULL    NULL  0                    NULL                                    2023-04-19 09:44:06.31628 +0000 +0000   0  NULL  NULL
        	            	857954870738812929  AUTO CREATE STATS                Table statistics refresh for system.public.tenant_usage                                      CREATE STATISTICS __auto__ FROM [45] WITH OPTIONS THROTTLING 0.9 AS OF SYSTEM TIME '-30s'  root      {}  running           NULL  2023-04-19 09:44:07.954977 +0000 +0000  2023-04-19 09:44:08.049454 +0000 +0000  NULL                                    2023-04-19 09:44:08.018517 +0000 +0000  0  NULL    1     2980161466478593606  2023-04-19 09:44:08.049459 +0000 +0000  2023-04-20 09:44:08.049459 +0000 +0000  1  NULL  NULL
    --- FAIL: TestJobControlByType/cancel_ALL_RESTORE_JOBS (7.56s)

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@yuzefovich
Copy link
Member

fixed by #101477

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot.
Projects
None yet
Development

No branches or pull requests

2 participants