ccl/importccl: TestImportPgDumpSchemas failed #65878

cockroach-teamcity · 2021-05-29T07:57:47Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 196130b8069778b7065cea3a3667ef07c41953ba:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas727396398
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas727396398
--- FAIL: TestImportPgDumpSchemas (4.27s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210529 07:34:43.794829 524612 jobs/adopt.go:284  [n1] 1  job 662579718614941697: adoption completed with error job 662579718614941697: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 662579718614941697: cannot be reverted, manual cleanup may be required: descriptor not found
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (0.89s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

The text was updated successfully, but these errors were encountered:

cockroach-teamcity · 2021-05-29T14:43:53Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 196130b8069778b7065cea3a3667ef07c41953ba:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas346161340
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas346161340
--- FAIL: TestImportPgDumpSchemas (14.75s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210529 12:37:01.822862 257562 jobs/adopt.go:284  [n1] 1  job 662639149991395329: adoption completed with error job 662639149991395329: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 662639149991395329: cannot be reverted, manual cleanup may be required: descriptor not found
E210529 12:37:01.844945 256673 jobs/registry.go:697  [-] 2  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210529 12:37:01.847753 256673 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.29s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-29T20:40:46Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 196130b8069778b7065cea3a3667ef07c41953ba:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas622679460
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas622679460
--- FAIL: TestImportPgDumpSchemas (15.73s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210529 18:28:09.370210 261681 jobs/adopt.go:284  [n1] 1  job 662708183090790401: adoption completed with error job 662708183090790401: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 662708183090790401: cannot be reverted, manual cleanup may be required: descriptor not found
E210529 18:28:09.391361 260780 jobs/registry.go:707  [-] 2  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.90s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-29T21:47:15Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 7628160a7dfdc73d693f8018772fef8f79c8c0fe:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas387389255
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas387389255
--- FAIL: TestImportPgDumpSchemas (2.90s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210529 21:27:38.623962 407307 jobs/adopt.go:284  [n1] 1  job 662743476220755969: adoption completed with error job 662743476220755969: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 662743476220755969: cannot be reverted, manual cleanup may be required: descriptor not found
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (0.90s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-30T05:23:15Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 7628160a7dfdc73d693f8018772fef8f79c8c0fe:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas077765252
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas077765252
--- FAIL: TestImportPgDumpSchemas (10.86s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210530 05:18:54.037937 226268 jobs/adopt.go:284  [n1] 1  job 662836126504288257: adoption completed with error job 662836126504288257: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 662836126504288257: cannot be reverted, manual cleanup may be required: descriptor not found
E210530 05:18:54.054279 225436 jobs/registry.go:697  [-] 2  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210530 05:18:54.056553 225436 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (2.75s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-race -parallel=4

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-31T05:32:20Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 995f0dd1512d0266e78001980aab0023eab0e70f:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas235838748
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas235838748
--- FAIL: TestImportPgDumpSchemas (9.92s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210531 05:28:25.808367 223766 jobs/adopt.go:284  [n1] 5  job 663121116027944961: adoption completed with error job 663121116027944961: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663121116027944961: cannot be reverted, manual cleanup may be required: descriptor not found
E210531 05:28:25.822460 222754 jobs/registry.go:697  [-] 6  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210531 05:28:25.825142 222754 jobs/registry.go:707  [-] 7  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (2.45s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-race -parallel=4

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-31T07:53:02Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ a64b26d37be6f781532dae4f8e4fc0cd189d075c:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas604462232
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas604462232
--- FAIL: TestImportPgDumpSchemas (13.22s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210531 05:51:33.987278 264329 jobs/adopt.go:284  [n1] 1  job 663125663327420417: adoption completed with error job 663125663327420417: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663125663327420417: cannot be reverted, manual cleanup may be required: descriptor not found
E210531 05:51:34.000140 265231 kv/kvclient/kvcoord/txn_interceptor_committer.go:452  [-] 2  making txn commit explicit failed for "unnamed" meta={id=3770de4e pri=0.00979379 epo=0 ts=1622440293.951603260,1 min=1622440293.931495863,0 seq=5} lock=true stat=STAGING rts=1622440293.951603260,1 wto=false gul=1622440294.431495863,0 int=1 ifw=4: result is ambiguous (server shutdown)
E210531 05:51:34.009361 263294 jobs/registry.go:697  [-] 3  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210531 05:51:34.012208 263294 jobs/registry.go:707  [-] 4  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.27s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-31T13:14:49Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ b4791775a8801b0fee3625bbba9b0db28808371f:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas958124122
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas958124122
--- FAIL: TestImportPgDumpSchemas (14.37s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210531 11:14:35.824574 257407 jobs/adopt.go:284  [n1] 1  job 663189173233811457: adoption completed with error job 663189173233811457: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663189173233811457: cannot be reverted, manual cleanup may be required: descriptor not found
E210531 11:14:35.840873 258364 kv/kvclient/kvcoord/txn_interceptor_committer.go:452  [-] 2  making txn commit explicit failed for "unnamed" meta={id=b521e692 pri=0.00436767 epo=0 ts=1622459675.787275165,0 min=1622459675.787275165,0 seq=5} lock=true stat=STAGING rts=1622459675.787275165,0 wto=false gul=1622459676.287275165,0 int=1 ifw=4: result is ambiguous (server shutdown)
E210531 11:14:35.846273 256574 jobs/registry.go:697  [-] 3  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210531 11:14:35.849003 256574 jobs/registry.go:707  [-] 4  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.55s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-05-31T16:59:12Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ a3d8e3abb6172e91449eafe16f0143d493fc04b3:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas389651550
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas389651550
--- FAIL: TestImportPgDumpSchemas (13.30s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210531 14:56:53.948298 253975 jobs/adopt.go:284  [n1] 2  job 663232880376250369: adoption completed with error job 663232880376250369: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663232880376250369: cannot be reverted, manual cleanup may be required: descriptor not found
E210531 14:56:53.974210 253009 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.40s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-06-01T02:44:02Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 5fb0e29d1da5d09d1d869c2324d14160c0fbd71f:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas841390445
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas841390445
--- FAIL: TestImportPgDumpSchemas (3.45s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 02:23:52.686329 509527 jobs/adopt.go:284  [n1] 1  job 663367949474660353: adoption completed with error job 663367949474660353: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663367949474660353: cannot be reverted, manual cleanup may be required: descriptor not found
E210601 02:23:52.720934 508695 jobs/registry.go:697  [-] 2  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210601 02:23:52.721306 508695 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (0.90s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-06-01T05:24:01Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 7762f00fdb5dd7a65545b684fbd4f0babe383a76:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas861154826
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas861154826
--- FAIL: TestImportPgDumpSchemas (9.55s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 05:20:14.740911 220864 jobs/adopt.go:284  [n1] 1  job 663402622566727681: adoption completed with error job 663402622566727681: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663402622566727681: cannot be reverted, manual cleanup may be required: descriptor not found
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (2.39s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-race -parallel=4

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-06-01T05:34:36Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 7762f00fdb5dd7a65545b684fbd4f0babe383a76:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas486181981
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas486181981
--- FAIL: TestImportPgDumpSchemas (1.81s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 05:33:59.477813 338645 jobs/adopt.go:284  [n1] 1  job 663405327722905601: adoption completed with error job 663405327722905601: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663405327722905601: cannot be reverted, manual cleanup may be required: descriptor not found
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (0.42s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-parallel=4

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-06-01T06:04:40Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 5fb0e29d1da5d09d1d869c2324d14160c0fbd71f:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas879818465
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas879818465
--- FAIL: TestImportPgDumpSchemas (12.31s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 03:57:34.498349 250526 jobs/adopt.go:284  [n1] 1  job 663386367769772033: adoption completed with error job 663386367769772033: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663386367769772033: cannot be reverted, manual cleanup may be required: descriptor not found
E210601 03:57:34.509514 251364 kv/kvclient/kvcoord/txn_interceptor_committer.go:452  [-] 2  making txn commit explicit failed for "unnamed" meta={id=9f98cfaf pri=0.00111372 epo=0 ts=1622519854.438871964,0 min=1622519854.438871964,0 seq=3} lock=true stat=STAGING rts=1622519854.438871964,0 wto=false gul=1622519854.938871964,0 int=1 ifw=1: result is ambiguous (server shutdown)
E210601 03:57:34.517880 249542 jobs/registry.go:697  [-] 3  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210601 03:57:34.520559 249542 jobs/registry.go:707  [-] 4  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.08s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

tbg · 2021-06-01T12:39:46Z

Also failed on #64774

Refs: cockroachdb#65878 Reason: flaky test Generated by bin/skip-test. Release justification: non-production code changes Release note: None

cockroach-teamcity · 2021-06-01T17:27:23Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ af3bebbcbdc8fe732fa4174afb2c93da2729c5c9:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas204109313
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas204109313
--- FAIL: TestImportPgDumpSchemas (13.13s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 15:21:21.164038 258180 jobs/adopt.go:284  [n1] 1  job 663520803377086465: adoption completed with error job 663520803377086465: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663520803377086465: cannot be reverted, manual cleanup may be required: descriptor not found
E210601 15:21:21.181202 257151 jobs/registry.go:697  [-] 2  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210601 15:21:21.183408 257151 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.27s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

cockroach-teamcity · 2021-06-01T17:28:53Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 82a4d1d40259eb10cafee551d10da4bf68b7302e:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas423784398
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas423784398
--- FAIL: TestImportPgDumpSchemas (13.68s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 15:16:27.944859 258307 jobs/adopt.go:284  [n1] 1  job 663519842870067201: adoption completed with error job 663519842870067201: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663519842870067201: cannot be reverted, manual cleanup may be required: descriptor not found
E210601 15:16:27.965265 257295 jobs/registry.go:697  [-] 2  error claiming jobs: could not query jobs table: claim-jobs: context canceled
E210601 15:16:27.969444 257295 jobs/registry.go:707  [-] 3  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.33s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

65867: changefeedccl: Fix flaky tests. r=miretskiy a=miretskiy Fix flaky test and re-enable it to run under stress. The problem was that the transaction executed by the table feed can be restarted. If that happens, then we would see the same keys again, but because we had side effects inside transaction (marking the keys seen), we would not emit those keys causing the test to be hung. The stress race was failing because of both transaction restarts and the 10ms resolved timestamp frequency (with so many resolved timestamps being generated, the table feed transaction was always getting restarted). Fixes #57754 Fixes #65168 Release Notes: None 65868: storage: expose pebble.IteratorStats through {MVCC,Engine}Iterator r=sumeerbhola a=sumeerbhola These will potentially be aggregated before exposing in trace statements, EXPLAIN ANALYZE etc. Release note: None 65900: roachtest: fix ruby-pg test suite r=rafiss a=RichardJCai Update blocklist with passing test. The not run test causing a failure is because the test is no longer failing. Since it is not failing, it shows up under not run. Release note: None 65910: sql/gcjob: retry failed GC jobs r=ajwerner a=sajjadrizvi In the previous implementation, failed GC jobs were not being retried regardless whether the failure is permanent or transient. As a result, a GC job's failure risked orphaned data, which cannot be reclaimed. This commit adds a mechanism to retry failed GC jobs that are not permanent. No limit is set on the number of retries. For the time being, the failure type is determined based on the failure categorization of schema-change jobs. This behavior is expected to change once exponential backoff mechanism is implemented for failed jobs (#44594). Release note: None Fixes: #65000 Release note (<category, see below>): <what> <show> <why> 65925: ccl/importccl: skip TestImportPgDumpSchemas/inject-error-ensure-cleanup r=tbg a=adityamaru Refs: #65878 Reason: flaky test Generated by bin/skip-test. Release justification: non-production code changes Release note: None 65933: kv/kvserver: skip TestReplicateQueueDeadNonVoters under race r=sumeerbhola a=sumeerbhola Refs: #65932 Reason: flaky test Generated by bin/skip-test. Release justification: non-production code changes Release note: None 65934: kv/kvserver: skip TestReplicateQueueSwapVotersWithNonVoters under race r=sumeerbhola a=sumeerbhola Refs: #65932 Reason: flaky test Generated by bin/skip-test. Release justification: non-production code changes Release note: None 65936: jobs: fix flakey TestMetrics r=fqazi a=ajwerner Fixes #65735 The test needed to wait for the job to be fully marked as paused. Release note: None Co-authored-by: Yevgeniy Miretskiy <yevgeniy@cockroachlabs.com> Co-authored-by: sumeerbhola <sumeer@cockroachlabs.com> Co-authored-by: richardjcai <caioftherichard@gmail.com> Co-authored-by: Sajjad Rizvi <sajjad@cockroachlabs.com> Co-authored-by: Aditya Maru <adityamaru@gmail.com> Co-authored-by: Andrew Werner <awerner32@gmail.com>

cockroach-teamcity · 2021-06-01T20:27:32Z

ccl/importccl.TestImportPgDumpSchemas failed with artifacts on master @ 82a4d1d40259eb10cafee551d10da4bf68b7302e:

=== RUN   TestImportPgDumpSchemas
    test_log_scope.go:73: test logs captured to: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas923752835
    test_log_scope.go:74: use -show-logs to present logs inline
=== CONT  TestImportPgDumpSchemas
    import_stmt_test.go:6293: -- test log scope end --
test logs left over in: /go/src/github.com/cockroachdb/cockroach/artifacts/logTestImportPgDumpSchemas923752835
--- FAIL: TestImportPgDumpSchemas (13.53s)
=== RUN   TestImportPgDumpSchemas/inject-error-ensure-cleanup
E210601 18:25:48.370403 262017 jobs/adopt.go:284  [n1] 1  job 663557068556959745: adoption completed with error job 663557068556959745: cannot be reverted, manual cleanup may be required: descriptor not found
    import_stmt_test.go:6220: expected error 'testing injected failure', got: pq: job 663557068556959745: cannot be reverted, manual cleanup may be required: descriptor not found
E210601 18:25:48.393094 261192 jobs/registry.go:707  [-] 2  error processing claimed jobs: could not query for claimed jobs: select-running/get-claimed-jobs: context canceled
    --- FAIL: TestImportPgDumpSchemas/inject-error-ensure-cleanup (3.27s)

Reproduce

To reproduce, try:

make stressrace TESTS=TestImportPgDumpSchemas PKG=./pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

GOFLAGS=-json

/cc @cockroachdb/bulk-io adityamaru _{This test on roachdash | Improve this report!}

ajwerner · 2021-06-02T15:55:30Z

@fqazi I have a strong suspicion that this is due to #64897. I suspect that we're now hitting an error inside revert (which is not a good thing). Could you take a look?

fqazi · 2021-06-02T15:56:42Z

I'll take a look @ajwerner

ajwerner · 2021-06-09T15:09:12Z

We're having a very hard time reproducing this one, even on an older SHA. It's interesting because it was failing so consistently. I cannot find artifacts for any of these failed builds which is hindering progress.

ajwerner · 2021-07-13T14:13:13Z

Faizan to re-enable when he returns?

68110: sql: re-enable test TestImportPgDumpSchemas/inject-error-ensure-cleanup r=postamar a=fqazi Fixes: #65878 Previously, this test was disable because it was acting flaky and failing in a fairly consistent manner. This was inadequate because the flaky failures have disappeared. To address this, this patch re-enables the test since we can't reproduce the failure after multiple attempts. Release note: None 68131: bazel: start building generated documentation using bazel in ci r=rail a=rickystewart In the Linux CI job, build the documentation and ensure it's byte-for- byte identical with what we have in tree. Also make a quick change to generate `settings.html` correctly. Part of #68130. Release note: None 68137: delegate: SHOW GRANTS ON TYPE works across DBs r=RichardJCai a=rafiss fixes #67512 Release note (bug fix): Previously, a `SHOW GRANTS ON TYPE db.public.typ` command would not correctly show the grants if the current database was not `db`. This is fixed now. Co-authored-by: Faizan Qazi <faizan@cockroachlabs.com> Co-authored-by: Ricky Stewart <ricky@cockroachlabs.com> Co-authored-by: Rafi Shamim <rafi@cockroachlabs.com>

cockroach-teamcity added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. labels May 29, 2021

tbg mentioned this issue Jun 1, 2021

kvserver: add TestElectionAfterRestart, remove roachtest/election-after-restart #64774

Merged

adityamaru added a commit to adityamaru/cockroach that referenced this issue Jun 1, 2021

ccl/importccl: skip TestImportPgDumpSchemas

04c6a25

Refs: cockroachdb#65878 Reason: flaky test Generated by bin/skip-test. Release justification: non-production code changes Release note: None

adityamaru mentioned this issue Jun 1, 2021

ccl/importccl: skip TestImportPgDumpSchemas/inject-error-ensure-cleanup #65925

Merged

adityamaru added the skipped-test label Jun 1, 2021

mwang1026 added the A-disaster-recovery label Jun 1, 2021

blathers-crl bot added the T-disaster-recovery label Jun 1, 2021

mwang1026 assigned adityamaru Jun 1, 2021

ajwerner assigned fqazi Jun 2, 2021

exalate-issue-sync bot unassigned adityamaru Jul 9, 2021

exalate-issue-sync bot added T-disaster-recovery T-sql-schema-deprecated Use T-sql-foundations instead and removed T-disaster-recovery labels Jul 9, 2021

fqazi mentioned this issue Jul 27, 2021

sql: re-enable test TestImportPgDumpSchemas/inject-error-ensure-cleanup #68110

Merged

craig bot closed this as completed in 080b31a Jul 28, 2021

exalate-issue-sync bot added T-sql-foundations SQL Foundations Team (formerly SQL Schema + SQL Sessions) and removed T-sql-schema-deprecated Use T-sql-foundations instead labels May 10, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ccl/importccl: TestImportPgDumpSchemas failed #65878

ccl/importccl: TestImportPgDumpSchemas failed #65878

cockroach-teamcity commented May 29, 2021 •

edited by exalate-issue-sync bot

Loading

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 30, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

tbg commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

ajwerner commented Jun 2, 2021

fqazi commented Jun 2, 2021

ajwerner commented Jun 9, 2021

ajwerner commented Jul 13, 2021

ccl/importccl: TestImportPgDumpSchemas failed #65878

ccl/importccl: TestImportPgDumpSchemas failed #65878

Comments

cockroach-teamcity commented May 29, 2021 • edited by exalate-issue-sync bot Loading

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 29, 2021

cockroach-teamcity commented May 30, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented May 31, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

tbg commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

cockroach-teamcity commented Jun 1, 2021

ajwerner commented Jun 2, 2021

fqazi commented Jun 2, 2021

ajwerner commented Jun 9, 2021

ajwerner commented Jul 13, 2021

cockroach-teamcity commented May 29, 2021 •

edited by exalate-issue-sync bot

Loading