CI Failure (KafkaException) in TransactionsTest.check_pids_overflow_test

[StephanDollberg]

https://buildkite.com/redpanda/redpanda/builds/40666

Module: rptest.tests.transactions_test
Class: TransactionsTest
Method: check_pids_overflow_test

test_id:    TransactionsTest.check_pids_overflow_test
status:     FAIL
run time:   31.179 seconds

KafkaException(KafkaError{FATAL,code=OUT_OF_ORDER_SEQUENCE_NUMBER,val=45,str="ProduceRequest for topic-xvamkvkwuc [0] with 1 message(s) failed due to sequence desynchronization with broker 1 (PID{Id:49,Epoch:0}, base seq 1, idemp state change 6990ms ago, last partition error NO_ERROR (actions , base seq 0..0, base msgid 0, -1ms ago)"})
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 82, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/transactions_test.py", line 795, in check_pids_overflow_test
    producers[last_worked_producers + i].flush()
cimpl.KafkaException: KafkaError{FATAL,code=OUT_OF_ORDER_SEQUENCE_NUMBER,val=45,str="ProduceRequest for topic-xvamkvkwuc [0] with 1 message(s) failed due to sequence desynchronization with broker 1 (PID{Id:49,Epoch:0}, base seq 1, idemp state change 6990ms ago, last partition error NO_ERROR (actions , base seq 0..0, base msgid 0, -1ms ago)"}

JIRA Link: CORE-1572

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/44241

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45585
*https://buildkite.com/redpanda/redpanda/builds/45586
*https://buildkite.com/redpanda/redpanda/builds/45588
*https://buildkite.com/redpanda/redpanda/builds/45605
*https://buildkite.com/redpanda/redpanda/builds/45606

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45673
*https://buildkite.com/redpanda/redpanda/builds/45675
*https://buildkite.com/redpanda/redpanda/builds/45677

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45727#018e1270-3f22-4e0b-a618-35c0874fd509
*https://buildkite.com/redpanda/redpanda/builds/45754#018e156c-577d-4ca7-a79f-477bf36d9685

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45800#018e1a0c-4a1b-4862-9536-6d1c898f1466

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45908#018e206e-82f4-411d-9a22-6fd8cc7a9c98
*https://buildkite.com/redpanda/redpanda/builds/45924#018e21dd-f833-4406-a5e3-7963d263de1f
*https://buildkite.com/redpanda/redpanda/builds/45930#018e251b-8649-4be6-96d3-6c47a0c923bb
*https://buildkite.com/redpanda/redpanda/builds/45959#018e2c33-52c1-4a91-8659-f8b90a901e0a
*https://buildkite.com/redpanda/redpanda/builds/46058#018e3348-10ba-4366-9c2c-cf57496ddb92

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46161

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46333

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46377

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46394

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46623

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/46682

[piyushredpanda]

Not seen in at least two months, closing