[CERT-TEST-FAILURE] TC_IDM_1_2.py fails with suppress response Step 7 when correctly implemented

[Apollon77]

Feature Area

Other

Test Case

TC_IDM_1_2.py

Reproduction steps

The python test IDM 1.2 is having a note and references to a chip issue regarding "suppress response handling" in chip for invokes.

https://github.com/project-chip/connectedhomeip/blob/master/src/python_testing/TC_IDM_1_2.py#L232-L239

The problem now is that matter.js which is currently certifying the first device has implemented this correctly and so no response is returned.

But the python test expects a response and currently fails with a Timeout because no response sent:

[2024-05-18 13:37:42.573480][APP ][STDOUT]2024-05-18 13:37:42.572 DEBUG  CommandServer        Invoke armFailSafe with data {"expiryLengthSeconds":900,"breadcrumb":2}
[2024-05-18 13:37:42.573493][TEST][STDOUT][MatterTest] 05-18 13:37:42.573 INFO >>> [E:57913i S:1759 M:19800270 (Ack:44963257)] (S) Msg RX from 1:0000000012344321 [9F93] --- Type 0000:10 (SecureChannel:StandaloneAck)
[2024-05-18 13:37:42.573640][APP ][STDOUT]2024-05-18 13:37:42.572 DEBUG  FailsafeContext      Extend failSafe timer for 900s.
[2024-05-18 13:37:42.573774][APP ][STDOUT]2024-05-18 13:37:42.572 DEBUG  CommissioningServer  Storing attribute breadcrumb in cluster GeneralCommissioning (48)
[2024-05-18 13:37:42.573899][APP ][STDOUT]2024-05-18 13:37:42.572 DEBUG  CommandServer        Invoke armFailSafe response : {"errorCode":0,"debugText":""}
[2024-05-18 13:37:42.574122][APP ][STDOUT]2024-05-18 13:37:42.573 DEBUG  ExchangeManager      Message » id: 41987/57913/19800270 type: 0/16 acked: 44963257 reqAck: false duplicate: false payload: 
[2024-05-18 13:37:45.996740][APP ][STDOUT]2024-05-18 13:37:45.994 DEBUG  ExchangeManager      Channel for session secure/41986 is udp://fe80::434:e28c:f5f7:981%en0:65123 on session secure/41986
[2024-05-18 13:37:45.997145][APP ][STDOUT]2024-05-18 13:37:45.995 DEBUG  MessageExchange      New exchange protocol: 0 id: 21594 session: secure/41986 peerSessionId: 1758 active threshold ms: 4000 active interval ms: 300 idle interval ms: 300 retries: 5
[2024-05-18 13:37:45.997313][APP ][STDOUT]2024-05-18 13:37:45.995 DEBUG  ExchangeManager      Initiated exchange true to close session secure/41986
[2024-05-18 13:37:45.997641][APP ][STDOUT]2024-05-18 13:37:45.995 DEBUG  ExchangeManager      Message » id: 1758/21594/91587691 type: 0/64 acked: undefined reqAck: false duplicate: false payload: 0000000000000300
[2024-05-18 13:37:45.997844][APP ][STDOUT]2024-05-18 13:37:45.995 DEBUG  ExchangeManager      Exchange index 87130 Session secure/41986 is already marked for closure. Close session now.
[2024-05-18 13:37:45.997972][APP ][STDOUT]2024-05-18 13:37:45.995 INFO   SessionManager       End PASE session secure/41986
[2024-05-18 13:37:45.999129][TEST][STDOUT][MatterTest] 05-18 13:37:45.998 ERROR Data received on an unknown session (LSID=1758). Dropping it!
[2024-05-18 13:37:48.796137][TEST][STDOUT][MatterTest] 05-18 13:37:48.795 INFO Time out! failed to receive invoke command response from Exchange: 57913i
[2024-05-18 13:37:48.809845][TEST][STDOUT][MatterTest] 05-18 13:37:48.797 ERROR Exception occurred in test_TC_IDM_1_2.
[2024-05-18 13:37:48.809901][TEST][STDOUT]Traceback (most recent call last):
[2024-05-18 13:37:48.809922][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/out/venv/lib/python3.9/site-packages/mobly/base_test.py", line 783, in exec_one_test
[2024-05-18 13:37:48.809933][TEST][STDOUT]    test_method()
[2024-05-18 13:37:48.809942][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/src/python_testing/matter_testing_support.py", line 1386, in async_runner
[2024-05-18 13:37:48.809951][TEST][STDOUT]    return asyncio.run(runner_with_timeout)
[2024-05-18 13:37:48.809960][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/.environment/cipd/packages/python/lib/python3.9/asyncio/runners.py", line 44, in run
[2024-05-18 13:37:48.809969][TEST][STDOUT]    return loop.run_until_complete(main)
[2024-05-18 13:37:48.809977][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/.environment/cipd/packages/python/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete
[2024-05-18 13:37:48.809987][TEST][STDOUT]    return future.result()
[2024-05-18 13:37:48.809995][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/.environment/cipd/packages/python/lib/python3.9/asyncio/tasks.py", line 481, in wait_for
[2024-05-18 13:37:48.810004][TEST][STDOUT]    return fut.result()
[2024-05-18 13:37:48.810013][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/src/python_testing/TC_IDM_1_2.py", line 239, in test_TC_IDM_1_2
[2024-05-18 13:37:48.810022][TEST][STDOUT]    await self.default_controller.SendCommand(nodeid=self.dut_node_id, endpoint=0, payload=cmd, suppressResponse=True)
[2024-05-18 13:37:48.810030][TEST][STDOUT]  File "/Users/ingof/Dev/matter/connectedhomeip/out/venv/lib/python3.9/site-packages/chip/ChipDeviceCtrl.py", line 934, in SendCommand
[2024-05-18 13:37:48.810039][TEST][STDOUT]    return await future
[2024-05-18 13:37:48.810047][TEST][STDOUT]chip.exceptions.ChipStackError: src/app/CommandSender.cpp:334: CHIP Error 0x00000032: Timeout
[2024-05-18 13:37:48.810715][TEST][STDOUT][MatterTest] 05-18 13:37:48.810 INFO 		***** Test Failure : 
[2024-05-18 13:37:48.810816][TEST][STDOUT][MatterTest] 05-18 13:37:48.810 INFO Finished test in 11854ms
[2024-05-18 13:37:48.811014][TEST][STDOUT][MatterTest] 05-18 13:37:48.810 INFO [Test] test_TC_IDM_1_2 ERROR
[2024-05-18 13:37:48.815529][TEST][STDOUT][MatterTest] 05-18 13:37:48.815 INFO Summary for test class TC_IDM_1_2: Error 1, Executed 1, Failed 0, Passed 0, Requested 1, Skipped 0
[2

When I comment out Test 7 then the test passes on matter.js local version (soon in main)

Bug prevalence

known bug

GitHub hash of the SDK that was being used

master

Platform

core

Anything else?

No response