-
Notifications
You must be signed in to change notification settings - Fork 2
Description
Describe the bug
See https://github.com/xmtp/xmtp-qa-tools/actions/runs/18988341680 for example
Currently, the network chaos tests run through GH actions are unstable and often fail. This is possibly due to instability of the GH Actions environment when running complex network shaping operations with traffic control and iptables.
When run locally, the tests have a 100% pass rate (as of Node SDK ~3.2.1).
Need to investigate how to make these tests more stable, because the infra failures are nullifying any useful info about underlying product issues.
Expected behavior
Test suite should pass barring underlying SDK/V3 issues.
Steps to reproduce the bug
View several of the latest pipeline runs such as:
https://github.com/xmtp/xmtp-qa-tools/actions/runs/18988341680
When running the suite against a local 4-node environment the pass rate is much 90%+.