Automated regression testing of binaries

[jm-clius]

Background

The nim-waku codebase incorporates a large number of unit tests with a fair amount of code coverage (though this could probably be measured and evaluated). These tests are run as part of regular CI testing and have been invaluable in detecting and fixing regression bugs.

However, we have very few regular tests that cover the integrated functionality of a wakunode2 and no tests that ensure that our compiled binaries function as expected. In short, we need proper "black-box testing" that run at regular intervals.

A test could, for example, create and run the wakunode2 binary (similar to the simulation here) and test its external functionality via the JSON-RPC API.

Acceptance criteria

Black-box test that:

• tests configuring and setting up all binaries (wakunode2, chat2, chat2bridge, etc.)
• uses the JSON-RPC to test basic functionality
• runs at regular intervals (e.g. nightly)

Either Jenkins jobs or GH workflows should be suitable for setting up and automatic the test(s).

[jm-clius]

Replaced by more specific issues, such as: status-im/infra-nim-waku#79