Integration tests using solid docker builds to check operations in live scenario

[blythed]

Why

We would like to make our testing environment as isolated as much as possible.

To start with, we should run mongodb in a dedicated container and clean its state for each test.

Eventually we will need to integrate more 3rd-party components and docker-based test fixtures will help use a lot.

How

Use docker-compose or similar to set up clear testing environment, pinning all dependencies. Add component in the compose.yaml file corresponding to all bits and pieces. Can be based on https://github.com/SuperDuperDB/superduperdb-stealth/blob/main/tests/material/supervisord/supervisord.conf.

Currently we have an environment variable SUPERDUPERDB_TEST_REMOTE to toggle integration tests on-off. Potentially necessary to refactor.

What

• test Dask jobs
• test CDC
• test client server
• test jupyter notebooks
• test vector-search