Feature/marl

[Mark2000]

Description

Closes #184

Adds asynchronous multiagent training utilities for RLlib. Modernizes logging and connectors to work with RLlib 2.35.0 (latest release).

Type of change

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)

How should this pull request be reviewed?

• By commit
• All changes at once

How Has This Been Tested?

Tests still pass. Connectors and logging are tested in documentation examples.

Passes Tests

• Unit tests pytest --cov bsk_rl --cov-report term-missing tests/unittest
• Integrated tests pytest --cov bsk_rl --cov-report term-missing tests/integration
• Documentation builds cd docs; make html

Test Configuration

• Python: 3.10.11
• Basilisk: 2.4
• Platform: Mac

Checklist:

• My code follows the style guidelines of this project (passes Black, ruff, and isort)
• I have performed a self-review of my code
• I have commented my code in hard-to-understand areas
• I have made corresponding changes to the documentation and release notes
• Commit messages are atomic, are in the form Issue #XXX: Message and have a useful message
• My changes generate no new warnings
• I have added tests that prove my fix is effective or that my feature works
• If I changed an example ipynb, I have locally rebuilt the documentation

[Mark2000]

TODO add example scripts for single and multiagent training. (DONE)

[Mark2000]

TODO add to release notes [done]

[Yume27]

Those are great example scripts for the new RLlib environment! I ran pytest and all the Jupyter Notebook example scripts. It passed all the tests and the example scripts worked.