Move to trusted publishing pattern

5.0.3 (2024-08-19)

• Moving to a trusted push to pypi

Apply Dependabots Dependencies - 20240807

5.0.2 (2024-08-13)

• Bump black from 24.4.2 to 24.8.0
• Bump pylint from 3.2.5 to 3.2.6
• Bump mypy from 1.10.1 to 1.11.1
• Bump flake8 from 7.1.0 to 7.1.1
• Bump actions/setup-python from 3 to 5
• Bump pypa/gh-action-pypi-publish from 1.4.2 to 1.9.0

Update README.md to correct locations for package

5.0.1 (2024-08-12)

• Updating the README.md to have the badges point to the correctly published version on PyPI.

Publishing to PyPi

5.0.0 (2024-08-09)

• Renaming repo to realit-singer-python to allow required publishing to PyPI
• NOTE: Will need to urgently update tap-oracle, tap-mssql, tap-s3-csv which are dependent on this.

Updating Python constraints and Bumping Versions

4.0.1 (2024-08-08)

• Correcting Supported Python version constraint in pyproject.toml >=3.8,<3.13
• Bump pytest from 7.4.4 to 8.3.2
• Bump pytz from 2018.9 to 2024.1
• Bump jsonschema from 4.22.0 to 4.23.0
• Bump tox from 4.15.1 to 4.17.1 #35
• Bump coverage from 7.5.4 to 7.6.1 #33

Update test framework and support msgspec serialization.

Description of change

A major update to build and run this framework to be pep8 compliant as much as possible and to modernise the testing framework.

Changes:

1. Moving from setup.py to pyproject.toml and poetry for installation
2. Introducing tox for platform independent testing of pep8 compliance.
3. Introducing black for formatting
4. Introducing isort for compliant and order includes
5. Introducing flake8 for linting alongside pylint
6. Introducing mypy for type checking
7. Updating github actions to run tox tests rather than directly running pytests.
8. Code formatting updates and changes to pass / met the standards above.
9. Deprecating python 3.7

Manual QA steps

• Ensuring all pytests pass
• Ensuring all introduced tox python pep compliant tests pass
• Running against tap-oracle which uses this variant of the singer-python framework
• Ensure performance is good from ORJSON -> MSGSPEC

Performance Results:

• Table A: 455.4k rows, 22.3 MB

• Table B: 848.9k rows, 31.1 MB

• MSGSPEC with Singer Decimal on runtime:

  Start Time 2024-07-08T05:06:48
  End Time 2024-07-08T05:13:27

  Total Time: 6:39 (min/secs) - lag 1:19 (min/sec) before ingesting really kicks in.

• ORJSON with Singer Decimal on runtime:

  Start Time 2024-07-08T05:32:10
  End Time 2024-07-08T05:39:40

  Total Time: 7:30 (min/secs) - lag 1:34 (min/sec) before ingesting really kicks in.

• MSGSPEC with Singer Decimal off runtime:

  Start Time 2024-07-08T05:47:19
  End Time 2024-07-08T05:53:53

  Total Time: 6:34 (min/secs) - lag 0:51 (min/sec) before ingesting really kicks in.

• ORJSON with Singer Decimal off runtime:

  Start Time 2024-07-08T05:55:48
  End Time 2024-07-08T06:03:18

  Total Time: 7:30 (min/secs) - lag 1:13 (min/sec) before ingesting really kicks in.

• Overall performance gain running from tap-oracle to target-snowflake (real world scenario). Close to one minute.

Moving from ORJSON to MSGSPEC serialisation

3.0.0 Major Change

• Moving from ojson for serialization to msgspec for performance gains.
• Bumping various versions of packages
• Moving from jsonschema RefResolver to referencing.jsonschema for dynamic substitution in the schema against a set specification

This release has been made prior to bring dependency updates to get a solid foundation and provide messaging performance gains.