Per-Stream State Support for API Sources

[brianjlai]

This epic comprises all the tasks required to allow for per-stream state for API source connectors that implement the CDK. It is broken into two milestones. The first is all the changes to the CDK library to receive, process, and emit per-stream state according to the platform interface. The second is the work to migrate all connectors to the per-stream changes by publishing all API source connectors.

Milestone 1 (CDK development + validation)

• [per-stream cdk] Transform incoming LEGACY and per-stream state JSON to AirbyteStateMessage #15977
• [per-stream cdk] Build ConnectorState based on incoming AirbyteStateMessage(s) #16055
• [per-stream cdk] Emit state messages with combined LEGACY and STREAM state #16057
• [per-stream cdk] Update Source Acceptance Tests to support new outbound state messages format #16059
• [per-stream cdk] Migrate 3 connectors to per-stream state #16060

Milestone 2 (Migrating connectors to per-stream state)

• [per-stream state] Migrate GA connectors that implement custom read() #16687
• [per-stream cdk] publish all GA API source connectors #13136

Nice to Haves:

• https://github.com/airbytehq/airbyte-internal-issues/issues/912

The tech spec can be found here:
https://docs.google.com/document/d/1xTt1jCGLab4qy6QOcef6biAL-Kb-N2BBH7Wp8h-dndg/edit?usp=sharing

[brianjlai]

all GA connectors are migrated in OSS and have been released to cloud