airbyte-lib snowflake integration

[flash1293]

This PR adds Snowflake support to airbyte-lib.

Changes to enable Snowflake support

As the snowflake sqlalchemy plugin doesn't support sqlalchemy 2, I downgraded to the last version of sqlalchemy 1. IMHO having a slightly outdated version of sqlalchemy is less important than snowflake support. We should check with the Snowflake team whether they are working on upgrading, and we can follow up. This changes some imports in our base class but no major changes were necessary, which makes me think this is OK.

To make the postgres adapter work, I had to add the psycopg2==2.9.9 dependency.

I'm not sure how to implement merge-support for snowflake, so for now the snowflake cache defaults to append instead of overwrite. This should probably be adjusted before release, but I wanted to keep this PR minimal to make the basic functionality work.

Testing

To test the snowflake support, the following setup is used:

• Created a new warehouse, database, user and role for airbyte lib integration testing
• Added these to Lastpass for easy access
• Also added them as a GSM secret
• Added code to load the GSM secret during the test (this requires to have GCP_GSM_CREDENTIALS set up - same applies to running integration tests for connectors locally via airbyte-ci) https://github.com/airbytehq/airbyte/blob/master/airbyte-ci/connectors/ci_credentials/README.md#get-gsm-access
• Added a basic integration test

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
airbyte-docs	⬜️ Ignored (Inspect)	Visit Preview		Jan 19, 2024 4:53pm

[aaronsteers]

Looks great! 👍