Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding allowHosts to all non-GA source database connectors #23455

Merged
merged 40 commits into from
Mar 8, 2023
Merged

Adding allowHosts to all non-GA source database connectors #23455

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
27d5229
https://github.com/airbytehq/airbyte/issues/22372 Adding allowedHosts…
prateekmukhedkar Feb 24, 2023
91c1deb
Automated Change
prateekmukhedkar Feb 24, 2023
b7e09a3
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Feb 24, 2023
0a7de2f
Updated name of "File" source
prateekmukhedkar Feb 25, 2023
49a8a82
Automated Change
prateekmukhedkar Feb 25, 2023
0af62b4
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Feb 27, 2023
7ff4afa
1. Validting with source_specs.yaml on how host name is configured.
prateekmukhedkar Feb 27, 2023
2b80402
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Mar 1, 2023
e03db0f
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Mar 6, 2023
422a502
Bumped up version numbers and release notes.
prateekmukhedkar Mar 7, 2023
5d4cf4b
Revert "Bumped up version numbers and release notes."
prateekmukhedkar Mar 7, 2023
4ee5eb2
Revert "Revert "Bumped up version numbers and release notes.""
prateekmukhedkar Mar 7, 2023
5719049
https://github.com/airbytehq/airbyte/issues/22372 Adding allowedHosts…
prateekmukhedkar Feb 24, 2023
543c0cc
Automated Change
prateekmukhedkar Feb 24, 2023
2b97723
Updated name of "File" source
prateekmukhedkar Feb 25, 2023
a9a6e6b
Automated Change
prateekmukhedkar Feb 25, 2023
078c29e
1. Validting with source_specs.yaml on how host name is configured.
prateekmukhedkar Feb 27, 2023
e394205
Bumped up version numbers and release notes.
prateekmukhedkar Mar 7, 2023
0bc23d2
Revert "Bumped up version numbers and release notes."
prateekmukhedkar Mar 7, 2023
d9f9faa
Revert "Revert "Bumped up version numbers and release notes.""
prateekmukhedkar Mar 7, 2023
1f9a44d
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Mar 7, 2023
1beaa98
Merge branch 'prateekmukhedkar/add-allowedhosts-dbsources-non-ga' of …
prateekmukhedkar Mar 7, 2023
affdb15
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Mar 7, 2023
da2d157
Automated Change
prateekmukhedkar Mar 7, 2023
b8ba970
Not releasing MySQL and MSSQL allowed host changes until Debezium cha…
prateekmukhedkar Mar 7, 2023
6287322
Merge branch 'prateekmukhedkar/add-allowedhosts-dbsources-non-ga' of …
prateekmukhedkar Mar 7, 2023
830e844
Fixed formatting, year (2023)
prateekmukhedkar Mar 7, 2023
5c2fef0
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
2e27d8e
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
a247f8c
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
9a05296
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
55ebece
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
e67118e
auto-bump connector version
octavia-squidington-iii Mar 8, 2023
f692e42
Not releasing allowedHost change for MySQL and MSSQL
prateekmukhedkar Mar 8, 2023
d726a96
Merge branch 'prateekmukhedkar/add-allowedhosts-dbsources-non-ga' of …
prateekmukhedkar Mar 8, 2023
bb6345f
Merge branch 'master' into prateekmukhedkar/add-allowedhosts-dbsource…
prateekmukhedkar Mar 8, 2023
3d213a3
Bumped up version number for DB2 and Clickhouse strict-encrypt versions.
prateekmukhedkar Mar 8, 2023
33533ec
Merge branch 'prateekmukhedkar/add-allowedhosts-dbsources-non-ga' of …
prateekmukhedkar Mar 8, 2023
1926279
Removing Azure-table, Fauna and Redshift because of failing acceptanc…
prateekmukhedkar Mar 8, 2023
46092af
Removing allowedHosts for Source Firebolt because of failing acceptan…
prateekmukhedkar Mar 8, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 27 additions & 6 deletions airbyte-config/init/src/main/resources/seed/source_definitions.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -276,11 +276,15 @@
- name: ClickHouse
sourceDefinitionId: bad83517-5e54-4a3d-9b53-63e85fbd4d7c
dockerRepository: airbyte/source-clickhouse
dockerImageTag: 0.1.15
dockerImageTag: 0.1.16
documentationUrl: https://docs.airbyte.com/integrations/sources/clickhouse
icon: clickhouse.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
- "${tunnel_method.tunnel_host}"
- name: ClickUp
sourceDefinitionId: 311a7a27-3fb5-4f7e-8265-5e4afe258b66
dockerRepository: airbyte/source-clickup-api
Expand Down Expand Up @@ -311,11 +315,14 @@
- name: Cockroachdb
sourceDefinitionId: 9fa5862c-da7c-11eb-8d19-0242ac130003
dockerRepository: airbyte/source-cockroachdb
dockerImageTag: 0.1.19
dockerImageTag: 0.1.20
documentationUrl: https://docs.airbyte.com/integrations/sources/cockroachdb
icon: cockroachdb.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
- name: Coda
sourceDefinitionId: 27f910fd-f832-4b2e-bcfd-6ab342e434d8
dockerRepository: airbyte/source-coda
Expand Down Expand Up @@ -865,11 +872,14 @@
- name: IBM Db2
sourceDefinitionId: 447e0381-3780-4b46-bb62-00a4e3c8b8e2
dockerRepository: airbyte/source-db2
dockerImageTag: 0.1.17
dockerImageTag: 0.1.18
documentationUrl: https://docs.airbyte.com/integrations/sources/db2
icon: db2.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
- name: Insightly
sourceDefinitionId: 38f84314-fe6a-4257-97be-a8dcd942d693
dockerRepository: airbyte/source-insightly
Expand Down Expand Up @@ -1283,11 +1293,15 @@
- name: Oracle DB
sourceDefinitionId: b39a7370-74c3-45a6-ac3a-380d48520a83
dockerRepository: airbyte/source-oracle
dockerImageTag: 0.3.22
dockerImageTag: 0.3.23
documentationUrl: https://docs.airbyte.com/integrations/sources/oracle
icon: oracle.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
- "${tunnel_method.tunnel_host}"
- name: Orb
sourceDefinitionId: 7f0455fb-4518-4ec0-b7a3-d808bf8081cc
dockerRepository: airbyte/source-orb
Expand Down Expand Up @@ -1804,11 +1818,14 @@
- name: Snowflake
sourceDefinitionId: e2d65910-8c8b-40a1-ae7d-ee2416b2bfa2
dockerRepository: airbyte/source-snowflake
dockerImageTag: 0.1.30
dockerImageTag: 0.1.31
documentationUrl: https://docs.airbyte.com/integrations/sources/snowflake
icon: snowflake.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
Comment on lines +1826 to +1828
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it might be called "account_name" for snowflake:
Screenshot 2023-02-24 at 3 20 40 PM

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nope! I was wrong - it's still "host":

airbyte/airbyte-config/init/src/main/resources/seed/source_specs.yaml

Lines 14068 to 14075 in 7da6a3b

host:
description: "The host domain of the snowflake instance (must include the\
\ account, region, cloud environment, and end with snowflakecomputing.com)."
examples:
- "accountname.us-east-2.aws.snowflakecomputing.com"
type: "string"
title: "Account Name"
order: 1

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for pointing me to source_specs.yaml. Turns out it is not host name in all places.

- name: Sonar Cloud
sourceDefinitionId: 3ab1d7d0-1577-4ab9-bcc4-1ff6a4c2c9f2
dockerRepository: airbyte/source-sonar-cloud
Expand Down Expand Up @@ -1909,11 +1926,15 @@
- name: TiDB
sourceDefinitionId: 0dad1a35-ccf8-4d03-b73e-6788c00b13ae
dockerRepository: airbyte/source-tidb
dockerImageTag: 0.2.2
dockerImageTag: 0.2.3
documentationUrl: https://docs.airbyte.com/integrations/sources/tidb
icon: tidb.svg
sourceType: database
releaseStage: alpha
allowedHosts:
hosts:
- "${host}"
- "${tunnel_method.tunnel_host}"
- name: TikTok Marketing
sourceDefinitionId: 4bfac00d-ce15-44ff-95b9-9e3c3e8fbd35
dockerRepository: airbyte/source-tiktok-marketing
Expand Down
12 changes: 6 additions & 6 deletions airbyte-config/init/src/main/resources/seed/source_specs.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2302,7 +2302,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-clickhouse:0.1.15"
- dockerImage: "airbyte/source-clickhouse:0.1.16"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/destinations/clickhouse"
connectionSpecification:
Expand Down Expand Up @@ -2594,7 +2594,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-cockroachdb:0.1.19"
- dockerImage: "airbyte/source-cockroachdb:0.1.20"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/cockroachdb"
connectionSpecification:
Expand Down Expand Up @@ -6748,7 +6748,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-db2:0.1.17"
- dockerImage: "airbyte/source-db2:0.1.18"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/db2"
connectionSpecification:
Expand Down Expand Up @@ -10470,7 +10470,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-oracle:0.3.22"
- dockerImage: "airbyte/source-oracle:0.3.23"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/oracle"
connectionSpecification:
Expand Down Expand Up @@ -14123,7 +14123,7 @@
- - "client_secret"
oauthFlowOutputParameters:
- - "refresh_token"
- dockerImage: "airbyte/source-snowflake:0.1.30"
- dockerImage: "airbyte/source-snowflake:0.1.31"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/snowflake"
connectionSpecification:
Expand Down Expand Up @@ -14974,7 +14974,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-tidb:0.2.2"
- dockerImage: "airbyte/source-tidb:0.2.3"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/tidb"
connectionSpecification:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-clickhouse-strict-encrypt/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-clickhouse-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.15
LABEL io.airbyte.version=0.1.16
LABEL io.airbyte.name=airbyte/source-clickhouse-strict-encrypt
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-clickhouse/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-clickhouse

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.15
LABEL io.airbyte.version=0.1.16
LABEL io.airbyte.name=airbyte/source-clickhouse
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-cockroachdb-strict-encrypt/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-cockroachdb-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.19
LABEL io.airbyte.version=0.1.20
LABEL io.airbyte.name=airbyte/source-cockroachdb-strict-encrypt
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-cockroachdb/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-cockroachdb

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.19
LABEL io.airbyte.version=0.1.20
LABEL io.airbyte.name=airbyte/source-cockroachdb
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-db2-strict-encrypt/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-db2-strict-encrypt

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.17
LABEL io.airbyte.version=0.1.18
LABEL io.airbyte.name=airbyte/source-db2-strict-encrypt
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-db2/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-db2

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.17
LABEL io.airbyte.version=0.1.18
LABEL io.airbyte.name=airbyte/source-db2
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-oracle-strict-encrypt/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,5 @@ ENV TZ UTC

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.3.22
LABEL io.airbyte.version=0.3.23
LABEL io.airbyte.name=airbyte/source-oracle-strict-encrypt
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-oracle/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,5 @@ ENV TZ UTC
COPY build/distributions/${APPLICATION}*.tar ${APPLICATION}.tar
RUN tar xf ${APPLICATION}.tar --strip-components=1

LABEL io.airbyte.version=0.3.22
LABEL io.airbyte.version=0.3.23
LABEL io.airbyte.name=airbyte/source-oracle
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-snowflake/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-snowflake

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.30
LABEL io.airbyte.version=0.1.31
LABEL io.airbyte.name=airbyte/source-snowflake
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-tidb/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,5 @@ ENV APPLICATION source-tidb
COPY --from=build /airbyte /airbyte

# Airbyte's build system uses these labels to know what to name and tag the docker images produced by this Dockerfile.
LABEL io.airbyte.version=0.2.2
LABEL io.airbyte.version=0.2.3
LABEL io.airbyte.name=airbyte/source-tidb
Loading