Skip to content

Commit

Permalink
🎉 Source redshift & bigquery: emit cursor count in state (#18954)
Browse files Browse the repository at this point in the history
* Bump version for redshift, bigquery, and snowflake

* auto-bump connector version

* auto-bump connector version

* Log failed refresh token response

* Revert snowflake version bump

Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
  • Loading branch information
tuliren and octavia-squidington-iii authored Nov 4, 2022
1 parent 77f3e3b commit 6967d14
Show file tree
Hide file tree
Showing 7 changed files with 9 additions and 9 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -148,7 +148,7 @@
- name: BigQuery
sourceDefinitionId: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c
dockerRepository: airbyte/source-bigquery
dockerImageTag: 0.2.2
dockerImageTag: 0.2.3
documentationUrl: https://docs.airbyte.com/integrations/sources/bigquery
icon: bigquery.svg
sourceType: database
Expand Down Expand Up @@ -1062,7 +1062,7 @@
- name: Redshift
sourceDefinitionId: e87ffa8e-a3b5-f69c-9076-6011339de1f6
dockerRepository: airbyte/source-redshift
dockerImageTag: 0.3.14
dockerImageTag: 0.3.15
documentationUrl: https://docs.airbyte.com/integrations/sources/redshift
icon: redshift.svg
sourceType: database
Expand Down
4 changes: 2 additions & 2 deletions airbyte-config/init/src/main/resources/seed/source_specs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -1626,7 +1626,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-bigquery:0.2.2"
- dockerImage: "airbyte/source-bigquery:0.2.3"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/sources/bigquery"
connectionSpecification:
Expand Down Expand Up @@ -10300,7 +10300,7 @@
supportsNormalization: false
supportsDBT: false
supported_destination_sync_modes: []
- dockerImage: "airbyte/source-redshift:0.3.14"
- dockerImage: "airbyte/source-redshift:0.3.15"
spec:
documentationUrl: "https://docs.airbyte.com/integrations/destinations/redshift"
connectionSpecification:
Expand Down
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-bigquery/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -17,5 +17,5 @@ ENV APPLICATION source-bigquery
COPY --from=build /airbyte /airbyte

# Airbyte's build system uses these labels to know what to name and tag the docker images produced by this Dockerfile.
LABEL io.airbyte.version=0.2.2
LABEL io.airbyte.version=0.2.3
LABEL io.airbyte.name=airbyte/source-bigquery
2 changes: 1 addition & 1 deletion airbyte-integrations/connectors/source-redshift/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -16,5 +16,5 @@ ENV APPLICATION source-redshift

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.3.14
LABEL io.airbyte.version=0.3.15
LABEL io.airbyte.name=airbyte/source-redshift
Original file line number Diff line number Diff line change
Expand Up @@ -123,7 +123,7 @@ public static String getAccessTokenUsingRefreshToken(final String hostName,
} else {
LOGGER.error("Failed to obtain accessToken using refresh token. " + jsonResponse);
throw new RuntimeException(
"Failed to obtain accessToken using refresh token.");
"Failed to obtain accessToken using refresh token. " + jsonResponse);
}
} catch (final InterruptedException e) {
throw new IOException("Failed to refreshToken", e);
Expand Down
2 changes: 1 addition & 1 deletion docs/integrations/sources/bigquery.md
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ Once you've configured BigQuery as a source, delete the Service Account Key from

| Version | Date | Pull Request | Subject |
| :--- | :--- | :--- | :--- |
| | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.2.3 | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.2.2 | 2022-09-22 | [16902](https://github.com/airbytehq/airbyte/pull/16902) | Source BigQuery: added user agent header |
| 0.2.1 | 2022-09-14 | [15668](https://github.com/airbytehq/airbyte/pull/15668) | Wrap logs in AirbyteLogMessage |
| 0.2.0 | 2022-07-26 | [14362](https://github.com/airbytehq/airbyte/pull/14362) | Integral columns are now discovered as int64 fields. |
Expand Down
2 changes: 1 addition & 1 deletion docs/integrations/sources/redshift.md
Original file line number Diff line number Diff line change
Expand Up @@ -54,7 +54,7 @@ All Redshift connections are encrypted using SSL

| Version | Date | Pull Request | Subject |
|:--------|:-----------| :----- |:----------------------------------------------------------------------------------------------------------|
| | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.3.15 | 2022-10-13 | [15535](https://github.com/airbytehq/airbyte/pull/16238) | Update incremental query to avoid data missing when new data is inserted at the same time as a sync starts under non-CDC incremental mode |
| 0.3.14 | 2022-09-01 | [16258](https://github.com/airbytehq/airbyte/pull/16258) | Emit state messages more frequently |
| 0.3.13 | 2022-05-25 | | Added JDBC URL params |
| 0.3.12 | 2022-08-18 | [14356](https://github.com/airbytehq/airbyte/pull/14356) | DB Sources: only show a table can sync incrementally if at least one column can be used as a cursor field |
Expand Down

0 comments on commit 6967d14

Please sign in to comment.