Skip to content

Commit

Permalink
Greg/teradata ssl (airbytehq#23708)
Browse files Browse the repository at this point in the history
* Added SSL support for teradata connector.
Modified database size from 1GB to 120 MB for schema creating from Airbyte.

* Update TeradataDestinationSSLAcceptanceTest.java

PR Review comments addressed.

* Update TeradataDestination.java

Removed unnecessary log statement

* Deleting/Droping all tables created as part of integration testing in teardown method.

* bump version

* auto-bump connector version

---------

Co-authored-by: SatishChGit <satishchinthanippu@gmail.com>
Co-authored-by: Octavia Squidington III <octavia-squidington-iii@users.noreply.github.com>
  • Loading branch information
3 people authored Mar 3, 2023
1 parent c03909a commit 72b2f8e
Show file tree
Hide file tree
Showing 5 changed files with 136 additions and 9 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -433,7 +433,7 @@
- name: Teradata Vantage
destinationDefinitionId: 58e6f9da-904e-11ed-a1eb-0242ac120002
dockerRepository: airbyte/destination-teradata
dockerImageTag: 0.1.0
dockerImageTag: 0.1.1
icon: teradata.svg
documentationUrl: https://docs.airbyte.io/integrations/destinations/teradata
releaseStage: alpha
Expand Down
136 changes: 131 additions & 5 deletions airbyte-config/init/src/main/resources/seed/destination_specs.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -7179,7 +7179,7 @@
supported_destination_sync_modes:
- "overwrite"
- "append"
- dockerImage: "airbyte/destination-teradata:0.1.0"
- dockerImage: "airbyte/destination-teradata:0.1.1"
spec:
documentationUrl: "https://docs.airbyte.io/integrations/destinations/teradata"
connectionSpecification:
Expand All @@ -7200,23 +7200,149 @@
title: "User"
description: "Username to use to access the database."
type: "string"
order: 4
order: 1
password:
title: "Password"
description: "Password associated with the username."
type: "string"
airbyte_secret: true
order: 5
order: 2
schema:
title: "Default Schema"
description: "The default schema tables are written to if the source does\
\ not specify a namespace. The usual value for this field is \"public\"\
."
type: "string"
examples:
- "public"
default: "public"
- "airbyte_td"
default: "airbyte_td"
order: 3
ssl:
title: "SSL Connection"
description: "Encrypt data using SSL. When activating SSL, please select\
\ one of the connection modes."
type: "boolean"
default: false
order: 5
ssl_mode:
title: "SSL modes"
description: "SSL connection modes. \n <b>disable</b> - Chose this mode\
\ to disable encryption of communication between Airbyte and destination\
\ database\n <b>allow</b> - Chose this mode to enable encryption only\
\ when required by the destination database\n <b>prefer</b> - Chose this\
\ mode to allow unencrypted connection only if the destination database\
\ does not support encryption\n <b>require</b> - Chose this mode to always\
\ require encryption. If the destination database server does not support\
\ encryption, connection will fail\n <b>verify-ca</b> - Chose this mode\
\ to always require encryption and to verify that the destination database\
\ server has a valid SSL certificate\n <b>verify-full</b> - This is the\
\ most secure mode. Chose this mode to always require encryption and to\
\ verify the identity of the destination database server\n See more information\
\ - <a href=\"https://teradata-docs.s3.amazonaws.com/doc/connectivity/jdbc/reference/current/jdbcug_chapter_2.html#URL_SSLMODE\"\
> in the docs</a>."
type: "object"
order: 6
oneOf:
- title: "disable"
additionalProperties: false
description: "Disable SSL."
required:
- "mode"
properties:
mode:
type: "string"
const: "disable"
enum:
- "disable"
default: "disable"
order: 0
- title: "allow"
additionalProperties: false
description: "Allow SSL mode."
required:
- "mode"
properties:
mode:
type: "string"
const: "allow"
enum:
- "allow"
default: "allow"
order: 0
- title: "prefer"
additionalProperties: false
description: "Prefer SSL mode."
required:
- "mode"
properties:
mode:
type: "string"
const: "prefer"
enum:
- "prefer"
default: "prefer"
order: 0
- title: "require"
additionalProperties: false
description: "Require SSL mode."
required:
- "mode"
properties:
mode:
type: "string"
const: "require"
enum:
- "require"
default: "require"
order: 0
- title: "verify-ca"
additionalProperties: false
description: "Verify-ca SSL mode."
required:
- "mode"
- "ssl_ca_certificate"
properties:
mode:
type: "string"
const: "verify-ca"
enum:
- "verify-ca"
default: "verify-ca"
order: 0
ssl_ca_certificate:
type: "string"
title: "CA certificate"
description: "Specifies the file name of a PEM file that contains\
\ Certificate Authority (CA) certificates for use with SSLMODE=verify-ca.\n\
\ See more information - <a href=\"https://teradata-docs.s3.amazonaws.com/doc/connectivity/jdbc/reference/current/jdbcug_chapter_2.html#URL_SSLCA\"\
> in the docs</a>."
airbyte_secret: true
multiline: true
order: 1
- title: "verify-full"
additionalProperties: false
description: "Verify-full SSL mode."
required:
- "mode"
- "ssl_ca_certificate"
properties:
mode:
type: "string"
const: "verify-full"
enum:
- "verify-full"
default: "verify-full"
order: 0
ssl_ca_certificate:
type: "string"
title: "CA certificate"
description: "Specifies the file name of a PEM file that contains\
\ Certificate Authority (CA) certificates for use with SSLMODE=verify-full.\n\
\ See more information - <a href=\"https://teradata-docs.s3.amazonaws.com/doc/connectivity/jdbc/reference/current/jdbcug_chapter_2.html#URL_SSLCA\"\
> in the docs</a>."
airbyte_secret: true
multiline: true
order: 1
jdbc_url_params:
description: "Additional properties to pass to the JDBC URL string when\
\ connecting to the database formatted as 'key=value' pairs separated\
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -14,5 +14,5 @@ ENV APPLICATION destination-teradata

COPY --from=build /airbyte /airbyte

LABEL io.airbyte.version=0.1.0
LABEL io.airbyte.version=0.1.1
LABEL io.airbyte.name=airbyte/destination-teradata
2 changes: 1 addition & 1 deletion connectors.md
Original file line number Diff line number Diff line change
Expand Up @@ -327,7 +327,7 @@
| **Scylla** | <img alt="Scylla icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/scylla.svg" height="30" height="30"/> | Destination | airbyte/destination-scylla:0.1.3 | alpha | [link](https://docs.airbyte.com/integrations/destinations/scylla) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-scylla) | <small>`3dc6f384-cd6b-4be3-ad16-a41450899bf0`</small> |
| **Snowflake** | <img alt="Snowflake icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/snowflake.svg" height="30" height="30"/> | Destination | airbyte/destination-snowflake:0.4.49 | generally_available | [link](https://docs.airbyte.com/integrations/destinations/snowflake) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-snowflake) | <small>`424892c4-daac-4491-b35d-c6688ba547ba`</small> |
| **Streamr** | <img alt="Streamr icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/streamr.svg" height="30" height="30"/> | Destination | ghcr.io/devmate-cloud/streamr-airbyte-connectors:0.0.1 | alpha | [link](https://docs.airbyte.com/integrations/destinations/streamr) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/devmate-cloud) | <small>`eebd85cf-60b2-4af6-9ba0-edeca01437b0`</small> |
| **Teradata Vantage** | <img alt="Teradata Vantage icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/teradata.svg" height="30" height="30"/> | Destination | airbyte/destination-teradata:0.1.0 | alpha | [link](https://docs.airbyte.io/integrations/destinations/teradata) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-teradata) | <small>`58e6f9da-904e-11ed-a1eb-0242ac120002`</small> |
| **Teradata Vantage** | <img alt="Teradata Vantage icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/teradata.svg" height="30" height="30"/> | Destination | airbyte/destination-teradata:0.1.1 | alpha | [link](https://docs.airbyte.io/integrations/destinations/teradata) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-teradata) | <small>`58e6f9da-904e-11ed-a1eb-0242ac120002`</small> |
| **TiDB** | <img alt="TiDB icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/tidb.svg" height="30" height="30"/> | Destination | airbyte/destination-tidb:0.1.0 | alpha | [link](https://docs.airbyte.com/integrations/destinations/tidb) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-tidb) | <small>`06ec60c7-7468-45c0-91ac-174f6e1a788b`</small> |
| **Typesense** | x | Destination | airbyte/destination-typesense:0.1.0 | alpha | [link](https://docs.airbyte.com/integrations/destinations/typesense) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-typesense) | <small>`36be8dc6-9851-49af-b776-9d4c30e4ab6a`</small> |
| **Weaviate** | <img alt="Weaviate icon" src="https://raw.githubusercontent.com/airbytehq/airbyte/master/airbyte-config/init/src/main/resources/icons/weaviate.svg" height="30" height="30"/> | Destination | airbyte/destination-weaviate:0.1.1 | alpha | [link](https://docs.airbyte.com/integrations/destinations/weaviate) | [code](https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/destination-weaviate) | <small>`7b7d7a0d-954c-45a0-bcfc-39a634b97736`</small> |
Expand Down
3 changes: 2 additions & 1 deletion docs/integrations/destinations/teradata.md
Original file line number Diff line number Diff line change
Expand Up @@ -85,4 +85,5 @@ You can also use a pre-existing user but we highly recommend creating a dedicate

| Version | Date | Pull Request | Subject |
|:--------|:-----------|:--------------------------------------------------------------|:---------------------------------|
| 0.1.0 | 2022-12-13 | https://github.com/airbytehq/airbyte/pull/20428 | New Destination Teradata Vantage |
| 0.1.0 | 2022-12-13 | https://github.com/airbytehq/airbyte/pull/20428 | New Destination Teradata Vantage |
| 0.1.1 | 2023-03-03 | https://github.com/airbytehq/airbyte/pull/21760 | Added SSL support |

0 comments on commit 72b2f8e

Please sign in to comment.