Skip to content

Commit

Permalink
Redshift Destination: update spec
Browse files Browse the repository at this point in the history
  • Loading branch information
VitaliiMaltsev committed Apr 18, 2022
1 parent 92694c9 commit d701e5b
Showing 1 changed file with 13 additions and 13 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@
"host": {
"description": "Host Endpoint of the Redshift Cluster (must include the cluster-id, region and end with .redshift.amazonaws.com)",
"type": "string",
"title": "Host"
"title": "Host *"
},
"port": {
"description": "Port of the database.",
Expand All @@ -23,45 +23,45 @@
"maximum": 65536,
"default": 5439,
"examples": ["5439"],
"title": "Port"
"title": "Port *"
},
"username": {
"description": "Username to use to access the database.",
"type": "string",
"title": "Username"
"title": "Username *"
},
"password": {
"description": "Password associated with the username.",
"type": "string",
"airbyte_secret": true,
"title": "Password"
"title": "Password *"
},
"database": {
"description": "Name of the database.",
"type": "string",
"title": "Database"
"title": "Database *"
},
"schema": {
"description": "The default schema tables are written to if the source does not specify a namespace. Unless specifically configured, the usual value for this field is \"public\".",
"type": "string",
"examples": ["public"],
"default": "public",
"title": "Default Schema"
"title": "Default Schema *"
},
"s3_bucket_name": {
"title": "S3 Bucket Name",
"title": "S3 Bucket Name (Optional)",
"type": "string",
"description": "The name of the staging S3 bucket to use if utilising a COPY strategy. COPY is recommended for production workloads for better speed and scalability. See <a href=\"https://docs.aws.amazon.com/redshift/latest/dg/c_loading-data-best-practices.html\">AWS docs</a> for more details.",
"examples": ["airbyte.staging"]
},
"s3_bucket_path": {
"title": "S3 Bucket Path",
"title": "S3 Bucket Path (Optional)",
"type": "string",
"description": "The directory under the S3 bucket where data will be written. If not provided, then defaults to the root directory.",
"examples": ["data_sync/test"]
},
"s3_bucket_region": {
"title": "S3 Bucket Region",
"title": "S3 Bucket Region (Optional)",
"type": "string",
"default": "",
"description": "The region of the S3 staging bucket to use if utilising a copy strategy.",
Expand Down Expand Up @@ -95,13 +95,13 @@
"access_key_id": {
"type": "string",
"description": "The Access Key Id granting allow one to access the above S3 staging bucket. Airbyte requires Read and Write permissions to the given bucket.",
"title": "S3 Key Id",
"title": "S3 Key Id (Optional)",
"airbyte_secret": true
},
"secret_access_key": {
"type": "string",
"description": "The corresponding secret to the above access key id.",
"title": "S3 Access Key",
"title": "S3 Access Key (Optional)",
"airbyte_secret": true
},
"part_size": {
Expand All @@ -110,10 +110,10 @@
"maximum": 100,
"examples": ["10"],
"description": "Optional. Increase this if syncing tables larger than 100GB. Only relevant for COPY. Files are streamed to S3 in parts. This determines the size of each part, in MBs. As S3 has a limit of 10,000 parts per file, part size affects the table size. This is 10MB by default, resulting in a default limit of 100GB tables. Note, a larger part size will result in larger memory requirements. A rule of thumb is to multiply the part size by 10 to get the memory requirement. Modify this with care.",
"title": "Stream Part Size"
"title": "Stream Part Size (Optional)"
},
"purge_staging_data": {
"title": "Purge Staging Files and Tables",
"title": "Purge Staging Files and Tables (Optional)",
"type": "boolean",
"description": "Whether to delete the staging files from S3 after completing the sync. See the docs for details. Only relevant for COPY. Defaults to true.",
"default": true
Expand Down

1 comment on commit d701e5b

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SonarQube Report

SonarQube report for Airbyte Connectors Destination Redshift(#12100)

Measures

Name Value Name Value Name Value
Duplicated Lines (%) 0.0 Reliability Rating A Security Rating A
Lines to Cover 166 Coverage 0.0 Duplicated Blocks 0
Lines of Code 394 Quality Gate Status OK Vulnerabilities 0
Code Smells 5 Bugs 0 Blocker Issues 0
Critical Issues 2 Major Issues 3 Minor Issues 0

Detected Issues

Rule File Description Message
java:S1068 (MAJOR) redshift/RedshiftInsertDestination.java:21 Unused "private" fields should be removed Remove this unused "LOGGER" private field.
java:S1192 (CRITICAL) redshift/RedshiftInsertDestination.java:51 String literals should not be duplicated Define a constant instead of duplicating this literal "username" 3 times.
java:S1192 (CRITICAL) redshift/RedshiftInsertDestination.java:52 String literals should not be duplicated Define a constant instead of duplicating this literal "password" 4 times.
java:S112 (MAJOR) redshift/RedshiftStreamCopier.java:99 Generic exceptions should never be thrown Define and throw a dedicated exception instead of using a generic one.
java:S112 (MAJOR) redshift/RedshiftDestination.java:70 Generic exceptions should never be thrown Define and throw a dedicated exception instead of using a generic one.

Coverage (0.0%)

File Coverage File Coverage
src/main/java/io/airbyte/integrations/destination/redshift/manifest/Entry.java 0.0 src/main/java/io/airbyte/integrations/destination/redshift/manifest/Manifest.java 0.0
src/main/java/io/airbyte/integrations/destination/redshift/RedshiftCopyS3Destination.java 0.0 src/main/java/io/airbyte/integrations/destination/redshift/RedshiftDestination.java 0.0
src/main/java/io/airbyte/integrations/destination/redshift/RedshiftInsertDestination.java 0.0 src/main/java/io/airbyte/integrations/destination/redshift/RedshiftSQLNameTransformer.java 0.0
src/main/java/io/airbyte/integrations/destination/redshift/RedshiftSqlOperations.java 0.0 src/main/java/io/airbyte/integrations/destination/redshift/RedshiftStreamCopier.java 0.0
src/main/java/io/airbyte/integrations/destination/redshift/RedshiftStreamCopierFactory.java 0.0

Please sign in to comment.