-
Notifications
You must be signed in to change notification settings - Fork 9.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add dms endpoint s3 attributes to keep format from changing to default on update #14620
Conversation
Updating my fork to catch up with latest changes
@breathingdust could you check this MR please? we also use S3 for DMS as target and need setup "DataFormat=parquet;ParquetVersion=PARQUET_2_0" |
Pull request #21306 has significantly refactored the AWS Provider codebase. As a result, most PRs opened prior to the refactor now have merge conflicts that must be resolved before proceeding. Specifically, PR #21306 relocated the code for all AWS resources and data sources from a single We recognize that many pull requests have been open for some time without yet being addressed by our maintainers. Therefore, we want to make it clear that resolving these conflicts in no way affects the prioritization of a particular pull request. Once a pull request has been prioritized for review, the necessary changes will be made by a maintainer -- either directly or in collaboration with the pull request author. For a more complete description of this refactor, including examples of how old filepaths and function names correspond to their new counterparts: please refer to issue #20000. For a quick guide on how to amend your pull request to resolve the merge conflicts resulting from this refactor and bring it in line with our new code patterns: please refer to our Service Package Refactor Pull Request Guide. |
Thanks so much for this submission! There's a lot of good work here. Unfortunately, many of the issues have been resolved apart from this PR. We value your time in submissions and do our best to make sure contributions don't go to waste. We're sorry for this not being used. Rest assured we are always seeking to improve our processes so that this doesn't happen again. |
I'm going to lock this pull request because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. |
This is a resubmission of #11576
Original description:
I've tested functionality to dms endpoint for the issue that I want to address.
Issue: Given a created dms migration with an s3 target endpoint in parquet format, if you updated and execute a terraform update the target endpoint format reverts to csv.
With current changes: Created a dms migration with an s3 target endpoint, then changed the name of the bucket, ran terraform apply and verified the migration still proceeded with original parquet format.
Relates to #11576
Community Note
Relates to #11576
Release note for CHANGELOG:
ENHANCEMENTS:
resource/aws_dms_endpoint: Added missing
s3_settings
attributesServiceAccessRoleArn, ExternalTableDefinition, CsvRowDelimiter, CsvDelimiter, BucketFolder, BucketName, CompressionType, TimestampColumnName, DataFormat, ParquetVersion, EncryptionMode, ServerSideEncryptionKmsKeyId
Output from acceptance testing: