Skip to content

Allow destination AWS account to initiate the DataSync transfer #1

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
C-Collamar opened this issue Dec 13, 2023 · 0 comments · Fixed by #2
Closed

Allow destination AWS account to initiate the DataSync transfer #1

C-Collamar opened this issue Dec 13, 2023 · 0 comments · Fixed by #2
Assignees
Labels
enhancement New feature or request

Comments

@C-Collamar
Copy link
Owner

My use case

I need to do cross-account S3 object transfer with the following constraints:

  1. the bucket-level ownership of the destination bucket is fixed to object writer,
  2. the ACLs of objects from source bucket must be retained when these objects are copied to the destination bucket, and
  3. the copied S3 objects in the destination bucket needs to have object ownership set to the destination AWS account, not the source account.

Problem

If I use this package to do the cross-account S3 transfer via DataSync, the current behavior is that the DataSync task is created and initiated from the source AWS account. This means that when the DataSync transfer task is initiated, the source AWS account effectively becomes the object writer of the copied objects in the destination bucket, violating constraint no. 3.

If I set the bucket-level ownership of the destination bucket to bucket owner enforced (already violating constraint no. 1), this will resolve the issue about objects being owned by the source bucket, at the cost of disabling ACLs and violating constraint no. 2.

Solution

Provide an option for the destination AWS account to be the one that copies S3 objects from source to destination buckets, contrary to the current behavior that the source AWS account is the initiating party. In this case, DataSync-related resources will be created from the destination AWS account.

@C-Collamar C-Collamar added the enhancement New feature or request label Dec 13, 2023
@C-Collamar C-Collamar changed the title Support DataSync transfer initiated from destination AWS account Allow destination AWS account to initiate the DataSync transfer Dec 13, 2023
@C-Collamar C-Collamar self-assigned this Dec 19, 2023
@C-Collamar C-Collamar linked a pull request Dec 20, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant