AWS DataSync Scheduling

[gazoakley]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Description

AWS have announced support for scheduled tasks for AWS Datasync: https://aws.amazon.com/about-aws/whats-new/2019/11/aws-datasync-adds-the-ability-to-schedule-data-transfers/

You can now schedule AWS DataSync transfers between NFS servers, SMB servers, Amazon S3, and Amazon Elastic File System (Amazon EFS). DataSync task scheduling enables you to periodically execute a transfer task to detect and copy changes from your source storage system to the destination.

New or Affected Resource(s)

• aws_datasync_task

Potential Terraform Configuration

resource "aws_datasync_task" "example" {
  destination_location_arn = "${aws_datasync_location_s3.destination.arn}"
  name                     = "example"
  source_location_arn      = "${aws_datasync_location_nfs.source.arn}"

  schedule {
    schedule_expression = "<cron expression>"
  }
}

References

• https://docs.aws.amazon.com/datasync/latest/userguide/API_CreateTask.html
• https://docs.aws.amazon.com/datasync/latest/userguide/API_UpdateTask.html
• https://docs.aws.amazon.com/datasync/latest/userguide/API_TaskSchedule.html

[ewbankkit]

Requires AWS SDK v1.25.39:

• Update module aws/aws-sdk-go to v1.25.42 #10955

[Hitesh-Agrawal]

We need this part of the terraform resource to schedule our datasync task.

[gonzaloraisin]

Voted. Could you add filtering feature to the request? Thanks

[mehfuzh]

This is absolutely important to automate the data sync task,
+ 1

[bzcnsh]

shocked to find out that I cannot schedule/kick off the task with terraform, after spending hours setting up all the groundwork for EFS replication using terraform.
the ability to schedule task runs is absolutely needed.

[DrFaust92]

Ill take a crack at it.

[gazoakley]

@DrFaust92 Go for it - I don't have any plans to work on this right now 👍

[tmx-dxiao]

DataSync scheduling is a must have! The current Terraform datasync task does not support scheduling, does not support specify log level... Unbelievable!

[ghost]

DataSync schedule is an absolute must.

[alxgruU]

yes please !!!, this is really necessary !

[smeluski]

Bumping this up! Would be really beneficial to have.

[robmoss2k]

Bump again. Having to use the AWS CLI to manually check the log level's state and schedule and update them if incorrect is painful.

[ghost]

This has been released in version 3.40.0 of the Terraform AWS provider. Please see the Terraform documentation on provider versioning or reach out if you need any assistance upgrading.

For further feature requests or bug reports with this functionality, please create a new GitHub issue following the template for triage. Thanks!

[github-actions]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.