task: skip existing files on download

[casperdcl]

Don't download files if size/mode time/checksum is the same.

[0x2b3bfa0]

Similarly to #360 (comment), it should be easily feasible for machines, but not that much for Kubernetes.

[DavidGOrtega]

Similarly to #360 (comment), it should be easily feasible for machines, but not that much for Kubernetes.

Lets do it at least for machines.

[0x2b3bfa0]

This is a core feature of rclone and already implemented unless proven otherwise. Tested with a dummy 1 GB file.

terraform {
  required_providers {
    iterative = {
      source = "github.com/iterative/iterative"
    }
  }
}

provider "iterative" {}

resource "iterative_task" "example" {
  cloud   = "aws"
  machine = "m"

  script = <<-END
    #!/bin/sh
    fallocate --length 1G file
  END

  storage {
    workdir = "."
    output  = "file"
  }
}