Intermediate layer caching on EKS

[royassis]

Hey

I have a SAM application with multiple AWS lambda functions, that are image based.

Right now we run our CICD pipeline of a Jenkins server that runs on EC2.
All the intermediate docker layers are caches on the instance itself.

We are moving our Jenkins stack (workers and controller) from running on EC2 to EKS, so the layers won't be cached.
There is a solution for this with docker buildkit:
--cache-to and --cache-from.

What is a sutible solution for this when using AWS SAM?

[reedham-aws]

In #8661, I've added the framework for using docker buildkit. I believe once this is merged, it should be possible to use the --cache-to and --cache-from options with BuildKit via the DockerBuildArgs section in the Metadata of the template:

Metadata:
  # ...
  DockerBuildArgs:
    CACHE_TO: !Ref CacheLocation

I haven't thought too much about using other methods to achieve this, but I think this will work with your existing flow once merged.