Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Streaming pull #8

Merged
merged 3 commits into from
Jul 28, 2017
Merged

Streaming pull #8

merged 3 commits into from
Jul 28, 2017

Conversation

petrosagg
Copy link
Contributor

This PR changes the pull behaviour to download and extract at the same time, without first buffering the layer to disk. This reduces the required space for a pull to be exactly the size of the downloaded layers and minimises disk IO.

start extracting as soon as the data starts coming from the network.
This reduces the free space required for a docker pull to happen since
there are no temp files.

Digest verification happens when the last byte of the layer is read.
If verification fails we return an error that will cascade to the layer
store and cancel the pull.

Signed-off-by: Petros Angelatos <petrosagg@gmail.com>
Attempt to resume a download if it stops midway for up to
maxDownloadAttempts times.

Signed-off-by: Petros Angelatos <petrosagg@gmail.com>
@petrosagg petrosagg requested a review from zozo123 July 28, 2017 04:37
@petrosagg petrosagg merged commit 9d1e6e4 into 17.06-resin Jul 28, 2017
@petrosagg petrosagg deleted the stream-pull branch July 28, 2017 07:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant