Skip to content
This repository has been archived by the owner on Aug 21, 2023. It is now read-only.

compress/: support creating a single archive instead of several compressed files #220

Open
lichunzhu opened this issue Dec 23, 2020 · 1 comment
Labels
priority/P2 Medium priority issue

Comments

@lichunzhu
Copy link
Contributor

lichunzhu commented Dec 23, 2020

Feature Request

Is your feature request related to a problem? Please describe:

When dumpling dumps with --compress gzip parameter, dumpling will dump several compressed files. Here is an example:

$ ls export-20201219-200357/
metadata  test-schema-create.sql.gz  test.t-schema.sql.gz  test.t.sql.gz

This behavior is similar to mydumper.

Describe the feature you'd like:

Dumpling can compress these files into one archive. Here is an example:

export-20201219-200357.tar.gz

Describe alternatives you've considered:

Teachability, Documentation, Adoption, Optimization:

@kennytm
Copy link
Collaborator

kennytm commented Dec 23, 2020

you can't write to a tar in parallel, so you still need an intermediate storage to store the incomplete files and write them to the tar.gz in a single thread.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
priority/P2 Medium priority issue
Projects
None yet
Development

No branches or pull requests

3 participants