Did not use gzip compression

[liuqian1990]

[root@localhost prodwebsite]# mongodb-consistent-backup -H 127.0.0.1 -P 27017 -n prodwebsite --archive.tar.threads 2 --archive.tar.compression gzip -l /home/data/db
[2017-08-14 05:40:34,549] [INFO] [MainProcess] [Main:init:144] Starting mongodb-consistent-backup version 1.1.0 (git commit: 34818a2)
[2017-08-14 05:40:34,549] [INFO] [MainProcess] [Main:init:145] Loaded config: {"archive": {"method": "tar", "tar": {"compression": "gzip", "threads": 2}, "zbackup": {"binary": "/usr/bin/zbackup", "cache_mb": 128, "compression": "lzma"}}, "authdb": "admin", "backup": {"location": "/home/data/db", "method": "mongodump", "mongodump": {"binary": "/usr/bin/mongodump", "compression": "auto"}, "name": "prodwebsite"}, "environment": "production", "host": "127.0.0.1", "lock_file": "/tmp/mongodb-consistent-backup.lock", "notify": {"method": "none"}, "oplog": {"compression": "none", "flush": {"max_docs": 1000, "max_secs": 1}, "tailer": {"enabled": "true", "status_interval": 30}}, "port": 27017, "replication": {"max_lag_secs": 10, "max_priority": 1000}, "sharding": {"balancer": {"ping_secs": 3, "wait_secs": 300}}, "upload": {"gs": {"threads": 4}, "method": "none", "s3": {"chunk_size_mb": 50, "region": "us-east-1", "retries": 5, "secure": true, "threads": 4}}}
[2017-08-14 05:40:34,549] [INFO] [MainProcess] [Stage:init:32] Notify stage disabled, skipping
[2017-08-14 05:40:34,553] [INFO] [MainProcess] [State:init:135] Initializing root state directory /home/data/db/prodwebsite
[2017-08-14 05:40:34,554] [INFO] [MainProcess] [State:load_backups:153] Found 4 existing completed backups for set
[2017-08-14 05:40:34,554] [INFO] [MainProcess] [State:init:119] Initializing backup state directory: /home/data/db/prodwebsite/20170814_0540
[2017-08-14 05:40:34,556] [INFO] [MainProcess] [Stage:init:32] Upload stage disabled, skipping
[2017-08-14 05:40:34,556] [INFO] [MainProcess] [Main:run:269] Running backup in replset mode using seed node(s): 127.0.0.1:27017
[2017-08-14 05:40:34,561] [INFO] [MainProcess] [Main:run:297] Backup method supports compression, disabling compression in archive step
[2017-08-14 05:40:34,562] [INFO] [MainProcess] [Task:compression:38] Setting Tar compression method: none
[2017-08-14 05:40:34,562] [INFO] [MainProcess] [Stage:run:83] Running stage mongodb_consistent_backup.Backup with task: Mongodump
[2017-08-14 05:40:34,564] [INFO] [MainProcess] [Replset:find_primary:153] Found PRIMARY: rs0/127.0.0.1:27018 with optime Timestamp(1502700966, 4)
[2017-08-14 05:40:34,565] [INFO] [MainProcess] [Replset:find_secondary:229] Found SECONDARY rs0/127.0.0.1:27017: {'priority': 1, 'lag': 0, 'optime': Timestamp(1502700966, 4), 'score': 100}
[2017-08-14 05:40:34,565] [INFO] [MainProcess] [Replset:find_secondary:229] Found SECONDARY rs0/127.0.0.1:27019: {'priority': 1, 'lag': 0, 'optime': Timestamp(1502700966, 4), 'score': 100}
[2017-08-14 05:40:34,565] [INFO] [MainProcess] [Replset:find_secondary:239] Choosing SECONDARY rs0/127.0.0.1:27017 for replica set rs0 (score: 100)
[2017-08-14 05:40:34,567] [WARNING] [MainProcess] [Mongodump:threads:126] Threading unsupported by mongodump version 3.0.4. Use mongodump 3.2.0 or greater to enable per-dump threading.
[2017-08-14 05:40:34,567] [WARNING] [MainProcess] [Mongodump:threads:126] Threading unsupported by mongodump version 3.0.4. Use mongodump 3.2.0 or greater to enable per-dump threading.
[2017-08-14 05:40:34,567] [INFO] [MainProcess] [Mongodump:run:158] Starting backups using mongodump 3.0.4 (options: threads_per_dump=None, mongodump=3.0.4, git=efe71bf185cdcfe9632f1fc2e42ca4e895f93269, compression=auto)
[2017-08-14 05:40:34,572] [INFO] [MongodumpThread-2] [MongodumpThread:run:140] Starting mongodump backup of rs0/127.0.0.1:27017
[2017-08-14 05:40:34,580] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing admin.system.indexes to /home/data/db/prodwebsite/20170814_0540/rs0/dump/admin/system.indexes.bson
[2017-08-14 05:40:34,582] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing admin.system.users to /home/data/db/prodwebsite/20170814_0540/rs0/dump/admin/system.users.bson
[2017-08-14 05:40:34,583] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing admin.system.users metadata to /home/data/db/prodwebsite/20170814_0540/rs0/dump/admin/system.users.metadata.json
[2017-08-14 05:40:34,584] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: done dumping admin.system.users
[2017-08-14 05:40:34,585] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing admin.system.version to /home/data/db/prodwebsite/20170814_0540/rs0/dump/admin/system.version.bson
[2017-08-14 05:40:34,585] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing admin.system.version metadata to /home/data/db/prodwebsite/20170814_0540/rs0/dump/admin/system.version.metadata.json
[2017-08-14 05:40:34,587] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: done dumping admin.system.version
[2017-08-14 05:40:34,587] [INFO] [MongodumpThread-2] [MongodumpThread:wait:107] rs0/127.0.0.1:27017: writing captured oplog to /home/data/db/prodwebsite/20170814_0540/rs0/dump/oplog.bson
[2017-08-14 05:40:34,589] [INFO] [MongodumpThread-2] [MongodumpThread:run:176] Backup rs0/127.0.0.1:27017 completed in 0.02 seconds, 0 oplog changes
[2017-08-14 05:40:38,573] [INFO] [MainProcess] [Mongodump:wait:110] All mongodump backups completed successfully
[2017-08-14 05:40:38,574] [INFO] [MainProcess] [Stage:run:92] Completed running stage mongodb_consistent_backup.Backup with task Mongodump in 4.01 seconds
[2017-08-14 05:40:38,575] [INFO] [MainProcess] [Stage:run:83] Running stage mongodb_consistent_backup.Archive with task: Tar
[2017-08-14 05:40:38,582] [INFO] [MainProcess] [Tar:run:56] Archiving backup directories with pool of 1 thread(s)
[2017-08-14 05:40:38,584] [INFO] [PoolWorker-3] [TarThread:run:41] Archiving directory: /home/data/db/prodwebsite/20170814_0540/rs0
[2017-08-14 05:40:40,585] [INFO] [MainProcess] [Stage:run:92] Completed running stage mongodb_consistent_backup.Archive with task Tar in 2.01 seconds
[2017-08-14 05:40:40,586] [INFO] [MainProcess] [Main:update_symlinks:161] Updating prodwebsite previous symlink to: /home/data/db/prodwebsite/20170814_0538
[2017-08-14 05:40:40,587] [INFO] [MainProcess] [Main:update_symlinks:167] Updating prodwebsite latest symlink to: /home/data/db/prodwebsite/20170814_0540
[2017-08-14 05:40:40,587] [INFO] [MainProcess] [Main:run:473] Completed mongodb-consistent-backup in 6.03 sec

[root@localhost prodwebsite]# cd /home/data/db/prodwebsite/20170814_0540
[root@localhost 20170814_0540]# ls
mongodb-consistent-backup_META rs0.tar

[timvaillancourt]

Hello @liuqian1990, I believe I have fixed this in a new branch.

Please checkout the following and verify:

git clone -b issue_193_no_compress https://github.com/timvaillancourt/mongodb_consistent_backup

Commits: master...timvaillancourt:issue_193_no_compress