Make disk available on tutorial vagrant images larger

[itamarst]

Replaced by https://clusterhq.atlassian.net/browse/FLOC-392

Currently image is 9GB and it's very easy to run out of space, which tends to break everything going forward. Increasing available size won't increase download time so there's no real cost.

[dwgebler]

Also, working out and specifying the minimum system requirements to be able to successfully follow and complete the tutorial might be useful.

[wallrj]

I just had a quick look into this and it appears to be more difficult than it should be.

vagrant people recommend you implement a VirtualBox specific post-build hook to resize the Vdi file.

See hashicorp/vagrant#2339 (comment)

But unhelpfully, they don't actually document how exactly to to that and some others have commented that it's more difficult because you first need the ID of the virtual disk device; and vagrant doesn't make that available. See hashicorp/vagrant#2339 (comment)

The tutorial is based on our own flocker-dev image which in turn is based on a custom fedora image. clusterhq/fedora20-updated So perhaps we need to modify that custom base image. But where's the Vagrantfile for that machine?

[tomprince]

The vagrant file for that image is in the description on vagrantcloud.

[itamarst]

Before going too far down this path let's see if we can just get a smaller mongo docker image. I don't want to change too much at this point if we can help it.

[robhaswell]

@dwgebler how are you getting on with this?

[dwgebler]

I'm at least 50% hopeful #383 will be working today.

[wallrj]

I just ran out of disk space again on our vagrant dev environment and this docker bug may be the culprit.

• Graph deletes are non-atomic, db refs deleted without deleting on-disk entities moby/moby#6354

I'd removed all containers and all images and yet there were still lingering data directories for old mongo containers.

Removing all the vfs sub-directories freed up the space.

[root@localhost /]# docker images
REPOSITORY          TAG                 IMAGE ID            CREATED             VIRTUAL SIZE

[root@localhost /]# df -h
Filesystem               Size  Used Avail Use% Mounted on
/dev/mapper/fedora-root  8.2G  7.5G  318M  96% /
devtmpfs                 239M     0  239M   0% /dev
tmpfs                    246M     0  246M   0% /dev/shm
tmpfs                    246M  284K  245M   1% /run
tmpfs                    246M     0  246M   0% /sys/fs/cgroup
tmpfs                    246M   32K  246M   1% /tmp
/dev/sda1                477M   83M  365M  19% /boot
none                     469G   25G  445G   6% /vagrant
none                     469G   25G  445G   6% /tmp/vagrant-cache

[root@localhost /]# du -sx /var/lib/docker/vfs/dir/a6ad94a48e17b03f75efefa7e435a6e69dbdb60e5bc7803aaaa0674101a86e26/journal/*
1048580 /var/lib/docker/vfs/dir/a6ad94a48e17b03f75efefa7e435a6e69dbdb60e5bc7803aaaa0674101a86e26/journal/j._0
1048580 /var/lib/docker/vfs/dir/a6ad94a48e17b03f75efefa7e435a6e69dbdb60e5bc7803aaaa0674101a86e26/journal/prealloc.1
1048580 /var/lib/docker/vfs/dir/a6ad94a48e17b03f75efefa7e435a6e69dbdb60e5bc7803aaaa0674101a86e26/journal/prealloc.2


[root@localhost /]# du -hsx /var/lib/docker/vfs/
5.1G    /var/lib/docker/vfs/

[root@localhost /]# ls /var/lib/docker/vfs/dir/
02cd65f10cbcd5d2f9f7ad5055373b9102023b1fae84410c4105a878c7bc0aff/ 52d3b555fa2035701f44be3348ca6d327e379a7e34778a72025deb45b1be9c3c/ a6ad94a48e17b03f75efefa7e435a6e69dbdb60e5bc7803aaaa0674101a86e26/
031c9326ca1c0e0ee484e2eb636b03545bb16f3dade761a6f960dd5c8316e3f8/ 542c1865d669553924d1116135b51f84163506b1ed37b87cd9a585023edbc158/ bb9eab4bc1e5c828f3dd4efd1b16b032f12afbbbd41e1c19a2636e03b8129ce8/
0e9841fa79d97126c53ed7dcdec39e86bcd44e8e760f421945181af1e22f0278/ 54749bb751eec600e6793257c72c5d7601fd38c50276e379a71438b26ed3bb42/ be8738591cebbaa7791f57b97af914c1bfdc583d3adf247a78f233761f7f18f7/
0ea9a127be850f4e78a5df06c254a248a89069d7a8fb963cb004b15e5d460d18/ 66f4676c596f835c62c8c8401b9fe3b2b198d5e9a6808782902eb3bd241554b5/ c19143c84eec673f976cfe2a628a1da7c0db918a564c8f1808fc1a40b8f3812b/
146282ab0c85386b8a0472eedf8b95523b951f6bd2e8d5d18ef02a64b7971d82/ 7116eb7a69a50ea1b53f0bc7ce2af76944c34dec07f2fb4a48ed1b6ceb8f2202/ c3e42ed148c75596696e75e55da4de19ea3967329a86a88cf4f3641271569299/
1abac4323e7f198fe1344a963ccb6ed67b299678ecdac6d36b9d282cb53bbd16/ 78a365113e4665847f9112774552e541b4646a302b3240babdb028daaef10606/ c65295e89539a30bf260a872c19c562417e66e5a17918b1eb8dbcb28877409f6/
1e56d12f771a99ab6b1818d2db6b05a763d22418949384176584a4b93bf21c07/ 7fb7e2b6314a338caf939d561405a2b750d57024117c9844bb77570d2935b53c/ d18ba1db80711d34701681044f41de4d662487834884949576b3b4a6140e8dd3/
23c0cfaf4cee0b3032a9fef01e7db94a460be6b646b8f54f4ba3b42b7f0a56b7/ 7fd944f48bce585cee61ca6e421b3447fd430b910ce937cb9f5ecadb44139f34/ d22dd95ddcf377e02bd2fed70afc46fa59c7b53f4be6930743c7b7f05cc6df86/
278e97037380ac8bad634187674a1120a73dc56fa1d1810c45919b59c70a8ff5/ 8235129b3cb08cd734721f90c244a16848a7b2008e7b7c6bdd892badf42acd8e/ dc35dba0c3dd565b5079673d09432b1ef6fcc6a0f6a539e2fa63f01a08d36e2a/
2f2e9d3634cec6cdea5d29ace28be1b2cf2e6dbe753d8662c13089f08ef8cc43/ 84e544e243eab1c526a08ddf67dfbd9b80634cd27333b499187e9800299f66e0/ ddc81d91620db9794c2af148112f1bb51c109117a08642caa6fc147e8d0e27cf/
32dfbb547cf3f3fd482213abde83f7200f718a9374f8393f600f1cd7ca25ca95/ 87ec2098e3b26307149f43bd7c437d9329b088e8c7bc4ee8b467a7bbbfb38cf0/ de391c0bfc77ac0022043a4a057a481d7c30a46ad02484a48ad4e0441977c1de/
367d70b2fd66a156c47218e4f6ac2976369cf4fa731afe67210ed338ca1e3b93/ 8fd5e1b241a3de90aafd64fb6ef8d1731dba0c44d6c1c13f0f469352981c334f/ de85fe3d31c23d3fc84b315c5a72ab93c96c061a8d5c224c88c02d8c78898980/
3dc4f60dc35996d8fa90ab5f130fd504219ab97499fe8246bb422b22bc9e7ba6/ 991e4f8de692da5f377065c7ead528a6d14c117f6dc0485e701b0715000f6696/ e2d41ad76bb20c532c93da4891846608c312e1380e4808744bb5de340d27bf6f/
42baa15126d97c8a57e8ab65122758a3eedc5f046adfd8e2b294afdb6b631d3b/ 9df62543508ed1ba1c831c842bf1d251b2e3acc4973974c05974e585481772f0/ e75084f733fcef80ef3ec3f7e286f151ed6a1135427126e94ac111ff13d554fa/
44b1086fe3283e37863a7db7b3735212df3572af27d1987f6dc2dcdfc24738ad/ a320d7526f85419f0ea25cff3c9b3069caad14f562db35526ca1a79697c1c56c/ e86a1c894f79932aea5b1e7357edd0cad5327b82b3fac2212f332b47cf602cdb/
497b0a7ef0990f30afb0aca78e15a27d17554b25a56fcff83383196618d663a6/ a5504ffa044f28b19ae8bfce3f6ce1800e36293701b27a228ddd4fc3eb794510/ ea475d2408aacf0d203053985d8018ca22ef3957e54eeb98178ccb2e68c7eed3/
51b9ee1cbe541e7bac44a11d4d15ea14b42a3e246cfdf16392e9dc59f857e19b/ a63fe98990946d69b6ef36037226350ebc5f7ca1cdef307f28b0dd110a46065f/ 

[root@localhost /]# rm -rf  /var/lib/docker/vfs/dir/*


[root@localhost /]# df -h
Filesystem               Size  Used Avail Use% Mounted on
/dev/mapper/fedora-root  8.2G  2.5G  5.4G  32% /
devtmpfs                 239M     0  239M   0% /dev
tmpfs                    246M     0  246M   0% /dev/shm
tmpfs                    246M  284K  245M   1% /run
tmpfs                    246M     0  246M   0% /sys/fs/cgroup
tmpfs                    246M   32K  246M   1% /tmp
/dev/sda1                477M   83M  365M  19% /boot
none                     469G   25G  445G   6% /vagrant
none                     469G   25G  445G   6% /tmp/vagrant-cache

[adamtheturtle]

We are moving our development planning to JIRA. This issue is now being tracked at https://clusterhq.atlassian.net/browse/FLOC-392. You are welcome to file additional issues in GitHub if that's easier for you.