Soundproud

A soundcloud web client with a django backend and react/redux frontend. Broken into 3 services: web, assets (front-end styles and javascript), and nginx.

Getting started

Copy and rename web.env.example to web.env with necessary secrets/configured environment variables.

docker-compose -f docker-compose.yml -f docker-compose.test.yml build docker-compose -f docker-compose.yml -f docker-compose.test.yml up -d docker-compose exec web bash

Then run in the container

./manage.py migrate
./manage.py persist_new_tracks

Then outside run docker-compose run assets bash

Then run in the container

npm run watch

You may also want to run flow-typed install, then flow as another job to see typechecking via static analysis.

Then open localhost:8082/stream

Testing production setup locally (without swarm)

Build and push images:

docker build -t ./web mcabrams/soundproud_web:x.y.z
docker push mcabrams/soundproud_web:x.y.z
docker build -t ./nginx mcabrams/soundproud_nginx:x.y.z
docker push mcabrams/soundproud_nginx:x.y.z
docker build -t ./nginx mcabrams/soundproud_assets:x.y.z
docker push mcabrams/soundproud_assets:x.y.z

Update docker-compose.production.yml with correct images i.e.

  nginx:
    image: mcabrams/soundproud_nginx:x.y.z

Spin up instance of postgres container and expose a port

docker run -d -p 5435:5432 postgres:9.3 --network=soundcloud_default

Edit web.production.env appropriately:

...
DATABASE_URL=postgres://postgres:mysecretpassword@db/postgres
...

Then run

docker-compose -f docker-compose.production.yml up -d

and open localhost in browser.

Testing production setup locally (w/ swarm)

Create a couple vms according to here: https://docs.docker.com/get-started/part4/#create-a-cluster

Make a web.production.env file from web.env.example

Spin up instance of postgres container and expose a port

docker network create soundcloud_default
docker run -d --network=soundcloud_default --name=db -p 5435:5432 postgres:9.3

Sssh into myvm1 docker-machine ssh myvm1

Find ip of host image (gateway value for destination of 0.0.0.0)

docker@myvm1:~$ netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
0.0.0.0         10.0.2.2        0.0.0.0         UG        0 0          0 eth0
10.0.2.0        0.0.0.0         255.255.255.0   U         0 0          0 eth0
127.0.0.1       0.0.0.0         255.255.255.255 UH        0 0          0 lo
172.17.0.0      0.0.0.0         255.255.0.0     U         0 0          0 docker0
172.18.0.0      0.0.0.0         255.255.0.0     U         0 0          0 docker_gwbridge
192.168.99.0    0.0.0.0         255.255.255.0   U         0 0          0 eth1

In this example would be 10.0.2.2

Edit web.production.env appropriately (don't forget to replace ip with actual):

...
DATABASE_URL=postgres://postgres:mysecretpassword@10.0.2.2:5435/postgres
...

Then copy prod yml file and web.production.env

docker-machine scp docker-compose.production.yml myvm1:~ docker-machine scp web.production.env myvm1:~

Then deploy docker-machine ssh myvm1 "docker stack deploy -c docker-compose.production.yml soundproud"

It seems like right now you have to restart nginx manually, one way is to docker-machine ssh myvm1 docker service scale soundproud_nginx=0 docker service scale soundproud_nginx=1

Then find ip of one of vms and open in browser.

Deploying (w/ swarm)

TODO

Tests

Javascript (in assets container):

npm run test

Unit/Integration:

./manage.py test --keepdb

Acceptance:

./manage.py test --keepdb acceptance_tests