- Install Docker and Docker Compose https://docs.docker.com/compose/install/
- Clone this repo
- Create Github token via https://github.com/settings/tokens.
- In
~/.bash_profile
setexport GITHUB_TOKEN="token-here"
. Need it to deal with Github rate limiting https://developer.github.com/v3/#rate-limiting docker-compose up --build -d --scale worker=2
- Browse to http://localhost:5000/github to start data process
- Browse to http://localhost:5000/rq/ to view jobs running
- Browse to http://localhost:8888/ to use Jupyter Notebooks
-
Notifications
You must be signed in to change notification settings - Fork 3
using Redis for data science and data engineering
License
dmitrypol/redis_data
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
using Redis for data science and data engineering
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published