Releases: jayunit100/SparkStreamingApps
Releases · jayunit100/SparkStreamingApps
Spark containers w/ Pi test.
This release marks a working docker test of spark in the deploy/ method, and the code used in the youtube video explaining spark streaming w/ SBT, which is available here https://www.youtube.com/watch?v=gfWIUOapUp4 .
Cleaned up code w/ ctakes and cassandra apps.
Minimized code for SparkStreamingCassandra demo.
Working example.
To run the example, paste twitter creds into /tmp/twitter, and run Driver class.
The deploy directory also has some WIP code for docker and vagrant container tests of spark .
Somewhat unrelated.
Basic working code
this is a clean, basic working api integration of cassandra and spark which
can be used with the vagrantfile described in the README.
later instances will be opinionated in differente ways, for example,
dockerfiles for clustered ETL and so on.