Skip to content

Include Spark Streaming

Past due by over 1 year 75% complete
  1. Create a new module and solve Scala version issues (Spark does not run on Scala 3)
  2. Create new classes that will define the SparkContext and the StreamingContext
  3. Create DStreams that reads from the Kafka topic
  4. Define streaming operations
  5. Configuration
  6. Deploy
  7. Testing and debugging
  1. Create a new module and solve Scala version issues (Spark does not run on Scala 3)
  2. Create new classes that will define the SparkContext and the StreamingContext
  3. Create DStreams that reads from the Kafka topic
  4. Define streaming operations
  5. Configuration
  6. Deploy
  7. Testing and debugging
Loading