Process data in Kafka with Python using Quix Streams

The official Docker image for processing data in Kafka with Python using Quix Streams

This application demonstrates how to process data in Kafka with Python using Quix Streams. It uses data in a publicly available read-only Kafka cluster and illustrates how to process the data with a stateful hopping window operator.

You can adapt this code to suit your needs.

How to run

• Create a virtual environment: python -m venv venv (python3 on Mac)
• Install the requirements: pip install -r requirements.txt
• Run main.py: python main.py (python3 on Mac)

To get started with running projects like this locally read the docs.

Resources

Quix Streams Quick Start Quix CLI Quick Start Quix Cloud Quick Start

Template gallery

Visit Quix YouTube or Quix Community Slack to learn more about developing real-time data pipelines with Kafka and Python.

Contribute

We welcome contributions, see the contribution guide and join the community Slack.

Open source

This project is open source under the Apache 2.0 license and available in GitHub.

Star and share the repo to show your appreciation.