Overview
Siddhi is a fully open source, cloud-native, scalable, Streaming and Complex Event Processing System capable of building real-time analytics, data integration, notification and surveillance usecases. Siddhi understands Streaming SQL queries in order to capture events from diverse data sources, process them, integrate with multiple services and data sources, and publish output to various endpoints in real-time.
Siddhi SDK 5.1.2 release contains the latest Siddhi core 5.1.11 dependency. Other than that, it provides a lot of new features and improvements that help for the cloud native stream processing deployments.
Complete Changes
Please find the complete changes here
Bundled Siddhi Extensions
Execution Extensions
| Name | Description | Latest Tested Version |
|---|---|---|
| execution-string | Provides basic string handling capabilities such as concat, length, replace all, etc. | 5.0.9 |
| execution-regex | Provides basic RegEx execution capabilities. | 5.0.5 |
| execution-math | Provides useful mathematical functions. | 5.0.4 |
| execution-time | Provides time related functionality such as getting current time, current date, manipulating/formatting dates, etc. | 5.0.4 |
| execution-map | Provides the capability to generate and manipulate map data objects. | 5.0.5 |
| execution-json | Provides the capability to retrieve, insert, and modify JSON elements. | 2.0.5 |
| execution-unitconversion | Converts various units such as length, mass, time and volume. | 2.0.2 |
| execution-reorder | Orders out-of-order event arrivals using algorithms such as K-Slack and alpha K-Stack. | 5.0.3 |
| execution-unique | Retains and process unique events based on the given parameters. | 5.0.5 |
| execution-list | Provides the capability to send an array object inside Siddhi stream definitions and use it within queries. | 1.0.0 |
| execution-streamingml | Performs streaming machine learning (clustering, classification and regression) on event streams. | 2.0.4 |
| execution-tensorflow | Provides support for running pre-built TensorFlow models. | 2.0.2 |
| execution-pmml | Evaluates Predictive Model Markup Language (PMML). It is under GPL license. | 5.0.1 |
Input/Output Extensions
| Name | Description | Latest Tested Version |
|---|---|---|
| io-http | Receives and publishes events via http and https transports, calls external services, and serves incoming requests and provide synchronous responses. | 2.2.0 |
| io-nats | Receives and publishes events from/to NATS. | 2.0.10 |
| io-kafka | Receives and publishes events from/to Kafka. | 5.0.7 |
| io-email | Receives and publishes events via email using smtp, pop3 and imap protocols. |
2.0.5 |
| io-cdc | Captures change data from databases such as MySQL, MS SQL, Postgresql, H2 and Oracle. | 2.0.5 |
| io-tcp | Receives and publishes events through TCP transport. | 3.0.4 |
| io-googlepubsub | Receives and publishes events through Google Pub/Sub. | 2.0.2 |
| io-rabbitmq | Receives and publishes events from/to RabbitMQ. | 3.0.4 |
| io-file | Receives and publishes event data from/to files. | 2.0.5 |
| io-jms | Receives and publishes events via Java Message Service (JMS), supporting Message brokers such as ActiveMQ | 2.0.3 |
| io-prometheus | Consumes and expose Prometheus metrics from/to Prometheus server. | 2.1.1 |
| io-grpc | Receives and publishes events via gRpc. | 1.0.8 |
| io-mqtt | Allows to receive and publish events from/to mqtt broker. | 3.0.0 |
| io-sqs | Subscribes to a SQS queue and receive/publish SQS messages. | 3.0.0 |
| io-s3 | Allows you to publish/retrieve events to/from Amazon AWS S3. | 1.0.3 |
| io-gcs | Receives/publishes events from/to Google Cloud Storage bucket. | 1.0.0 |
Data Mapping Extensions
| Name | Description | Latest Tested Version |
|---|---|---|
| map-json | Converts JSON messages to/from Siddhi events. | 5.0.6 |
| map-xml | Converts XML messages to/from Siddhi events. | 5.0.3 |
| map-text | Converts text messages to/from Siddhi events. | 2.0.4 |
| map-avro | Converts AVRO messages to/from Siddhi events. | 2.0.6 |
| map-keyvalue | Converts events having Key-Value maps to/from Siddhi events. | 2.0.5 |
| map-csv | Converts messages with CSV format to/from Siddhi events. | 2.0.3 |
| map-binary | Converts binary events that adheres to Siddhi format to/from Siddhi events. | 2.0.4 |
| map-protobuf | Converts protobuf messages to/from Siddhi events.. | 1.0.4 |
Store Extensions
| Name | Description | Latest Tested Version |
|---|---|---|
| store-rdbms | Optimally stores, retrieves, and manipulates data on RDBMS databases such as MySQL, MS SQL, Postgresql, H2 and Oracle. | 7.0.5 |
| store-mongodb | Stores, retrieves, and manipulates data on MongoDB. | 2.1.0 |
| store-redis | Stores, retrieves, and manipulates data on Redis. | 3.1.1 |
| store-elasticsearch | Stores, retrieves, and manipulates data on Elasticsearch. | 3.2.0 |
Script Extensions
| Name | Description | Latest Tested Version |
|---|---|---|
| script-js | Allows writing user defined JavaScript functions within Siddhi Applications to process events. | 5.0.3 |