Skip to content

🌊OctoSQL Streaming 🌊

Compare
Choose a tag to compare
@cube2222 cube2222 released this 05 Aug 09:32
99e3474

Hey everybody!

This release is an almost-rewrite of OctoSQL.

  • It changes all state to use local transactional on-disk storage (based on Badger).
  • Adds Temporal SQL
    • Watermarks
    • Triggers
    • Event Time
    • Early Results and Retractions
  • New datasources
    • Kafka
    • Apache Parquet Files
  • All datasources now work asynchronously to actual processing
  • Parallelism has been introduced to datasources (Kafka), distinct selects, group by's, joins with Shuffling functionality included. (key-hashing)
  • Stream Joins (which make joining files orders of magnitudes faster than Lookup Joins)
  • Live-updating output tables
  • New Table Valued Functions
    • Maximum Difference Watermark Generator
    • Percentile Watermark Generator
  • Many new functions have been added
  • Common Table Expressions have been added (queries containing "WITH" statements)
  • Telemetry (described in the README in depth)

octosql-demo