🌊OctoSQL Streaming 🌊
Hey everybody!
This release is an almost-rewrite of OctoSQL.
- It changes all state to use local transactional on-disk storage (based on Badger).
- Adds Temporal SQL
- Watermarks
- Triggers
- Event Time
- Early Results and Retractions
- New datasources
- Kafka
- Apache Parquet Files
- All datasources now work asynchronously to actual processing
- Parallelism has been introduced to datasources (Kafka), distinct selects, group by's, joins with Shuffling functionality included. (key-hashing)
- Stream Joins (which make joining files orders of magnitudes faster than Lookup Joins)
- Live-updating output tables
- New Table Valued Functions
- Maximum Difference Watermark Generator
- Percentile Watermark Generator
- Many new functions have been added
- Common Table Expressions have been added (queries containing "WITH" statements)
- Telemetry (described in the README in depth)