This repository accompanies our blog post "DEBS Grand Challenge: Real-Time Stream Processing with YoMo."
DEBS or the ACM International Conference on Distributed Event Based Systems aims to "provide a forum dedicated to the dissemination of original research, the discussion of practical insights, and the reporting of experiences relevant to event based computing that were previously scattered across several scientific and professional communities" (reference).
The DEBS 2014 Grand Challenge - Smart Grid is the 8th ACM International Conference on Distributed Event Based Systems. It focused on two problems which are relevant to the industry: real-time load prediction and anomaly detection. The data for the challenge was collected from a number of smart-home installations deployed in Germany.
With YoMo, we can build a real-time stream processing system like the following:
- Install
yomo
CLI:go install -v github.com/yomorun/yomo/cmd/yomo@latest && yomo --version
. - Clone this repository by typing
git clone git@github.com:yomorun/debs-2014.git && cd debs-2014
. - Start
yomo-zipper
:yomo wf run workflow.yaml
- Start streaming function load-prediction:
go run cmd/stream-fn-realtime-load-prediction/load-prediction.go
- Start mock
data-source
to generate IoT data:go run cmd/mock-data-source/mock-data.go
- Start streaming function outliers:
go run cmd/stream-fn-realtime-outliers/outliers.go
You should be able to see some exciting results! :)
If you have any questions, let us know! We hope to see you around.