Skip to content
fiwang edited this page Jan 29, 2016 · 13 revisions

PulsarIODemo gives an example of the visualization solution for data analyzing.

Pre-Request

Please set up your pipeline following Get-Started

User-behavior analytics demo

There is an emulator which emulate user click event and send to the pipeline collector, the collector will do geo and device enrichment, then flow to sessionizer and do the sessionization, distributor, metrics calculator do the metrics aggregation on various dimensions and store it on metrics store and also push the metrics via web socket.

Screenshot

Control the simulator

The simultor is embedded on the collecotor, it can be controlled via below url:

Twitter demo

It receive twitter sample feed and convert it to the Jetstream Event and flow it in to the distributor, then do aggregation on the hashtag and country in the metrics calculator. It require twitter OAUTH token to run the twitter sample app.

Screenshot

Dashboard

Dashboard url: http://:8088

  1. Realtime tab
    In this tab, you will see the past 5 minutes event aggregation count trend and break down list chat and pie chat based on country/browser/OS dimension in real-time mode (10s refresh).
    Demo data is coming from Collector EventGenerator processor and going through collector->sessionization->distributor->MetricCalculator.
    MetricCalculator does the run-time aggregation on several metrics with 10s interval and broadcast the metric data to MertricUI through Jetstream message. And then MertricUI aggregates on the metrics in its Esper again in 10s interval then broadcast the metrics to browser via websocket channel.
    MetricCalculator EPL
    MetricUI EPL

  2. Batch tab
    In this tab, you will see the past 24 hours event aggregation count trend and break down list chat and pie chat based on country/browser/OS dimension. Click the country link, it will lead you to the drill down page.
    Demo data is coming from Collector EventGenerator processor and going through collector->sessionization->distributor->MetricCalculator.
    MetricCalculator does the run-time aggregation on several metrics within a longer window(5 min), aggregation result are stored to a metric store and it's Cassandra. MertricUI pulls the metrics from Cassandra through MetricService to draw the graph.
    MetricCalculator EPL

  3. Twitter Feed tab
    In this tab, you will see the past 5 minutes event aggregation count trend and break down list chat and pie chat based on country/language/Hashtag dimension in real-time mode (10s refresh).
    Demo data is coming from twitterSample application and push to MetricCalculator directly. MetricCalculator does the run-time aggregation on several metrics with 10s interval and broadcast the metric data to MertricUI through Jetstream message. And then MertricUI aggregates on the metrics in its Esper again in 10s interval then broadcast the metrics to browser via websocket channel.
    MetricCalculator EPL
    MetricUI EPL