Storm Sandbox

Topologies Overview

BasicTopology

• Basic topology written in all Java

ExclamationTopology

• Reliable topology highlighting Anchoring and explicit Ack
• Adds Exclamation marks to words

WordCountTopology

• Basic topology that makes use of multilang by implementing one bolt in Python
• Count the words

EvenOddTopology

• Single Spout generating Even / Odd Streams

Commands

• Build Jar mvn package
• Run Topology
  • storm local target/storm-sandbox-2.3.0-SNAPSHOT.jar org.apache.storm.starter.BasicTopology
  • storm local target/storm-sandbox-2.3.0-SNAPSHOT.jar org.apache.storm.starter.ExclamationTopology
  • storm local target/storm-sandbox-2.3.0-SNAPSHOT.jar org.apache.storm.starter.WordCountTopology
  • storm local target/storm-sandbox-2.3.0-SNAPSHOT.jar org.apache.storm.starter.EvenOddTopology
  • storm local target/storm-sandbox-2.3.0-SNAPSHOT.jar org.apache.storm.starter.trident.TridentWordCountTopology

Docker Cluster

• Start Cluster docker-compose -f stack.yml up
• UI http://localhost:8080/

Logs

• Logs will be present in Supervisor Container user each worker
  • Enter container docker exec -ti supervisor bash
  • e.g. cd /logs/workers-artifacts/topology-1-1594194562/6700 And tail -f worker.log

Submit Topology docker run --link nimbus:nimbus --net storm-sandbox_default -it --rm -v $(pwd)/target/storm-sandbox-2.3.0-SNAPSHOT.jar:/topology.jar storm storm jar /topology.jar org.apache.storm.starter.ExclamationTopology topology

Kill Topology docker run --link nimbus:nimbus --net storm-sandbox_default -it --rm storm storm kill topology

Links

• Deploy Cluster Using Docker
• Set Up Apache Storm On Mac In 10min

References

This project is based on Storm Starter project