CS 511: Project 1 HDFS/Spark

Please refer to the instruction at https://docs.google.com/document/d/1D7huFJqN9kR_hqX6RnZ7Sl3j7H4lqy8lahb3-bQyLXA.

To get started, spin up the cluster.

bash start-all.sh

Test HDFS deployment.

bash test_hdfs.sh

Test Spark deployment.

bash test_spark.sh