CS 511: Project 1 HDFS/Spark

Please refer to the instruction at https://docs.google.com/document/d/1SP5NwWpEhpmqUIIaeCQBwk3XMLA11_LJ5Q0rZZdV7rw.

To get started, spin up the cluster.

bash start-all.sh

Test HDFS deployment.

bash test_hdfs.sh

Test Spark deployment.

bash test_spark.sh