This is a based on playframwork for submit spark app

Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks

Using python3.6 alpine base image adds java,pandas, numpy,pyspark and spark as rundeps. This image can be used as container image when you run spark-submit on k8.

Processing IT Recruitment Data in HDFS Cluster, Spark, Elasticsearch and Kibana, deployed by Docker compose

sbt plugin for spark-submit

Kronos extensions for storage, queue and handlers.

Steps to deploy a Spark app to Kubernetes cluster using spark-submit or a pod template

An easy to use script that automatically adds files to the spark-submit command.

scripts, configurations, resources, and others

Run a simple spark word count job via 1) scala sbt spark 2) docker

The primary objective of this study is to explore the feasibility of using machine learning algorithms to classify health insurance plans based on their coverage for routine dental services. To achieve this, I used six different classification algorithms: LR, DT, RF, GBT, SVM, FM(Tech: PySpark, SQL, Databricks, Zeppelin books, Hadoop, Spark-Submit)

GDELT Fu-Fu

Movie Recommendation using Apache Spark MLlib

Spatial Hotspot Analysis on Geo-Spatial Data using Apache Spark and Scala

Apache Spark and Apache Kafka integration and Spark Analytics over DataFrame.

Running Python Engg file with Spark-submit

Micro Spark Rest API

Simple spark environment setup in windows OS.

Spark submit extension from bde2020/spark-submit for Scala with SBT

BDA03 Final Project