dataproc

Here are 4 public repositories matching this topic...

tharwaninitin / etlflow

EtlFlow is an ecosystem of functional libraries in Scala based on ZIO for running complex Auditable workflows which can interact with Google Cloud Platform, AWS, Kubernetes, Databases, SFTP servers, On-Prem Systems and more.

redis bigquery aws scala spark etl s3 gcp gcs zio etl-framework dataproc etl-pipeline

Updated Aug 26, 2024
Scala

GoogleCloudPlatform / dataproc-scala-examples

Star

Dataproc Scala Examples is an effort to assist in the creation of Spark jobs written in Scala to run on Dataproc.

airflow composer scala spark gcp dataproc

Updated May 3, 2024
Scala

qts8n / olympics-spark

Star

Spark-приложение для потоковой обработки датасета олимпийских достижений и рекордов

java scala spark pubsub dataproc bahir

Updated Nov 16, 2020
Scala

jewertow / MapReduce-NYC-collisions

Star

Implementation of data processing in the MapReduce model.

airflow composer scala hive hadoop avro terraform gcp mapreduce dataproc

Updated Apr 23, 2021
Scala

Improve this page

Add a description, image, and links to the dataproc topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the dataproc topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

dataproc

Here are 4 public repositories matching this topic...

tharwaninitin / etlflow

GoogleCloudPlatform / dataproc-scala-examples

qts8n / olympics-spark

jewertow / MapReduce-NYC-collisions

Improve this page

Add this topic to your repo