Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Free MLOps course from DataTalks.Club

A curated list of awesome projects and resources related to Argo (a CNCF graduated project)

Polaris: High performance workflow orchestrator for Golang

A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)

Open source AI platform for rapid development of advanced AI and AGI pipelines.

SpiffWorkflow is a software development platform for building, running, and monitoring executable diagrams

Data Engineering examples covering Airflow and Mage for workflows; dbt for BigQuery, Redshift, ClickHouse; Spark and Kafka for Batch/Streaming Processing

The Kubernetes native and CloudEvents native distributed event streaming, event orchestration & messaging platform

An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts storage. AWS Lambda/ ECR for serverless model serving. AWS REST API gateway as endpoint to lambda function. GitHub Actions for CI/CD.

m2m is a node.js library for developing machine-to-machine and edge applications using the node-m2m framework.

A microservices flow orchestrator and workflow manager.

Repo for my MLOps Zoomcamp project

Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform

examples of Event-Driven Architectures (EDA) and Domain Driven Design (DDD) patterns implemented using eventual

Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club

Our startup, Mela, aims to simplify cryptocurrency trading for everyone and provide reliable investment sources while mitigating risks. We aim to design and build a reliable, large-scale trading data pipeline that can run various backtests and store useful artifacts in a robust data warehouse.