A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset

End-to-end data engineering project

This end-to-end data pipeline project processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.

Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio

A data engineering project built around Smogon's Stats API.

Python Lib to build and process data in Datalake - Cloud Function, Cloud Run, Lambda

Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.

mlops zoomcamp capstone project

In this project, I demonstrate creating a data pipeline from NYC Taxi data using Mage.ai for ETL, GCP for storage and BigQuery, and Looker Studio for analytics.

Performed data analytics on Uber data using various tools and technologies, including GCP Storage, Python, Compute Instance, Mage Data Pipeline Tool, BigQuery, and Looker Studio.

An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.

Personal project for Data Engineering Zoomcamp

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

A quick analysis of Yellow Taxi cabs riding in New York 2022

Developed an interactive dashboard utilizing Google Looker Studio to analyze Uber usage patterns in NYC. Designed a robust data model and implemented an efficient data pipeline using Mage AI on GCP's VM infrastructure. Utilized Google BigQuery for in-depth analytics and leveraged Google Cloud Platform for data processing.

Data Engineering on GCP and Mage AI

Project MLOps

Engineered a robust data pipeline using Google Cloud Platform (GCP) services like Cloud Storage, Compute Engine, BigQuery, resulting in a 30% decrease in data processing and analysis time of the San Francisco Crime dataset.Designed an interactive dashboard using Looker Studio, empowering stakeholders to explore crime data visually.