Analysed New York City's Yellow taxi data set with Big Data tools such as Hadoop, HBase, Sqoop, MapReduce and AWS Cloud Infrastructure.

Projeto de processamento distribuído de dados utilizando Python, MRJob e AWS EMR

Project developed to make an sentiment analysis using dictionary implemented with MrJob applying a map-reduce model. It can be executed locally or in HDFS enviroments (such as Hadoop or AWS)

Samples related to data engineering, e.g. spark, embulk, airflow, etc.

K-Means with hadoop

A performance evaluation of two algorithms for performing matrix multiplication using MapReduce

Examples of Recommendations powered by MapReduce and mrjob

This assignment is an example usage of hadoop streaming and mrjob

calculating statistics using mr. job

Using MrJob, create a word counter which breaks the paragraph into small incremental tasks which can be aggregated over a larger Hadoop cluster.

Experiments with MapReduce (mrjob) and Google Dataproc

use mrjob to write a movie recommend system

Analysis of full set of transactions which have occured on the Ethereum network

Collaborative Filtering based recommendation map reduce job using Yelp's mrjob

Distributed computing and storage architecture project

parsing text using map reduce

En esta práctica se empaqueta y distribuye una aplicación Python que descarga y analiza tweets en función de puntuaciones de sentimiento. Los resultados del análisis se guardan en una base de datos MongoDB, y la información se muestra en la web.