Skip to content

Latest commit

 

History

History
37 lines (22 loc) · 1.46 KB

README.md

File metadata and controls

37 lines (22 loc) · 1.46 KB

GitSee by Anna Leonenko

InsightDataScience Data Engineering project

What technology is trending on a github? What language is popular? For how long?

Let's explore. Detailed filesystem is below the illustrations.

Illustration

To start: here is a structure of the repo, it consists of multiple maven projects which compile to separate jars for each application stage

├── README.md

screenshots for readme

├── screenshots

First stage: reprocessing of all commits to temporary files on S3

Illustration3

Second stage: calculation, aggregation, creating CSV files for tableau

Illustration5

Third stage - already processes commits to DataBase

Illustration2

Initial app (not used anymore), but contains all necessary DAO's and parsers for possible additional processing if needed

Illustration4

Node.js application with API for db if to use custom frontend

├── postgres-api

Frontend

└── visual