Skip to content

leanyanko/github_trends

Repository files navigation

GitSee by Anna Leonenko

InsightDataScience Data Engineering project

What technology is trending on a github? What language is popular? For how long?

Let's explore. Detailed filesystem is below the illustrations.

Illustration

To start: here is a structure of the repo, it consists of multiple maven projects which compile to separate jars for each application stage

├── README.md

screenshots for readme

├── screenshots

First stage: reprocessing of all commits to temporary files on S3

Illustration3

Second stage: calculation, aggregation, creating CSV files for tableau

Illustration5

Third stage - already processes commits to DataBase

Illustration2

Initial app (not used anymore), but contains all necessary DAO's and parsers for possible additional processing if needed

Illustration4

Node.js application with API for db if to use custom frontend

├── postgres-api

Frontend

└── visual

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published