Skip to content

Data analytics on a procedurally generated dataset

Notifications You must be signed in to change notification settings

kgardea0/.RevProject2

Repository files navigation

Big Data Engineer github linkedin linkedin linkedin

BIG DATA ANALYTICAL APPLICATION

This is a group project that comprises of four team members known as Team Vegas. We developed a Back-end Application with the capacity of analyzing Big Data emphasized on providing solutions to Marketing Department common challenges. We conglomerated Programing languages, query languages and databases to deduce valued information suitable for Real-Time Diagnostic and Descriptive Purposes and also Futuristic Prescriptive and Predictive Purposes.

Project 2 Link

Languages And Technology

•⚛ Scala - 2.11.12 version

•⚛ Java -1.8.1 version as the SDK

•⚛ Sbt – 1.6.2 version

•⚛ Spark SQL – 2.4.8 version

•⚛ Vegas-viz – 0.3.11 version

•⚛ Vegas-spark – 0.3.11 version

Integrated Development Environment

• Intellij – 2021 version

• Jupyter Notebook

Features:

• Imported packages to enhance Spark Session and Vegas connection

• Established connections for Spark Session, Vegas and CSV file.

• A Menu object with Administrative privileges that encompasses option such as:

•	SPRINT LOG
•	TEAM LOGIN
•	QUERIES/ANALYSIS
•	LOG OUT

To-do list:

•	Further develop skills to utilize CLI for Spark Submit 
•	Create a scalable new user login with registration feature 
•	Integrate Hive
•	Utilizing case classes for cleaner and professional programming.

Getting Started

• Installed the correct versions of Scala (2.11.12), Spark (2.4.8) and JDK (1.8).

• Add JDK and Spark homes to the PATH variables for your system.

• Download all code files, including build.sbt.

• Configure IntelliJ or IDE of your choice to work with the appropriate version of JDK.

• Run from within preferred IDE.

Usage

Ensure you follow the above configurations, after which you can input the code into you preferred IDE and run the menu, for each query options there will be a Vegas visualization graph and it might pop up in a separate window.

Team Members

Justin Yeary

I enjoy solving a great puzzle, and coding is full of them which is why I've decided to start a career working on it.

Kiara Gardea

I am a driven and optimistic person with a background in business administration and information systems which influences my work.

Trathen Mecimore

Inspired by gaming and modding, became more curious and determined to learn the ins and outs of programs

Nicholas Famoye

My analytical, creative and collaborative mindset facilitated my desire to transition from a sociological background into technology.

Big Data Engineer at Revature

Anurag's GitHub stats

Team Vegas Community Chess Tournament

Game is in progress. This is open to ANYONE to play the next move. That's the point. 👋 It's your turn! Move a black (solid) piece.

A B C D E F G H
8
7
6
5
4
3
2
1

BLACK (solid): It's your move... to choose where to move...

FROM TO - just click one of the links :)
C7 D6

Ask a friend to take the next move: Share on Twitter...

How this works

When you click a link, it opens a GitHub Issue with the required pre-populated text. Just push "Create New Issue". That will trigger a GitHub Actions workflow that'll update my GitHub Profile README.md with the new state of the board.

Notice a problem?

Raise an issue, and include the text cc @timburgan.

Last few moves, this game

Move Who
B3 to B6 @automainint
H6 to G6 @jbutterwick
G7 to F7 @simonberner
A3 to B2 @donno2048
C2 to B3 @simonberner

Top 20 Leaderboard: Most moves across all games, except me.

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •