Data aggregation tool used to gather and translate information into an RDBMS format.
- Tweepy (Python Module for accessing the Twitter API) - https://tweepy.readthedocs.io/en/v3.5.0/
The main prereqresite for the project is Docker. Please visit https://www.docker.com/ and install Docker on your machine before getting started.
Provided are a variety of scripts that can be used to easily run the project
Useful in contributing to this project is the command docker ps
which will give you instances of running container. Find the container with the 'aggregator-image' tag, grab the ID, and type docker kill <ID>
to stop the current instance. This will allow you to re-run make run
without having to purge all your docker images.
make agg
will run a completely local instance of the aggregator that is not in a docker container. This is useful for quick tests
make dock
will build a new Docker image for the project
make run
will set up a new Docker container for the project and open the project locally
make clean
will purge all Docker images and containers on your system. DO NOT run this command unless you are only running this project.