As per our system architecture, KAFKA is the initial module of the design where we will be using it to extract data from Twitter in real time and push them to Kafka Cluster. It will have 3 different kinds of modules depending on the categories of tweets we would be extracting e.g. Entertainment, Sports, Politics etc.
We will be using a Twitter API from which, with the help of KAFKA module, we will be extracting the tweets from twitter and pushing them to KAFKA cluster.