Skip to content

IDEA-NTHU-Taiwan/twitter_crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Simple crawler

Configure your crawler

  • create twitter app to access Twitter Streaming API (https://apps.twitter.com)
  • create a file called config.py take example on config.py.example
  • obtain and provide tokens and keys
  • specify the database to write to (in this case it is expecting mongodb configurations)

Get Started

  1. Install virtualenv
pip install virtualenv
  1. Create an instance of virtualenv venv
virtualenv venv
  1. use the virtualenv
source venv/bin/activate
  1. Install the dependencies
pip install -r requirements.txt

About

A simple Twitter stream crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages