GitHub - jaggarwal96/HackISU2019

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 33 Commits
.idea		.idea
tutorial		tutorial
.gitignore		.gitignore
JevayCrawler.py		JevayCrawler.py
README.txt		README.txt
app.yaml		app.yaml
main.py		main.py
requirements.txt		requirements.txt
tweets_scrapper.py		tweets_scrapper.py

Repository files navigation

Hack ISU 19

Start with pip3 install Scrapy 
Switch to the directory you want your project to be in 
Start new project by saying: scrapy startproject tutorial 
cd tutorial 
Make file called quotes_spider.py 
Compile using python3 quotes_spider.py
Run the crawler using "scrapy runspider quotes_spider.py" or "scrapy runspider quotes_spider.py -o output.json"