Skip to content

RaunakShah/Crawler-files-Node.js

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

404 and 301 detectors

Node.js files to detect 301 and 404 status messages from web pages that it comes across Source URl is given as a command line argument

404 Detector: Performs 401 Not Found detection on links that can be accessed from the source URl

301 Detector: Performs 301 Moved Permanently detection recursively on links found at the source URl

About

Crawler.js files

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published