Skip to content

Onion Scraper Service - support v2 and v3

License

Notifications You must be signed in to change notification settings

kangoulya/onion-scraper

 
 

Repository files navigation

Onion Scraper

A tor onion scraper/generator service written in go

License MIT

How it works

  • Generates random v2 or v3 onion link
  • Proxy tor call
  • Scrapes title and description of onion website
  • Saves online onion link, title and description into CSV

Usage

Building

go build

Running Tests

go test -v

Configuration

!!! Lookup and copy enviroment file .env.example to .env

Key Value Default Description
DEBUG bool true Use debug logger
TOR_PROXY string socks5://127.0.0.1:9050 Tor Proxy
HTTP_TIMEOUT int 5 Seconds to wait for HTTP request
ONION_VERSION int 2 Onion links to generate - 2 or 3
CSV_FILE string temp.csv CSV file to write - required

Running

./onion-scraper

License

MIT

About

Onion Scraper Service - support v2 and v3

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 100.0%