Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
The unix-way web crawler
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Interactive CLI Web Crawler
Fast, highly configurable, cloud native dark web crawler.
GoScrapy: Harnessing Go's power for blazingly fast web scraping, inspired by Python's Scrapy framework.
Golang Crawling and scraping framework
A tool to find redirection chains in multiple URLs
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
Via Text Density Simple Web Crawler With Go
URL Spider - web crawler and wordlist / ngram generator
豆备 (Doubak) - 豆瓣 (Douban.com) 命令行版备份工具，备份完整页面镜像，Golang实现。
A web crawler built in the Go programming language
Add a description, image, and links to the web-crawler topic page so that developers can more easily learn about it.
To associate your repository with the web-crawler topic, visit your repo's landing page and select "manage topics."