Skip to content

Internet/WebPage collections. Wish could be easy used to download everything.

License

Notifications You must be signed in to change notification settings

hzwyjxy/Collections

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

42 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Collections

license

  • use HttpClient5 as http downloader
  • multi-thread support
  • easy use

Coming soon!

MODELS introduction

1. blackhole-storage 存储器

Done:nothing
TODO:local,redis,sql

2. particle-parser 解析器

Done: base process;Index dispatch;split tasks
TODO: More data Websites~

3. universe-reader 下载器

Done: base process;Http downloader
TODO: failed-retry, so-parser(unidbg),Rpc,torrent/magnet

4. who-wander 任务启动器

Done:base process

image

About

Internet/WebPage collections. Wish could be easy used to download everything.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages