Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support capturing snapshots of extremely large lists #200

Closed
collinbarrett opened this issue Feb 12, 2018 · 1 comment
Closed

support capturing snapshots of extremely large lists #200

collinbarrett opened this issue Feb 12, 2018 · 1 comment
Labels
url-validation service that validates URLs

Comments

@collinbarrett
Copy link
Owner

collinbarrett commented Feb 12, 2018 •
edited
Loading

The snapshot service should be updated to support extremely large lists like hpHosts. Predecessor of #6 .
@collinbarrett collinbarrett changed the title Support capturing snapshots of extremely large lists support capturing snapshots of extremely large lists Feb 12, 2018
collinbarrett added a commit that referenced this issue Feb 22, 2018
@collinbarrett
add HOSTS AdBlock to ignore list for snapshots for now
7a1c342 
ref #119
ref #200
collinbarrett added a commit that referenced this issue Feb 22, 2018
@collinbarrett
add list 149 to snpahot blacklist
82377e4 
causes service to hang, frequent 404s. will need to investigate at some point. kinda ref #200
@collinbarrett collinbarrett mentioned this issue Jun 7, 2018
Closed
@collinbarrett
Copy link
Owner Author

https://github.com/collinbarrett/FilterLists/blob/master/scripts/sql/cantSnapshot.sql

collinbarrett added a commit that referenced this issue Aug 16, 2018
@collinbarrett
move cantSnapshot to seed
79afd53 
ref #200
ref #201
@collinbarrett collinbarrett added the url-validation service that validates URLs label Aug 18, 2018
collinbarrett added a commit that referenced this issue Aug 22, 2018
@collinbarrett
add 489 to skipped snapshots
1e61f4f 
ref #200
hawkeye116477 pushed a commit to hawkeye116477/FilterLists that referenced this issue Feb 4, 2019
@collinbarrett
add HOSTS AdBlock to ignore list for snapshots for now
78f6f9f 
ref collinbarrett#119
ref collinbarrett#200
hawkeye116477 pushed a commit to hawkeye116477/FilterLists that referenced this issue Feb 4, 2019
@collinbarrett
add list 149 to snpahot blacklist
cb914b6 
causes service to hang, frequent 404s. will need to investigate at some point. kinda ref collinbarrett#200
hawkeye116477 pushed a commit to hawkeye116477/FilterLists that referenced this issue Feb 4, 2019
@collinbarrett
move cantSnapshot to seed
8ac28d9 
ref collinbarrett#200
ref collinbarrett#201
hawkeye116477 pushed a commit to hawkeye116477/FilterLists that referenced this issue Feb 4, 2019
@collinbarrett
add 489 to skipped snapshots
ea5e60b 
ref collinbarrett#200
hawkeye116477 pushed a commit to hawkeye116477/FilterLists that referenced this issue Feb 4, 2019
@collinbarrett
try capturing large lists again
d817bfd 
closes collinbarrett#200
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
url-validation service that validates URLs
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@collinbarrett