#

spider-trap

Here are 3 public repositories matching this topic...

acuciureanu / spidertrap-rs

A simple trap for web crawlers

Updated Aug 2, 2023
Rust

jieren123 / Bigdata_Project_Pagerank

Using MapReduce to calculate Wikipedia page rank; preventing dead-ends and spider-traps

hadoop pagerank pagerank-algorithm mapreduce dead-ends spider-trap

Updated Aug 29, 2017
Java

pete911 / blackhole

simple webserver generating random links

go golang spider-test spider-trap bot-testing crawler-testing

Updated Dec 6, 2024
Go

Improve this page

Add a description, image, and links to the spider-trap topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the spider-trap topic, visit your repo's landing page and select "manage topics."