Scraping in python made easy - receive the content you like in just one line of code

🌐🔀📰 Converts a webpage article into other formats, like PDF, markdown, JSON, plain text...

web crawler allowing full page render crawl using HtmlUnit

LinkxDoxer is a Python script designed to efficiently retrieve all links found directly under the webpage of a given URL. It is ideal for web developers, bug bounty hunters, and OSINT (Open-Source Intelligence) enthusiasts seeking to analyze links under a webpage and uncover valuable information(Expected In Ideal Cases)

Simple example how to call screenshot machine's API using python programming language.

The only real pluggable crawler / spider / webcrawler to search the web for stuff you need to know.

Bot to scarp user profile data in Linked-in .

An off-screen Chromium web browser used to extract the computed DOM from any web page using .NET Core WCF.

Simplifies the extraction of HTML meta and Open Graph tags from HTML content or URLs.

A simple python script that downloads a page as pdf.

Scrapes website content, puts to sqlite3 database, downloads preview picture

LinkxDoctor is a Python tool that scans a webpage to identify both broken and valid links. It provides a report on the link status, helping ensure all links on the page are functional. This Project Is Indeed The Successor Of One Of My Previous Projects, LinkxDoxer

A Laravel application to analyse the web pages