Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or filesystem to various data repositories such as search engines.

Generic library shared between several projects.

Collector-related code shared between different collector implementations

Norconex Importer is a Java library and command-line application meant to "parse" and "extract" content out of a file as plain text, whatever its format (HTML, PDF, Word, etc). In addition, it allows you to perform any manipulation on the extracted text before using it in your own service or application.

Maven parent POM for many Norconex Maven projects.

Norconex Filesystem Collector is a flexible crawler for collecting, parsing, and manipulating data ranging from local hard drives to network locations into various data repositories such as search engines.

Solr implementation of Norconex Committer. Should also work with any Solr-based products, such as LucidWorks.

Implementation of Norconex Committer for SQL (JDBC) databases.

Norconex Committer is a java library and command line application used to route content to local or remote target repositories, such as a search engine index.

Implementation of Norconex Committer for Neo4j.