Skip to content

Experience-rookie/ZeroXplorer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

ZeroXplorer

This is an advanced web crawler built with Scrapy. It extracts various types of information from a specified starting URL, including emails, links, external files, JavaScript files, form fields, images, videos, audio, and comments.

Features

  • Custom Offsite Middleware to handle URLs with ports.
  • Modular extraction functions for better readability and maintainability.
  • Detailed logging and error handling.
  • Outputs results to zeroxer.json.

Running the Crawler

Replace http://abcd.com with your desired starting URL. "python3 zeroxplorer.py http://abcd.com"

About

Web Crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages