Investigator Use
Use Web Crawler when working in the Web & URL OSINT phase of an investigation. Open it after recording the target, source URL, time, and reason for use in your case notes.
Before You Pivot
Record Context
Capture the target, search terms, and why this source is relevant before you leave the page.
Preserve Evidence
Archive volatile pages, save screenshots, and keep timestamps for anything that may change.
Corroborate
Treat one tool as a lead source. Confirm important findings with independent sources.
Related Tools
ArchiveBox
Web & URL OSINT
Open-source self-hosted web archiving platform that preserves URLs, pages, media, and evidence in durable formats such as HTML, PDF, PNG, WARC, and JSON.
Builtwith
Web & URL OSINT
BuiltWith profiles website technology stacks, tracking frameworks, hosting signals, and third-party services for web reconnaissance. This resource supports URL analysis, website intelligence, and online risk assessment.
Check short url
Web & URL OSINT
Check short url provides capabilities for URL analysis, website intelligence, and online risk assessment. CheckShortURL is a tool that lets you preview and verify shortened links.
Cute Stats
Web & URL OSINT
Cute Stats is an OSINT resource for domain footprint and DNS intelligence analysis. It supports WHOIS research, DNS history analysis, and infrastructure mapping.
Down for who?
Web & URL OSINT
Down for who? provides capabilities for URL analysis, website intelligence, and online risk assessment. Check if a website or service is down or having problems and report your problems! Click now to check/report problems!
Fast Osint Crawler
Web & URL OSINT
Fast Osint Crawler provides capabilities for repository intelligence, developer profiling, and source-code reconnaissance. Incredibly fast crawler designed for OSINT.