Website Crawler
Page audits, URL discovery, redirects and metadata
Run a single-page SEO audit, discover URLs from robots.txt and sitemaps, trace redirect chains, or crawl every page and export the metadata to Excel.
Page audit
Single-page audit: fetches a URL and reports status, indexability, metadata, headings and readability.