Screaming Frog
The Screaming Frog SEO Spider is a website crawler that allows you to crawl websites' URLs to analyze and audit technical and onsite SEO.
The Screaming Frog SEO Spider is a website crawler that allows you to crawl websites' URLs to analyze and audit technical and onsite SEO. It is a powerful and flexible site crawler, able to crawl both small and very large websites efficiently while allowing you to analyze the results in real-time. It gathers key onsite data that will help you with broken links, duplicate content, redirects, and analytics.