Free Crawl & Audit SEO Tools

Which check matches the list you already have

If the only input you have is one live URL, start there. The broken link checker requests that page and then requests each link on it. The redirect checker follows one URL hop by hop. The robots.txt tester takes a path and a user-agent and tells you whether that path is allowed. The indexability checker and the Googlebot simulator also work on one URL: the first says whether server signals allow indexing, the second compares a Googlebot Smartphone fetch with a Chrome fetch.

If you already exported URLs, do not crawl the site again to get the same list. Paste it into the bulk status checker (up to 200) for HTTP status, or into the bulk redirect checker when the question is the final destination. A sitemap file is a third kind of list: find it with the sitemap finder, then audit the URLs inside it with the sitemap auditor. The sitemap finder does not check those page URLs itself.

Read status codes before you rewrite content. A 404 or 410 is a missing URL. A 301 or 308 should be the only hop if you can point internal links at the final URL. A 403 or 429 on our fetch can be a firewall rather than a broken page, so open the URL in a browser before you delete the link. These tools report the response they got. They do not tell you whether Google has indexed the URL.

A redirect chain is a different finding from a 404. Use the redirect checker for one URL's hops and the bulk redirect checker for a list of old URLs after a migration. When you control the rules, collapse the chain to a single 301 and point internal links at the final URL so the next check does not rediscover the extra hops.