Home / Free tools / Crawl Budget Waste Calculator
Free tool

Crawl Budget Waste Calculator

Estimates what share of Googlebot's daily crawl requests your site burns on broken, redirecting and duplicate URLs, and how much faster your real pages get recrawled once they are cleaned up.

Your numbers

Results update as you type.

Your estimate

Crawl requests going to junk URLs...
Wasted requests per day...
Days to recrawl every indexable page now...
Days to recrawl after cleanup...

Estimates only. Assumptions are listed below, and you can change every input.

Search engines give every site a rough daily allowance of crawl requests. On a small site that allowance covers everything many times over. On a large site with thousands of dead links, redirecting URLs and parameter duplicates, a real share of each day goes to fetching pages that will never be indexed, and new or updated content waits longer to be seen. The numbers to check are already in Search Console; this calculator turns them into a waste percentage and a recrawl time.

The estimate takes the crawl requests per day you see in the Crawl Stats report and the counts of indexable pages, broken URLs, redirecting URLs and duplicate URLs from a link audit. It assumes requests are spread evenly across every URL the crawler can find, which is a simplification, and works out how many requests per day go to junk and how many days it takes to get through your good pages at the current rate versus after cleanup. Treat it as a way to size the problem, not as a prediction of what Google will do next.

How to use this tool

  1. Open the Crawl Stats report in Search Console and note the average total crawl requests per day over the last 90 days.
  2. Run a full site crawl and count indexable pages, linked URLs that return 404 or 410, linked URLs that redirect, and duplicate or non canonical URLs.
  3. Enter the five numbers and compare the recrawl time now against after cleanup; the gap is a fair proxy for how much faster updates and new pages will be picked up.

What the math assumes

  • Assumes crawl requests are spread evenly across every URL the crawler can discover; in practice popular and frequently updated pages are crawled more often than the rest.
  • Assumes each broken, redirecting or duplicate URL costs one request per crawl cycle and adds nothing to the index.
  • Redirect targets are counted among your indexable pages, so only the redirect response itself is treated as waste.
  • Assumes the daily crawl request figure stays the same after cleanup; the tool does not predict Google raising or lowering your crawl rate.
  • No benchmark crawl rates are baked in; use your own Search Console and audit numbers.

Frequently asked questions

Does crawl budget matter for a small site?

Usually not. If your daily crawl requests comfortably exceed your total URL count, the crawler gets through everything anyway and cleanup is mostly a hygiene and user experience win. The recrawl days output will show a fraction of a day in that case.

Why count redirecting URLs as waste when the target still gets indexed?

Because the crawler spends a request on the redirect response before it can fetch the target, and the target is already counted in your indexable pages. Updating internal links and sitemaps to point directly at the final URL removes that extra request.

Will fixing these URLs raise my crawl rate?

Possibly, but the calculator does not assume so. Crawl rate depends on server speed, site popularity and freshness signals. What cleanup reliably does is redirect the requests you already get toward pages that matter, which is what the after cleanup figure shows.

More free tools from DeadLinkr

  • Broken Link Revenue Loss Calculator: Estimates how many sessions, conversions and dollars your site loses every month to broken links and 404 pages, for marketers and site owners deciding whether a fix is worth the time.
  • Redirect Chain Latency Calculator: Estimates how much load time a redirect chain adds to every visit and across a month of traffic, and how much you get back by collapsing the chain to a single hop.

A deep link audit whenever you need one

On demand link and redirect audits for SEO.

Run an audit