CATEGORY · SEO · A04
Crawl budget
Crawl budget describes the resources a search engine allocates to crawling a site, influenced by serving capacity and crawl demand.
Full definition
Crawl budget describes the resources a search engine allocates to crawling a site, influenced by serving capacity and crawl demand.
Concrete Shopify example
Illustrative example: a catalog generates near-unlimited filter combinations. Logs and crawl statistics help evaluate those URLs before changing access.
Common misconceptions
Page count or indexing delay alone does not diagnose a crawl-budget problem. Useful pagination is not automatically waste.
My take
On a small site, first check accessibility, internal links and usefulness. Make crawl-budget changes in response to observed problems.
Related terms
Go further
Sources and editorial context
Teo Comyn · Updated
Technical references consulted for this revision. Illustrative examples are not measured client results. Check the current documentation and your store before applying a change.
Editorial policy