Crawling vs. Indexing: What's the Difference?
Crawling and indexing are the two gates every page must pass before it can rank — and they are not the same thing. This guide explains each step, the order they happen in, and why 'crawled — currently not indexed' is one of the most common problems in Google Search Console.
The difference in one sentence
Crawling is discovering and downloading a page; indexing is analyzing that page and storing it in the search engine's database so it can appear in results. Crawling comes first and is purely about access; indexing is a quality decision about whether the page is worth storing and showing.
What is crawling?
Crawling is the process where search engines send automated programs (crawlers) to discover and download pages on the web by following links and sitemaps. It's the first step in getting a page to appear in search results — before a page can be indexed or ranked, it has to be crawled.
Search engines start from a list of known URLs, fetch those pages, extract every link they contain, and add new URLs to a queue to crawl next. Pages blocked by robots.txt or unreachable by links may never be discovered.
What is indexing?
Indexing is when a search engine processes a crawled page — reading its content, evaluating its quality and uniqueness — and adds it to the index, the giant database that search results are pulled from. If a page isn't in the index, it cannot rank for anything.
Which happens first — and where does rendering fit?
Crawling always happens first. The full pipeline is: discover the URL → crawl (fetch) it → render it → index it → rank it. Each step is a filter — a page can drop out at any stage.
After crawling the raw HTML, Google queues pages that rely on JavaScript for a second phase called rendering, where it executes the JavaScript to see the final page — much like a browser does. Only after rendering does indexing happen. Heavy JavaScript sites can see delays or gaps if important content only appears after rendering.
Why is my page crawled but not indexed?
Getting crawled does not guarantee indexing. Google crawls far more pages than it indexes. The usual causes of crawled-but-not-indexed:
- Content is thin, duplicated, or too similar to other pages
- A noindex meta tag or a canonical tag pointing elsewhere
- The page loads too slowly or errors intermittently
- Google judged the page low value
How to fix it
Strengthen the content, check your meta tags and canonicals, and make the page genuinely distinct. An SEO crawler flags the technical causes — noindex tags, wrong canonicals, duplicates — in one scan, so you know whether the problem is technical or content quality.