Indexing is the next step after crawling, where search engines store and organize the content found on your pages. Indexed content is eligible to appear in search results. Pages blocked by robots.txt
or marked with noindex
tags will not be included in the search index.