Indexing
The process by which search engines add web pages to their database after crawling, making them available in search results. Well-structured sites with quality content get indexed more thoroughly. Monitor indexing status in Google Search Console to ensure pages are discoverable.
Robots.txt
SEO
A
robots.txtfile tells crawlers which URLs they may crawl on your site. It does not directly control indexing; for indexing control, usenoindexand related mechanisms. Configure robots rules carefully to avoid blocking important content. See Access your robots.txt file. See How do I prevent specific pages from getting indexed by search engines?.Sitemap
SEO
A hierarchical list of all pages and content on a website used for search engine indexing and user navigation. XML sitemaps help search engines discover all your pages while HTML sitemaps help visitors find content. Framer automatically generates and updates your XML sitemap. See How to access your sitemap.