Developers

Search

Access your robots.txt file

Learn how to view your site’s automatically generated robots.txt file

The robots.txt file tells search engines which pages they can crawl and index on your site.

Framer automatically generates a robots.txt file for every published site. You can access it directly from your browser.

  1. Open your browser.

  2. Enter your site’s domain followed by /robots.txt (for example, example.com/robots.txt).

  3. Press Enter to load the file.

You’ll see the live robots.txt file that search engines use when crawling your site.

If you need a custom robots.txt file, you can upload one using Static Files. This is available on Pro, Scale, and Enterprise plans. When you upload a custom robots.txt, it replaces the automatically generated one.

The robots.txt file tells search engines which pages they can crawl and index on your site.

Framer automatically generates a robots.txt file for every published site. You can access it directly from your browser.

  1. Open your browser.

  2. Enter your site’s domain followed by /robots.txt (for example, example.com/robots.txt).

  3. Press Enter to load the file.

You’ll see the live robots.txt file that search engines use when crawling your site.

If you need a custom robots.txt file, you can upload one using Static Files. This is available on Pro, Scale, and Enterprise plans. When you upload a custom robots.txt, it replaces the automatically generated one.

FAQ

  • What does the robots.txt file do?

    The robots.txt file gives instructions to search engine bots about which pages they can or cannot crawl. It helps manage how your site appears in search results and supports your SEO strategy.

  • Does Framer create a robots.txt file automatically?

    Yes, Framer generates a robots.txt file for every published site. If you upload a custom robots.txt via Static Files, it will replace the default one.

  • Can I edit the robots.txt file in Framer?

    Yes. You can upload a custom robots.txt file using Static Files. Go to your project dashboard, select your domain, open the "Files" tab, and upload your file with the path set to /. This is available on Pro, Scale, and Enterprise plans.

Updated

Related articles

Address optimization warnings in your project

Are multiple H1 tags in Framer a problem?

Fixing uncrawlable overlay content

Guide to Lighthouse scores

Guide to SEO features and tools