All Collections
Sharetribe Go - SEO
Sitemap & Robots
robots.txt file
robots.txt file

The robots.txt file is a good way to help search engines index your site. Sharetribe automatically creates this file for your marketplace.

Sharetribe avatar
Written by Sharetribe
Updated over a week ago

Where is the robots.txt file?

You can find the file at the root of your marketplace address. For example:

  • If your marketplace address is https://example.sharetribe.com, your robots.txt file can be found at https://example.sharetribe.com/robots.txt.

  • If your marketplace address is https://www.example.com, your robots.txt file can be found at https://www.example.com/robots.txt.

You can find a direct link to it in your Admin panel's "SEO / Sitemap & Robots" page.

What does the robots.txt file contain?

The robots.txt file for Sharetribe marketplaces allows Google (and other search engines) to index all your marketplace pages. Some bots might be restricted for performance reasons.

User-agent: *
Disallow: /*auth$
Crawl-Delay: 5
Sitemap: https://www.example.com/sitemap.xml.gz

Is it possible to edit the robots.txt file?

It is currently not possible to edit the robots.txt file for a specific marketplace.

Did this answer your question?