reference:(root):robots.txt

Jump to bottom Edit New page

Aaron Junker edited this page Mar 21, 2021 · 2 revisions

File `(root)` `/robots.txt`

This file tells search engines which files should be indexed and where the sitemap is.

This file allows all search engines to index everything except of:

/admin/
/docs/
/.git/
/.github/
/images/
/includes/
/install/
/lang/
/login/
/plugins/
/siteelements/
/styles/
/vendor/
/.gitattribute
/.gitignore
/logout.php
/profile.php

For more information on robots.txt please visit the offical robots.txt website.

USOC from Case Games (c) 2020-2021