aboutsummaryrefslogtreecommitdiffstats
path: root/robots.txt
Commit message (Collapse)AuthorAgeFilesLines
* Expand the allowed paths in robots.txtDan Fandrich2024-10-241-1/+7
| | | | | This is what we've been running since 2012, but it was being set by Puppet instead of here.
* Bug 139800 - remove errant references to index.html. Patch by ddk, 2xr=gerv.gerv%gerv.net2002-04-251-1/+1
|
* If the application is set up at the server root (e.g. bugzilla.mozilla.org) ↵endico%mozilla.org2000-07-291-0/+3
then this robots.txt disallows robots from scanning the site except for the top level file.