diff options
| author | endico%mozilla.org <> | 2000-07-29 04:28:39 +0000 |
|---|---|---|
| committer | endico%mozilla.org <> | 2000-07-29 04:28:39 +0000 |
| commit | aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc (patch) | |
| tree | 8760c88dd64951e88a8787f5bf996bf5e2684c0b /robots.txt | |
| parent | 1552368b2fd931bcc5d0e63a0e0b7c5f1cbd9632 (diff) | |
| download | bugs-aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc.tar bugs-aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc.tar.gz bugs-aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc.tar.bz2 bugs-aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc.tar.xz bugs-aae337d3e30bd3f8e58d9a66bad6f394e2b6eacc.zip | |
If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.
Diffstat (limited to 'robots.txt')
| -rw-r--r-- | robots.txt | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 000000000..c364fe62e --- /dev/null +++ b/robots.txt @@ -0,0 +1,3 @@ +User-agent: * +Allow: /index.html +Disallow: / |