diff options
| author | Dan Fandrich <danf@mageia.org> | 2024-10-24 14:17:20 -0700 |
|---|---|---|
| committer | Dan Fandrich <danf@mageia.org> | 2024-10-24 14:19:42 -0700 |
| commit | 161724e26223e90568be02876d265b0e2eec1ef6 (patch) | |
| tree | 313f69e148bf8dcc02fddfa57ee9f97f60e98634 | |
| parent | 007d67fb1e32617e79cee01fa586ee0650e57227 (diff) | |
| download | bugs-161724e26223e90568be02876d265b0e2eec1ef6.tar bugs-161724e26223e90568be02876d265b0e2eec1ef6.tar.gz bugs-161724e26223e90568be02876d265b0e2eec1ef6.tar.bz2 bugs-161724e26223e90568be02876d265b0e2eec1ef6.tar.xz bugs-161724e26223e90568be02876d265b0e2eec1ef6.zip | |
Expand the allowed paths in robots.txt
This is what we've been running since 2012, but it was being set by
Puppet instead of here.
| -rw-r--r-- | robots.txt | 8 |
1 files changed, 7 insertions, 1 deletions
diff --git a/robots.txt b/robots.txt index 0f823cb24..50eeb2795 100644 --- a/robots.txt +++ b/robots.txt @@ -1,3 +1,9 @@ User-agent: * -Allow: /index.cgi Disallow: / +Allow: /*index.cgi +Allow: /*page.cgi +Allow: /*show_bug.cgi +Allow: /*describecomponents.cgi +Disallow: /*show_bug.cgi*ctype=* +Disallow: /*show_bug.cgi*format=multiple* +Disallow: /*page.cgi*id=voting* |