diff options
| author | Nicolas Vigier <boklm@mageia.org> | 2013-01-03 17:09:36 +0000 |
|---|---|---|
| committer | Nicolas Vigier <boklm@mageia.org> | 2013-01-03 17:09:36 +0000 |
| commit | 466b6c0dda406e942d17079fcd7529f8ed756fc4 (patch) | |
| tree | afe2ce69aa366b83fe9bd42b8caa9aadf605eced /modules/viewvc/files/robots.txt | |
| parent | f2a95b17b775de16d499f0876502fab8717f7c60 (diff) | |
| download | puppet-466b6c0dda406e942d17079fcd7529f8ed756fc4.tar puppet-466b6c0dda406e942d17079fcd7529f8ed756fc4.tar.gz puppet-466b6c0dda406e942d17079fcd7529f8ed756fc4.tar.bz2 puppet-466b6c0dda406e942d17079fcd7529f8ed756fc4.tar.xz puppet-466b6c0dda406e942d17079fcd7529f8ed756fc4.zip | |
viewvc: add robots.txt
Diffstat (limited to 'modules/viewvc/files/robots.txt')
| -rw-r--r-- | modules/viewvc/files/robots.txt | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/modules/viewvc/files/robots.txt b/modules/viewvc/files/robots.txt new file mode 100644 index 00000000..96abad70 --- /dev/null +++ b/modules/viewvc/files/robots.txt @@ -0,0 +1,12 @@ +User-agent: Googlebot +User-agent: Baiduspider +User-agent: bingbot +User-agent: YandexBot +User-agent: AhrefsBot +User-agent: Mail.RU_Bot +User-agent: MJ12bot +Disallow: /viewvc/*/tags/ +Disallow: *?view=annotate* +Disallow: *?annotate=* +Disallow: *?view=diff* +Disallow: *?r1=* |