diff options
| author | Nicolas Vigier <boklm@mageia.org> | 2013-08-14 19:53:49 +0000 |
|---|---|---|
| committer | Nicolas Vigier <boklm@mageia.org> | 2013-08-14 19:53:49 +0000 |
| commit | fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98 (patch) | |
| tree | 63d661ef16cf854c2faf0ffde9b14abd82867e38 /README | |
| parent | 1c2a91f8c529be51cb2d994c461dd5fc0996dfaf (diff) | |
| download | puppet-fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98.tar puppet-fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98.tar.gz puppet-fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98.tar.bz2 puppet-fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98.tar.xz puppet-fa3aecb7e779de3ee9094d4b8ec8ff0db67bad98.zip | |
viewvc/robots.txt: ban AhrefsBot
It doesn't respect Crawl-delay, or disallowed URLs.
So try to disallow everything for them.
Diffstat (limited to 'README')
0 files changed, 0 insertions, 0 deletions