diff options
author | Thomas Backlund <tmb@mageia.org> | 2014-10-12 12:27:45 +0300 |
---|---|---|
committer | Thomas Backlund <tmb@mageia.org> | 2014-10-12 12:27:45 +0300 |
commit | 9ce6d646ff718cd62f6434c9a4c94e450436612a (patch) | |
tree | 3ee82e5db7c0aee44a5573d9d17035c6ecac697d /robots.txt | |
parent | a0b2d09125d7911656fe4cb286f20643c4432281 (diff) | |
download | www-9ce6d646ff718cd62f6434c9a4c94e450436612a.tar www-9ce6d646ff718cd62f6434c9a4c94e450436612a.tar.gz www-9ce6d646ff718cd62f6434c9a4c94e450436612a.tar.bz2 www-9ce6d646ff718cd62f6434c9a4c94e450436612a.tar.xz www-9ce6d646ff718cd62f6434c9a4c94e450436612a.zip |
Revert "Updated Estonian translation"
This reverts commit a0b2d09125d7911656fe4cb286f20643c4432281.
Diffstat (limited to 'robots.txt')
-rw-r--r-- | robots.txt | 26 |
1 files changed, 26 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt new file mode 100644 index 000000000..2a72f5bcf --- /dev/null +++ b/robots.txt @@ -0,0 +1,26 @@ +# +# +# + +#Sitemap: /sitemap.xml + +User-Agent: * +Disallow: + +User-Agent: bingbot +Disallow: /*/downloads/get/* + +User-Agent: Googlebot +Disallow: /*/downloads/get/* + +User-Agent: msnbot +Disallow: /*/downloads/get/* + +User-Agent: Ezooms +Disallow: /*/downloads/get/* + +User-Agent: MJ12bot +Disallow: /*/downloads/get/* + +User-Agent: GSLFbot +Disallow: /*/downloads/get/* |