diff options
| author | Jani Välimaa <wally@mageia.org> | 2025-05-04 11:23:45 +0300 |
|---|---|---|
| committer | Jani Välimaa <wally@mageia.org> | 2025-05-04 11:23:45 +0300 |
| commit | 8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4 (patch) | |
| tree | f38bdb543d13d57616e96ca4b7b500fa909c2b66 /modules/mediawiki/files/robots.txt | |
| parent | 20a7380942070a33d974a5c4afcb1dd643520860 (diff) | |
| download | puppet-8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4.tar puppet-8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4.tar.gz puppet-8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4.tar.bz2 puppet-8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4.tar.xz puppet-8f7ae07cf2a815a1d871bd9aa80dd342d6a6e5d4.zip | |
Add robots.txt to wiki
Diffstat (limited to 'modules/mediawiki/files/robots.txt')
| -rw-r--r-- | modules/mediawiki/files/robots.txt | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/modules/mediawiki/files/robots.txt b/modules/mediawiki/files/robots.txt new file mode 100644 index 00000000..a58c6199 --- /dev/null +++ b/modules/mediawiki/files/robots.txt @@ -0,0 +1,4 @@ +User-agent: * +Disallow: /mw-*/index.php? +Disallow: /*/Special: +Crawl-delay: 30 |