diff options
| author | Jani Välimaa <wally@mageia.org> | 2024-07-04 11:32:17 +0300 |
|---|---|---|
| committer | Jani Välimaa <wally@mageia.org> | 2024-07-04 11:32:17 +0300 |
| commit | d17b7032f2065a0c82681fecbbe250eb8e036995 (patch) | |
| tree | c91fc734addfa027144ee221f6ed8096872aadb3 | |
| parent | 222574e4822bdd63488c0acb8e51e379170458e8 (diff) | |
| download | puppet-d17b7032f2065a0c82681fecbbe250eb8e036995.tar puppet-d17b7032f2065a0c82681fecbbe250eb8e036995.tar.gz puppet-d17b7032f2065a0c82681fecbbe250eb8e036995.tar.bz2 puppet-d17b7032f2065a0c82681fecbbe250eb8e036995.tar.xz puppet-d17b7032f2065a0c82681fecbbe250eb8e036995.zip | |
svnweb: add facebookexternalhit to robots.txt
| -rw-r--r-- | modules/viewvc/files/robots.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/modules/viewvc/files/robots.txt b/modules/viewvc/files/robots.txt index 416168b6..dbb13834 100644 --- a/modules/viewvc/files/robots.txt +++ b/modules/viewvc/files/robots.txt @@ -8,6 +8,7 @@ User-agent: ClaudeBot User-agent: Amazonbot User-agent: PetalBot User-agent: Bytespider +User-agent: facebookexternalhit Disallow: /*/tags/ Disallow: *?view=annotate* Disallow: *?annotate=* |