Unified Diff: modules/trac/files/robots.txt
Issue 29336809:
Issue 3667 - Extend Trac's robots.txt file (Closed)
Patch Set:
Created Feb. 22, 2016, 12:49 p.m.
Use n/p to move between diff chunks;
N/P to move between comments.
« no previous file with comments
|
« no previous file
|
no next file »
|
no next file with comments »
Expand Comments ('e') | Collapse Comments ('c') | Hide Comments ('s')
Expand Comments ('e') | Collapse Comments ('c') | Hide Comments ('s')
| Index: modules/trac/files/robots.txt |
| diff --git a/modules/trac/files/robots.txt b/modules/trac/files/robots.txt |
| index 55bd235c92dcfffb63ae47e1d5e0fdf716249224..7bc589738842bab7b2ecad8edabd4c0822b7e090 100644 |
| --- a/modules/trac/files/robots.txt |
| +++ b/modules/trac/files/robots.txt |
| @@ -1,3 +1,8 @@ |
| -User-agent: AhrefsBot |
| -Disallow: / |
| +User-agent: * |
| +Disallow: /browser |
| +Disallow: /changeset |
| +Disallow: /log |
| +Disallow: /newticket |
| +Disallow: /timeline |
| +Disallow: /search |
« no previous file with comments
|
« no previous file
|
no next file »
|
no next file with comments »
