diff options
| author | Jochen Topf <jochen@topf.org> | 2011-04-14 19:17:14 +0200 |
|---|---|---|
| committer | Jochen Topf <jochen@topf.org> | 2011-04-14 19:17:14 +0200 |
| commit | c192de198afe4928dcd921ae7e78ce89c3d9b9ae (patch) | |
| tree | e583e6f4ffd6384df937ffe7c2eec3d331d57419 /web/public | |
| parent | 2f936a602045926dec80b0784f89de7f99623412 (diff) | |
| download | taginfo-c192de198afe4928dcd921ae7e78ce89c3d9b9ae.tar taginfo-c192de198afe4928dcd921ae7e78ce89c3d9b9ae.tar.gz | |
allowed more access to robots
Diffstat (limited to 'web/public')
| -rw-r--r-- | web/public/robots.txt | 10 |
1 files changed, 9 insertions, 1 deletions
diff --git a/web/public/robots.txt b/web/public/robots.txt index 2d178f8..d10f5f4 100644 --- a/web/public/robots.txt +++ b/web/public/robots.txt @@ -1,3 +1,11 @@ User-agent: * -Disallow: / +Disallow: /api +Disallow: /css Disallow: /download +Disallow: /embed +Disallow: /flexigrid +Disallow: /img +Disallow: /js +Disallow: /keys +Disallow: /search/suggest +Disallow: /tags |