diff options
| author | Joey Hess <joey@kodama.kitenet.net> | 2008-11-10 18:08:09 -0500 |
|---|---|---|
| committer | Joey Hess <joey@kodama.kitenet.net> | 2008-11-10 18:08:09 -0500 |
| commit | 1ea66c3d3f0a33bc3f04d073457b525a70380c37 (patch) | |
| tree | a32beaf3070309ddb926b632866dd4008c4b7dc5 | |
| parent | f0e58faefab108482e88f62db64ea6d654327d25 (diff) | |
| download | ikiwiki-1ea66c3d3f0a33bc3f04d073457b525a70380c37.tar ikiwiki-1ea66c3d3f0a33bc3f04d073457b525a70380c37.tar.gz | |
add a robots.txt
Yahoo! has been pounding on ikiwiki.cgi again. While I'd prefer ikiwiki to
generate sites that avoided robots hitting it in other ways, I'm adding a
robots.txt, at least temporarily.
| -rw-r--r-- | doc/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/doc/robots.txt b/doc/robots.txt new file mode 100644 index 000000000..7be87f9bd --- /dev/null +++ b/doc/robots.txt @@ -0,0 +1,2 @@ +User-Agent: * +Disallow: /ikiwiki.cgi |