aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorJoey Hess <joey@kodama.kitenet.net>2008-11-10 18:08:09 -0500
committerJoey Hess <joey@kodama.kitenet.net>2008-11-10 18:08:09 -0500
commit1ea66c3d3f0a33bc3f04d073457b525a70380c37 (patch)
treea32beaf3070309ddb926b632866dd4008c4b7dc5
parentf0e58faefab108482e88f62db64ea6d654327d25 (diff)
downloadikiwiki-1ea66c3d3f0a33bc3f04d073457b525a70380c37.tar
ikiwiki-1ea66c3d3f0a33bc3f04d073457b525a70380c37.tar.gz
add a robots.txt
Yahoo! has been pounding on ikiwiki.cgi again. While I'd prefer ikiwiki to generate sites that avoided robots hitting it in other ways, I'm adding a robots.txt, at least temporarily.
-rw-r--r--doc/robots.txt2
1 files changed, 2 insertions, 0 deletions
diff --git a/doc/robots.txt b/doc/robots.txt
new file mode 100644
index 000000000..7be87f9bd
--- /dev/null
+++ b/doc/robots.txt
@@ -0,0 +1,2 @@
+User-Agent: *
+Disallow: /ikiwiki.cgi