From 62d35f17c6463a9de72ad94a81bfb1900b629562 Mon Sep 17 00:00:00 2001 From: Eric Andersen Date: Thu, 31 Jan 2002 00:25:03 +0000 Subject: For now, don't let googlebot and friends spider the cvsweb stuff, since my little DSL line can't deal with the load. I'll reenable this in a few days when I get things colocated. -Erik --- docs/uclibc.org/robots.txt | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 docs/uclibc.org/robots.txt (limited to 'docs/uclibc.org') diff --git a/docs/uclibc.org/robots.txt b/docs/uclibc.org/robots.txt new file mode 100644 index 000000000..086578d06 --- /dev/null +++ b/docs/uclibc.org/robots.txt @@ -0,0 +1,3 @@ +# go away +User-agent: * +Disallow: /cgi-bin -- cgit v1.2.3