Add robots.txt to prevent indexing of dev installations

lgeologic · Nov 18, 2012 · a08735d · a08735d
1 parent f1f080b
commit a08735d
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/robots.txt b/robots.txt
@@ -0,0 +1,6 @@
+User-agent: *
+Disallow: /build
+Disallow: /dev
+Disallow: /doc
+Disallow: /scripts
+Disallow: /test