Merge pull request #72 from nodejs/robots.txt

copy robots.txt from old site
nodejs · Sep 1, 2015 · f30b0f0 · f30b0f0
2 parents f70d35d + 52c930a
commit f30b0f0
Showing 1 changed file with 6 additions and 0 deletions.
diff --git a/static/robots.txt b/static/robots.txt
@@ -0,0 +1,6 @@
+User-Agent: *
+Disallow: /dist/
+Disallow: /docs/
+Allow: /dist/latest/
+Allow: /dist/latest/docs/api/
+Allow: /api/