Skip to content

Commit

Permalink
Docs: Provide link to Google's docs on robots.txt
Browse files Browse the repository at this point in the history
Ref: #1554
  • Loading branch information
alrra committed Sep 19, 2014
1 parent 3e3b770 commit f134545
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 2 deletions.
4 changes: 3 additions & 1 deletion dist/doc/misc.md
Original file line number Diff line number Diff line change
Expand Up @@ -174,4 +174,6 @@ anyone, potentially disclosing the location of your private content! So, if
you want to block access to private content, use proper authentication instead.

For more information about `robots.txt`, please see:
[robotstxt.org](http://www.robotstxt.org/).

* [robotstxt.org](http://www.robotstxt.org/)
* [How Google handles the `robots.txt` file](https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt)
4 changes: 3 additions & 1 deletion src/doc/misc.md
Original file line number Diff line number Diff line change
Expand Up @@ -174,4 +174,6 @@ anyone, potentially disclosing the location of your private content! So, if
you want to block access to private content, use proper authentication instead.

For more information about `robots.txt`, please see:
[robotstxt.org](http://www.robotstxt.org/).

* [robotstxt.org](http://www.robotstxt.org/)
* [How Google handles the `robots.txt` file](https://developers.google.com/webmasters/control-crawl-index/docs/robots_txt)

0 comments on commit f134545

Please sign in to comment.