Skip to content
This repository has been archived by the owner on Jan 9, 2023. It is now read-only.

Commit

Permalink
Merge pull request #222 from mitchellcash/robots
Browse files Browse the repository at this point in the history
Prevent all robots from scanning the site
  • Loading branch information
jkleinsc committed Dec 9, 2015
2 parents c5afa0a + 278f44e commit 82d3f4d
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 2 deletions.
4 changes: 3 additions & 1 deletion prod/robots.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
# http://www.robotstxt.org

# Disallow crawling of all content
User-agent: *
Disallow:
Disallow: /
4 changes: 3 additions & 1 deletion public/robots.txt
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
# http://www.robotstxt.org

# Disallow crawling of all content
User-agent: *
Disallow:
Disallow: /

0 comments on commit 82d3f4d

Please sign in to comment.