mirror of
https://github.com/diaspora/diaspora.git
synced 2026-01-10 07:38:10 -05:00
7 lines
221 B
Plaintext
7 lines
221 B
Plaintext
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
|
|
#
|
|
# To ban all spiders from the entire site uncomment the next two lines:
|
|
User-Agent: *
|
|
Disallow: /people/
|
|
Disallow: /u/
|