Files
html5-boilerplate/dist/robots.txt
Christian Oliff 1ebdce9a80 Minor docs fixes (#3119)
- Fix release date year for recent release on CHANGELOG
- Add https:// to www.robotstxt.org link-  this has advantage of allowing users to Ctrl+click to view site to view more details
- Remove broken `#server-configuration` in-page link (doesn't exist)
2024-05-20 12:14:01 -04:00

6 lines
86 B
Plaintext

# https://www.robotstxt.org/
# Allow crawling of all content
User-agent: *
Disallow: