2
0
mirror of https://github.com/boostorg/website.git synced 2026-01-21 17:32:23 +00:00
Files
website/robots.txt
Daniel James 506eda2f5d Merge from live.
[SVN r69224]
2011-02-23 21:35:26 +00:00

4 lines
84 B
Plaintext

User-agent: *
Disallow: /development # Hide huge zip files
Crawl-delay: 10