2
0
mirror of https://github.com/boostorg/website.git synced 2026-01-30 20:32:16 +00:00
Files
website/robots.txt
2012-02-27 16:41:29 +00:00

6 lines
164 B
Plaintext

User-agent: *
Disallow: /development/ # Hide huge zip files
Disallow: /doc/libs/1_49_0_beta1/
Crawl-delay: 10
Sitemap: http://www.boost.org/sitemap.xml.php