mirror of
https://github.com/boostorg/website.git
synced 2026-01-19 04:42:17 +00:00
6 lines
165 B
Plaintext
6 lines
165 B
Plaintext
User-agent: *
|
|
Disallow: /development/ # Hide huge zip files
|
|
Disallow: /doc/libs/1_49_0_beta1/
|
|
Crawl-delay: 10
|
|
Sitemap: https://www.boost.org/sitemap.xml.php
|