Robots.txt

Files that suggest to search engines which parts of a site should not be crawled.

map-markerchevron-down linkedin facebook pinterest youtube rss twitter instagram facebook-blank rss-blank linkedin-blank pinterest youtube twitter instagram