Robots.txt

A file used to keep Web pages from being indexed or to tell which pages you want a search engine to index.

Get a free, no-obligation consultation with a digital marketing expert