DOM News

Never Ever Ever Dev Test a Site w/o Blocking Spiders

By Justin Seibert| 2 Min Read | June 28, 2010

I’m not a big believer in the words “never” or “always,” but am going to use it here like the Yeti in Monsters, Inc. “Rule #1 out here: Always…No, never go out in a blizzard.”

Since we’re now starting to build out our new WordPress site on a test server, we wanted to give you our Rule #1 out here.  Never put up a test (or dev) site without blocking it off from the search engines.  I know what you’re thinking – how would anyone ever find it – we’re not sending out an email to our newsletter list with the url.

However, I can count three separate times off the top of my head that future clients got their dev sites indexed in the search engines.  Unless you have the test site set up on a machine in your attic and it’s not wired to the internet, just please, block it off from the spiders via robots files or whatever method you prefer.  You probably want to block off access to unauthorized individuals as well, but that’s beyond our core interests.

If you do end up getting it indexed, you can get it removed – you’ll just want to submit the appropriate requests through Google Webmaster Tools, et al.

Happy testing!


Written by Justin Seibert

Justin Seibert is the President of Direct Online Marketing. Justin holds a Bachelor of Arts from Vanderbilt University. He contributes a wide range of online business-oriented topics, including the subject of exporting. His contributions can be found on publications such as the Pittsburgh Business Times, AdAge, SES Magazine, and La Voz del interior. Justin and his family enjoy learning about new cultures during their travels.

View Justin Seibert's Full Bio

Related Articles

All Blogs
Optimize Your Website Graphic
By Rob Ricci| 5 Min Read | October 2, 2023

Improve Website Performance With Faster Loading Times and Better User Experience

A website is one of the first impressions a consumer is going to have with…

Read Article right arrow
Website Security and Best Practices
By Rob Ricci| 5 Min Read | September 20, 2023

Improve WordPress Website Security With These Best Practices and Plugins

With the rising number of security breaches and attacks, it has become increasingly critical to…

Read Article right arrow
Advantages of AI in Marketing - A DOM Webinar with Semrush
By Jonathan Bentz| 4 Min Read | May 10, 2023

DOM + Semrush Webinar On June 7 To Share The “AI Advantage” For Digital Marketing

We are thrilled to announce today that we are partnering with Semrush to host our…

Read Article right arrow