DOM News

Never Ever Ever Dev Test a Site w/o Blocking Spiders

By Justin Seibert| 2 Min Read | June 28, 2010
LinkedInFacebookTwitter

I’m not a big believer in the words “never” or “always,” but am going to use it here like the Yeti in Monsters, Inc. “Rule #1 out here: Always…No, never go out in a blizzard.”

Since we’re now starting to build out our new WordPress site on a test server, we wanted to give you our Rule #1 out here.  Never put up a test (or dev) site without blocking it off from the search engines.  I know what you’re thinking – how would anyone ever find it – we’re not sending out an email to our newsletter list with the url.

However, I can count three separate times off the top of my head that future clients got their dev sites indexed in the search engines.  Unless you have the test site set up on a machine in your attic and it’s not wired to the internet, just please, block it off from the spiders via robots files or whatever method you prefer.  You probably want to block off access to unauthorized individuals as well, but that’s beyond our core interests.

If you do end up getting it indexed, you can get it removed – you’ll just want to submit the appropriate requests through Google Webmaster Tools, et al.

Happy testing!


Full-Scope Online Marketing Services | justin-seibert-headshot

Written by Justin Seibert

Justin Seibert is the President of Direct Online Marketing. Justin holds a Bachelor of Arts from Vanderbilt University. He contributes a wide range of online business-oriented topics, including the subject of exporting. His contributions can be found on publications such as the Pittsburgh Business Times, AdAge, SES Magazine, and La Voz del interior. Justin and his family enjoy learning about new cultures during their travels.

View Justin Seibert's Full Bio

Related Articles

All Blogs
Google SGE: What it is and should you be afraid?
By Billy Wright| 10 Min Read | November 27, 2023

Google SGE: What Is It And Should You Be Afraid?

Updated3/7/2024 Everything changes all of the time. Especially in the world of SEO. Google Search…

Read Article right arrow
Web Design Experts | the top to scariest web design mistakes you can make and what to do instead
By Matt Merlino| 17 Min Read | October 31, 2023

The Top 10 Scariest Web Design Mistakes You Can Make (And What To Do Instead)

Marketing professionals are always a little queasy around Halloween. It’s not because we ate too…

Read Article right arrow
Website Optimization | Optimize Your Website Graphic
By Rob Ricci| 5 Min Read | October 2, 2023

Improve Website Performance With Faster Loading Times and Better User Experience

A website is one of the first impressions a consumer is going to have with…

Read Article right arrow