DOM News

Never Ever Ever Dev Test a Site w/o Blocking Spiders

By Justin Seibert| 2 Min Read | June 28, 2010

I’m not a big believer in the words “never” or “always,” but am going to use it here like the Yeti in Monsters, Inc. “Rule #1 out here: Always…No, never go out in a blizzard.”

Since we’re now starting to build out our new WordPress site on a test server, we wanted to give you our Rule #1 out here.  Never put up a test (or dev) site without blocking it off from the search engines.  I know what you’re thinking – how would anyone ever find it – we’re not sending out an email to our newsletter list with the url.

However, I can count three separate times off the top of my head that future clients got their dev sites indexed in the search engines.  Unless you have the test site set up on a machine in your attic and it’s not wired to the internet, just please, block it off from the spiders via robots files or whatever method you prefer.  You probably want to block off access to unauthorized individuals as well, but that’s beyond our core interests.

If you do end up getting it indexed, you can get it removed – you’ll just want to submit the appropriate requests through Google Webmaster Tools, et al.

Happy testing!


Written by Justin Seibert

Justin Seibert is the President of Direct Online Marketing. Justin holds a Bachelor of Arts from Vanderbilt University. He contributes a wide range of online business-oriented topics, including the subject of exporting. His contributions can be found on publications such as the Pittsburgh Business Times, AdAge, SES Magazine, and La Voz del interior. Justin and his family enjoy learning about new cultures during their travels.

View Justin Seibert's Full Bio

Related Articles

All Blogs
How To Optimize Your Website For ChatGPT
By Billy Wright| 5 Min Read | February 3, 2023

How To Optimize Your Website For ChatGPT

AI is finally here, and it is named ChatGPT. And it's smart. Wicked smart. Gone…

Read Article right arrow
By Jonathan Bentz| 3 Min Read | February 1, 2023

Fear You Won’t Survive Adding GA4 To WordPress? Join Us Feb. 22.

Our friends at WooRank have invited us to share our expertise in all things SEO…

Read Article right arrow
Is Google Analytics 4 Better Than Universal Analytics? (Webinar)
By Jonathan Bentz| 6 Min Read | November 8, 2022

Is GA4 Better Than UA? Find Out In Our Next Webinar!

"Is Google Analytics 4 better than Universal Analytics?" If you are responsible for one of…

Read Article right arrow