View Full Version : Robots.txt Disallow Question
jda
Nov 28th 2005, 6:42 pm
Are there any negatives to blocking all search engines for one day? Could my URL be dropped from a crawl list? I'm expecting heavy traffic tomorrow and don't want an overload because of bots. Thanks.
Bernard
Nov 28th 2005, 8:03 pm
If the bots return the following day and see the updated robots.txt, it probably won't hurt. It's not something that I would personally do with any site that is ranking and converting well though. A better idea might be to check with your web host and upgrade your hosting account...
ServiceUptime
Nov 29th 2005, 11:43 pm
I would never play with that and risk the ranking and everything. Bots might think they are not welcome and leave for good :)
minstrel
Dec 1st 2005, 8:57 pm
I don't think it's worth the risk either.
Ask Brett Tabke how he feels about this issue now :o
Ended up not doing it, everything was fine. I thought I'd be fine, but I was cool site of the day and know that has caused some to crash.
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.