Online Name - Payday Loans - Debt Consolidation - Debt Consolidation - Health 2007

PDA

View Full Version : Robots.txt Disallow Question


jda
Nov 28th 2005, 6:42 pm
Are there any negatives to blocking all search engines for one day? Could my URL be dropped from a crawl list? I'm expecting heavy traffic tomorrow and don't want an overload because of bots. Thanks.

Bernard
Nov 28th 2005, 8:03 pm
If the bots return the following day and see the updated robots.txt, it probably won't hurt. It's not something that I would personally do with any site that is ranking and converting well though. A better idea might be to check with your web host and upgrade your hosting account...

ServiceUptime
Nov 29th 2005, 11:43 pm
I would never play with that and risk the ranking and everything. Bots might think they are not welcome and leave for good :)

minstrel
Dec 1st 2005, 8:57 pm
I don't think it's worth the risk either.

Ask Brett Tabke how he feels about this issue now :o

jda
Dec 2nd 2005, 9:18 am
Ended up not doing it, everything was fine. I thought I'd be fine, but I was cool site of the day and know that has caused some to crash.