1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Is Dreamhost support stupid or am i missing something?

Discussion in 'robots.txt' started by johan-cr, Dec 27, 2006.

  1. ishan

    ishan Prominent Member

    Messages:
    2,212
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    325
    #21
    I got this when you login to - https://www.google.com/webmasters
    You have to verify your website before you can change the crawl rate

    [​IMG]

    Here is a screenshot of google saying that the rate should be Normal.

    Thanks
    Ishan
     
    ishan, May 16, 2007 IP
  2. michael_dreamhost

    michael_dreamhost Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    They are just telling you what to use as the default in the absence of other factors. There are other factors such as the bot getting confused as I pointed out above where slowing the bot is appropriate. I agree that a normal crawl rate should be used under normal circumstances. There is nothing wrong with slowing the bot when there is a problem as there was with the original poster of this thread. That is why there is the other option.
     
    michael_dreamhost, May 17, 2007 IP
  3. Cristian Mezei

    Cristian Mezei Notable Member

    Messages:
    3,332
    Likes Received:
    355
    Best Answers:
    0
    Trophy Points:
    213
    #23
    Cristian Mezei, May 17, 2007 IP
  4. plumsauce

    plumsauce Peon

    Messages:
    310
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #24
    And was the page in question in fact a resource intensive page?

    .
     
    plumsauce, May 17, 2007 IP
  5. blogspinner

    blogspinner Peon

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #25
    Dreamhost has always been a pain in the ass. My only site with them (one I bought) is down constantly. It earns some money for me - my best site - and it dropped in PR from 5 to 4. I'm wondering now if this may have been a factor. I wouldn't have received the email - it would have gone to the owner before me, or before him. Well, I've sold the site and I will never use Dreamhost ever again. Not by choice, anyway.
     
    blogspinner, May 22, 2007 IP
    Cristian Mezei likes this.
  6. dshah

    dshah Well-Known Member

    Messages:
    1,840
    Likes Received:
    69
    Best Answers:
    0
    Trophy Points:
    115
    #26
    OHH MY GOD....

    F**K dreamhost

    I just found out same thing on my domain and shit its screwing my SERPS, no wonder.
     
    dshah, May 24, 2007 IP
  7. ivantk

    ivantk Active Member

    Messages:
    183
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    53
    #27
    This is a nightmare. I start looking for a good hosting company and found this thread. Now I will check many hostings at forums first, to see what people say. Last time I was screwed up by some reviews. Don't trust reviews :)
     
    ivantk, May 29, 2007 IP
  8. TxDon

    TxDon Active Member

    Messages:
    236
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    58
    #28
    I'm glad Michael stopped by and squared things away. I have 5 blogs and 2 sites with them and have for the last 3 years.

    I also have 8 accounts with other hosting companies and Dreamhost has consitently been better with customer service and hosting my sites than the others. Bluehost would be my 2nd pic as a provider that can come close to matching Dreamhost IMHO.

    The others talk a good game but fail to produce.

    TxDon
     
    TxDon, Jun 5, 2007 IP
  9. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #29
    if dreamhost has said this, dont believe it:D they are the worst hosting company. if you add that line to your robots.txt file, all of your pages will be blocked
     
    trichnosis, Jun 8, 2007 IP
  10. wwwoliondorcom

    wwwoliondorcom Member

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #30


    Is it ok now?
     
    wwwoliondorcom, Jun 11, 2007 IP
  11. aaa007

    aaa007 Member

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #31
    Been with dreamhost 2 years now,no problem at all... :)

    Only some minor downtime...

    :)
     
    aaa007, Jun 12, 2007 IP
  12. moi

    moi Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #32
    Old topic but unfortunately for me, Dreamhost apparently keeps going with it's unfair method :(

    After almost a 40% traffic slump in 10 days (and counting), i realised Dreamhost blocked googlebot via my site .htaccess.

    $ cat .htaccess
    <Limit GET HEAD POST>
    order deny,allow
    deny from 193.47.80
    deny from 66.249
    </LIMIT>

    I was ranking v/ well for popular keywords and most of my pages (include frontdoor) have now all disappeared from google (i guess the whole site will soon be deindexed as google updates its links and hits 403 Forbidden).

    The only feedback i got so far from Dreamhost is "I am assuming you prefer that I block the bot to disabling your account or domain but if you prefer I can do that instead."

    Anyone had this problems recently? I guess i have no other alternative than moving away from DH.
     
    moi, Dec 23, 2007 IP
  13. Ladadadada

    Ladadadada Peon

    Messages:
    382
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #33
    This behaviour really is unacceptable.

    What they should do is ask you to add the specified .htaccess or robots.txt file yourself. As a last resort, they could add it themselves and email you to let you know that they have done it.

    Modifying your site and/or blocking parts of your traffic, no matter where that traffic is from without notifying you is completely unacceptable.

    Up until now I had only ever heard good things about DreamHost. I like that they are participating in the discussion but that behaviour needs to change.

    Remember, if you aren't satisfied, you can always vote with your feet.
     
    Ladadadada, Jan 6, 2008 IP
  14. danieloffice

    danieloffice Peon

    Messages:
    472
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #34
    Hi I am a Dreamhost users almost 2 year.
    From the cost-performance point of view, I think they are good enough.

    I also got an email from them today complain my sites having the same problem (search engine BOT hits too high). They are asking me to do something. I am now looking into their info and trying to make my sites working fine.

    That's also the resaon why I visitng this sub-forum trying to collect more info.
    And I found this thread which is also informative.

    I really want to work with my webhost to get things "happy"......
     
    danieloffice, Jan 9, 2008 IP