robots.txt error

Discussion in 'Search Engine Optimization' started by pubsit1000, May 18, 2007.

0
  1. #1
    Large and old site which gets spidered often (4-5 days)

    Few days ago accidentally I set up the robots.txt to block access:
    User-Agent: *
    Disallow: /

    Today I looked in the Google Webmaster and saw what I did but the bot already found this. I repaired this but what will it happen now ? Will the bot come again ?
     
    pubsit1000, May 18, 2007 IP
  2. canvalley

    canvalley Peon

    Messages:
    58
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yeah it'll come back soon. I don't think it will distrupt your site much, if at all.
     
    canvalley, May 18, 2007 IP
  3. pubsit1000

    pubsit1000 Peon

    Messages:
    293
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #3
    ok. thanks for the quick reply. i was worried because it didn't happen before.
     
    pubsit1000, May 18, 2007 IP
  4. seoperson

    seoperson Peon

    Messages:
    501
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #4
    yeah, thats ok and the bot will sure come again.
     
    seoperson, May 18, 2007 IP