Accidentally upload robots.txt User-agent: * Disallow: /

Discussion in 'Google' started by diablo999, Aug 9, 2009.

Thread Status:
Not open for further replies.
0
  1. #1
    I have just discovered that, about 7 days ago, I accidentally uploaded a robots.txt file that disallowed all bots i.e: User-agent: *
    Disallow: / I have consequently almost disappeared from Google.
    I have now uploaded the correct robots.txt file.

    Will my site reappear as before the next time Google crawls it?

    Many thanks,
    d999
    -
     
    diablo999, Aug 9, 2009 IP
  2. arthur.x

    arthur.x Banned

    Messages:
    568
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    up to hal-year :)
    best way - change domain
     
    arthur.x, Aug 9, 2009 IP
  3. adithya

    adithya Well-Known Member

    Messages:
    568
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    110
    #3
    Dont worry.. It will get indexed the next time..
    But make sure you have signed up and verified your site in Google Webmaster Tools so that you can periodically track the progress
     
    adithya, Aug 9, 2009 IP
  4. diablo999

    diablo999 Guest

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Many thanks Adithya, that's a relief. How often do they crawl?

    I already use Webmaster Tools, it was just a careless mistake. I have just uploaded a fresh sitemap and registered it in Webmaster Tools, so I hope that will help.

    D999
    -
     
    diablo999, Aug 9, 2009 IP
  5. adithya

    adithya Well-Known Member

    Messages:
    568
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    110
    #5
    No one can tell the exactly how often they crawl but there is a belief that new contents in the site will attract them.. so add some new content and build some backlinks to the old content..
    You can also contact them if you have not been crawled even after some long time say 1 month using google webmaster tools
     
    adithya, Aug 9, 2009 IP
  6. webcosmo

    webcosmo Notable Member

    Messages:
    5,840
    Likes Received:
    153
    Best Answers:
    2
    Trophy Points:
    255
    #6
    Once they crawl again things will start getting back to where it was before. Then again getting all the datacenters update the info might take some time.

    You may consider submissions of social networking sites for a possible faster crawling.
     
    webcosmo, Aug 9, 2009 IP
  7. gkd_uk

    gkd_uk Well-Known Member

    Messages:
    979
    Likes Received:
    74
    Best Answers:
    1
    Trophy Points:
    165
    #7
    Nothing to worry about. Your site will get crawled again
     
    gkd_uk, Aug 9, 2009 IP
  8. lightlysalted

    lightlysalted Active Member

    Messages:
    2,067
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    90
    #8
    Yep it will get re indexed, but may take a little time.
     
    lightlysalted, Aug 9, 2009 IP
  9. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    No problem and if you are using the Google Webmaster Tools the file will get indexed quite fast.
     
    bermuda, Aug 9, 2009 IP
  10. shaibibutt

    shaibibutt Member

    Messages:
    606
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    35
    #10
    it will take sometime but it will be indexed again, don't worry
     
    shaibibutt, Aug 9, 2009 IP
  11. gr8webseller

    gr8webseller Peon

    Messages:
    1,097
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #11
    try submitting your site to social bookmarking websites, and article directories,,,,,,, your site will crawled soon ,,,,,,,,
     
    gr8webseller, Aug 9, 2009 IP
  12. Abhik

    Abhik ..:: The ONE ::..

    Messages:
    11,337
    Likes Received:
    606
    Best Answers:
    0
    Trophy Points:
    410
    Digital Goods:
    2
    #12
    Just don't worry.
    It'll get indexed on next crawl.
     
    Abhik, Aug 9, 2009 IP
  13. diablo999

    diablo999 Guest

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Many thanks guys for the tips and assurances. Phew! -Seems no permanent or long-term damage done then. I feel a lot better about it now!!
    Thanks again,
    d999
    -
     
    diablo999, Aug 9, 2009 IP
Thread Status:
Not open for further replies.