URLs restricted by robots.txt ??

Discussion in 'Search Engine Optimization' started by gc1282, Feb 20, 2008.

  1. #1
    Hello, anyone know why I might get this "URLs restricted by robots.txt " when I log in to Google Webmastertools ? I checked my source code and Blogger.com and I dont seem to have a robots.txt file restricting my URLS

    -Thanks
     
    gc1282, Feb 20, 2008 IP
  2. tribulus

    tribulus Peon

    Messages:
    359
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Okay you say you checked your source-code. Robots.txt will not be in your source code but is a separate file. Please check all folders that are listed on your server for that file.
    If you are not familiar with how to change the file, download it from your server to your computer, then delete from the server. Research what the robots.txt file is used for and revise and upload if needed.
     
    tribulus, Feb 20, 2008 IP
  3. gc1282

    gc1282 Active Member

    Messages:
    421
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    55
    #3
    hey thank you for responding Tribulus that is useful info, but I made the mistake of not saying I'm using a blog on blogger.com and I really dont have much control over anything other than checking the source code there.
     
    gc1282, Feb 20, 2008 IP
  4. tribulus

    tribulus Peon

    Messages:
    359
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I wonder if they do that with all their blogs?:confused:
     
    tribulus, Feb 20, 2008 IP
  5. wragge11

    wragge11 Guest

    Messages:
    2,222
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You don't need a robots/txt file with Blogger
     
    wragge11, Feb 21, 2008 IP
  6. johneva

    johneva Well-Known Member

    Messages:
    1,480
    Likes Received:
    46
    Best Answers:
    1
    Trophy Points:
    170
    #6
    Yeah thay have started doing this cos all the spammy blogs being made on there I have read from other threads on other forums.
     
    johneva, Feb 21, 2008 IP