problem in webmaster tool?

Discussion in 'Google Sitemaps' started by aliqayyum, Apr 25, 2009.

0
  1. #1
    hi friends
    i need your help
    i uploaded the sitemap on webmaster tool.This is report of webmaster tool.on url URLs restricted by robots.txt showed 8 errors. what does it's means, and secondly i should prevent from this? help me

    Web crawl errors
    Last updated Apr 24, 2009
    Errors for URLs in Sitemaps
    0
    --
    HTTP errors
    0
    --
    Not found
    0
    --
    URLs not followed
    0
    --
    URLs restricted by robots.txt
    8
    Details »
    URLs timed out
    0
    --
    Unreachable URLs
    0
    --
    Total: 8


    reply me
     
    aliqayyum, Apr 25, 2009 IP
  2. kailash

    kailash Well-Known Member

    Messages:
    1,248
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    190
    #2
    It is not an error but your robots.txt file is blocking the access to Google crawler. If you want to index those 8 URLs then you will need to modify your robots.txt file.
     
    kailash, Apr 25, 2009 IP
  3. webhost.uk.net

    webhost.uk.net Well-Known Member

    Messages:
    296
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    128
    #3
    thats true.. just remove your robot.txt .. or modify it that should fix the problem.
     
    webhost.uk.net, Apr 25, 2009 IP
  4. aliqayyum

    aliqayyum Peon

    Messages:
    329
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    how should i removed or modify ??
    tell me the producer !
     
    aliqayyum, Apr 26, 2009 IP
  5. kailash

    kailash Well-Known Member

    Messages:
    1,248
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    190
    #5
    Download the file called robots.txt via FTP and open it in notepad. Make the required changes and upload it again to your web site via FTP.
     
    kailash, Apr 26, 2009 IP
  6. shren.ching

    shren.ching Guest

    Messages:
    54
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    your site robot.txt file build such way that google is enable to read the pages of ur sites. so make necessary changes in robots.txt file.
     
    shren.ching, Apr 26, 2009 IP
  7. themedseoservices

    themedseoservices Guest

    Messages:
    46
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hi,

    It means you have blocked 8 url's from your website.According to my point of view avoid using blocking URL's in robots.txt instead you can just remove the unwanted URL's from Sitemap and resubmit in webastertools. further doubt contact us at http://www.themedseoservices.com
     
    themedseoservices, Apr 28, 2009 IP
  8. Lpe04

    Lpe04 Peon

    Messages:
    579
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Guys, I think he gets the picture that he is blocking urls :)
     
    Lpe04, Apr 28, 2009 IP
  9. aliqayyum

    aliqayyum Peon

    Messages:
    329
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    thanks, might be this would help me
     
    aliqayyum, Apr 29, 2009 IP
  10. chandi786

    chandi786 Peon

    Messages:
    94
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    robots.txt is used to allow or disallow the search engine agents from crawling your websites, while creating your robots.txt you have disallowed some of the pages from getting crawled by search engine agents but not you have added those pages in your sitemap.

    there are two ways to get over it, if you really want those 8 pages not to be indexed but remove them from your sitemap too and if you think you added them in your robots.txt in error, just exclude them from your robots.txt.

    btw, both of these files sitemap.xml and robots.txt are located in the root directory and you can access them throgh your ftp account.
     
    chandi786, Apr 30, 2009 IP
  11. promomanagers

    promomanagers Peon

    Messages:
    234
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #11
    It could be as simple as you are blocking G from indexing pages with strings at the end. It just means it's hit 8 pages it thought it should be able to index that it cannot. I can tell you also at least last year they didn't have to be in your sitemap.
     
    promomanagers, Apr 30, 2009 IP
  12. aliqayyum

    aliqayyum Peon

    Messages:
    329
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    suggest me any website where should i got the informations, and remove this problem,.why this problem occurred!!
     
    aliqayyum, May 1, 2009 IP
  13. mdamin76

    mdamin76 Well-Known Member

    Messages:
    1,752
    Likes Received:
    146
    Best Answers:
    0
    Trophy Points:
    153
    #13
    Which producer that you refer to? :D I guess you mean procedure.:rolleyes:
     
    mdamin76, May 5, 2009 IP
  14. aliqayyum

    aliqayyum Peon

    Messages:
    329
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    thanks for the corrections, but i need help guys ...
     
    aliqayyum, May 5, 2009 IP
  15. advansys

    advansys Guest

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    you have entered 8 of your web pages in the robots,avoid robots and try no follows.so you can avoid such errors.
     
    advansys, May 10, 2009 IP
  16. aliqayyum

    aliqayyum Peon

    Messages:
    329
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    kindly explain me how?
    thanks
     
    aliqayyum, May 12, 2009 IP