Restricted by robots.txt ‎(180)‎ crawl-errors

Discussion in 'Google Sitemaps' started by hassan784, Aug 16, 2011.

0
  1. #1
    i got these link errors many ...how to fix??




    http://www.therealfun.com/wallpapers/Kristen_Bell_9820.jpg" width="62" height="50" alt="image"/></a> </div> <div class="c0 r"><a href="/m/imgres?q=bell+wiki
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/Kate_Hudson_smile_12768jpeg
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/Christmas_santa_model_12077.jpg" width="62" height="50" alt="image"/></a> </div> <div class="c0 r"><a href="/m/imgres?q=3d+santa+decorating
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/Elijah_Wood,_Actor_13508.jpg" width="66" height="50" alt="image"/></a> </div> <div class="c0 r"><a href="/m/imgres?q=elilah+wood+at+x
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/Bolt_Movie_2008_12328.jpg" width="62" height="50" alt="image"/></a> </div> <div class="c0 r"><a href="/m/imgres?q=bolt+movie+girl
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/Ice_Age_3_Movie_2009_12334.jpg" width="62" height="50" alt="image"/></a><a href="/m/imgres?q=2009+movies+age
    URL restricted by robots.txt Aug 13, 2011
    http://www.therealfun.com/wallpapers/2011_Christmas_Elfs_Gifts_14251.jpg" width="66" height="50" alt="image"/></a> </div> <div class="c0 r"><a href="/m/imgres?q=comedy+mom+gifts
     
    hassan784, Aug 16, 2011 IP
  2. shibi07

    shibi07 Peon

    Messages:
    24
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Try to contact your administrator.
     
    shibi07, Aug 16, 2011 IP
  3. hassan784

    hassan784 Member

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #3
    i am the administrator, where i contact?
     
    hassan784, Aug 17, 2011 IP
  4. unknownpray

    unknownpray Active Member

    Messages:
    3,831
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    70
    #4
    The robots.txt is a file that YOU create and tell the Search Engines, OK now this is the list of pages that I don't want you to crawl. Then you place this file at the root directory of your site. If you get any errors regarding robots.txt then just open the file and see what URLs you have disallowed the crawler to crawl.
     
    unknownpray, Aug 21, 2011 IP