URL restricted by robots.txt

Discussion in 'Google Sitemaps' started by lonthee, Oct 13, 2009.

  1. #1
    Hi guys :

    if try to submit sitemap i got this message :
    "URL restricted by robots.txt
    We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit."

    i can't submit my sitemap.xml this address http://cerewet.net/sitemap.xml

    i have change my robots.txt to :

    User-agent: *
    Disallow:

    Sitemap: http://cerewet.net/sitemap.xml.gz

    and have change setting < privacy : to allow all robots for index my site and try to resubmit sitemap.xml but still can't

    any idea ?
     
    lonthee, Oct 13, 2009 IP
  2. Dandy68

    Dandy68 Peon

    Messages:
    73
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Why do you have Disallow in the robots.txt? Is it the xml.gz file you are trying to stop? If so, drop the sitemap: prefix.

    Anyway, in google tools you have a great robots.txt simulator, just play around til you see that it allows your sitemap. But

    User-agent: *
    Allow: / will work..
     
    Dandy68, Oct 13, 2009 IP
  3. lonthee

    lonthee Peon

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks...
    i just put a standard robots.txt as search at google
    and now my website cerewet[dot]net still not index yet by google huh!

    but i have contact my hosting support and they told me to wait allow 48 hours. i'll change robots.txt like dandy68
     
    lonthee, Oct 13, 2009 IP
  4. Dandy68

    Dandy68 Peon

    Messages:
    73
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    No problems ;)
     
    Dandy68, Oct 13, 2009 IP