problem with sitemap.xml and robots.txt

Discussion in 'Google' started by Buckyuk, Jan 5, 2009.

  1. #1
    I have recently created a new site, which seems to be taking longer than usual to get indexed by google.

    I created and submitted a sitemap, but in google webmaster tools, its coming up an error saying a robots.txt file was found but we couldnt download it.

    I dont have a robots.txt file, i checked the robots.txt anylise tool in webmaster tools and it returns googlebot allowed.

    Has anyone else every had any problems like this??
    Thanks

    Alan
     
    Buckyuk, Jan 5, 2009 IP
  2. rena

    rena Peon

    Messages:
    1,987
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #2
    No today also i updated my site map , within a hr verified. How u submit the site map, the format is correct?
     
    rena, Jan 5, 2009 IP
  3. FREE BET

    FREE BET Peon

    Messages:
    927
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #3
    FREE BET, Jan 5, 2009 IP
  4. Buckyuk

    Buckyuk Active Member

    Messages:
    381
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #4
    Thanks i will try that sitemap generator, i was using a different site to generate mine.
    I do have some good backlinks, ive dugg it etc, yahoo has indexed it no probs, but google seems to delaying.

    Will try out that new sitemap, also i have actually created a robots.txt file now allowing all bots, but will need to wait till tmrw before it all gets checked again by google.

    Thanks alot.
     
    Buckyuk, Jan 5, 2009 IP
  5. Buckyuk

    Buckyuk Active Member

    Messages:
    381
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #5
    Thanks alot, the new sitemap seems to have worked, thanks.
     
    Buckyuk, Jan 5, 2009 IP
  6. IEmailer.com

    IEmailer.com Well-Known Member

    Messages:
    1,864
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    110
    #6
    Good for you dude, now work more on your website content and backlinks ;)
     
    IEmailer.com, Jan 5, 2009 IP
  7. blu3.sky

    blu3.sky Member

    Messages:
    71
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #7
    i was having the same issue... thanks alot
     
    blu3.sky, Jan 5, 2009 IP
  8. Buckyuk

    Buckyuk Active Member

    Messages:
    381
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #8
    Ok... Problem again.

    Everything seemed to go ok, google checked the sitemap and returned it as all ok.

    Now after google have tried to crawl my site, it has returned robots.txt unreachable again. and as a result they wont be added to the index.

    The robots.txt file is reachable if i key the address into the address bar. i have checked the header and it returns HTTP/1.1 200 OK

    is there any advice from the digital point guru's??
     
    Buckyuk, Jan 6, 2009 IP