1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

False robots.txt reading from Google

Discussion in 'Google Sitemaps' started by roger_inkart, Mar 22, 2008.

  1. #1
    So, for months I've had the same robots.txt and sitemap.xml for the domain www.stock.inkart.net. Yesterday I noted sitemap errors in Google Webmaster. Running an analysis on the robots.txt it reports that the entire site is blocked:

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /images/
    Disallow: /
    Disallow: /images/thumbs/

    But that's not how the robots.txt actually reads. It never has:

    http://stock.inkart.net/robots.txt

    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /images/
    Disallow: /images/thumbs/

    Strange, huh? Anyone have any insight? Is this just a bug?
    SEMrush
    Thanks!
     
    roger_inkart, Mar 22, 2008 IP
    SEMrush
  2. vinod.kumar

    vinod.kumar Banned

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    check robots.txt in wbemaster tool
     
    vinod.kumar, Mar 26, 2008 IP