1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

help needed . robots.txt and sitemap

Discussion in 'Google Sitemaps' started by Megafu, Feb 6, 2008.

  1. #1
    hi there i really need help with this small problem:

    1 - i have a blog called: www.something.com
    2 - i have created a sudbomain called: cars.something.com
    3 - i use wordpress in both blogs and a plugin to create sitemap
    4 - the sitemap works just fine with: www.something.com
    5 - the sitemap at google gives me an error sayin that it is blocked by robots.txt and i didnt even have any "robots.txt" in the folder of the sudbomain (car.something.com). so after that i added one "robots.txt" copied from main domain (www.something.com) . still same stupid error.

    any idea? help?

    anything apreciated. im totally lost here... :confused:
     
    Megafu, Feb 6, 2008 IP
  2. promomanagers

    promomanagers Peon

    Messages:
    234
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Random thought but have you verified the contents of your robots file versus the google validator? We had an issue recently with a minor change in the robots file causing some problems with our portfolio group.

    Verify the content of the robots file first, use a trial version of a sitemap generator second, or xml sitemaps online.

    Good luck.
     
    promomanagers, Feb 6, 2008 IP
  3. dairyman

    dairyman Notable Member

    Messages:
    7,224
    Likes Received:
    274
    Best Answers:
    0
    Trophy Points:
    205
    #3
    Just go to the url http://www.robotstxt.org/ and see how a robots.txt file is created. Information regarding allowing or blocking the bot / crawler / spider to any page of your site is discussed there. Hope you would find that useful.
     
    dairyman, Feb 7, 2008 IP