is this a sitemap problem?

Discussion in 'Google Sitemaps' started by UrbanMonk, Apr 22, 2007.

0
  1. #1
    Hey guys,

    I run a blog at www.urbanmonk.net and about 2 weeks ago deleted a couple of posts (bad mistake). Now I check 404 errors and seems that I get a lot of bots trying to get to the deleted pages.

    User Agent: msnbot-media/1.0 (+http://search.msn.com/msnbot.htm)
    User Agent: Mediapartners-Google/2.1

    1) Are these bots?
    2) I've already updated my sitemap and pinged Google a few times, is it a sitemap problem? I haven't pinged the other search engines, how do I do so?
    3) what can I do?

    Thanks for any advice in advance :D
     
    UrbanMonk, Apr 22, 2007 IP
  2. weppos

    weppos Well-Known Member

    Messages:
    99
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    125
    #2
    Yes, they are.
    The first is MSN/Live bot and the second one is AdSense Bot.

    First of all check these pages are not linked somewhere in your site.
     
    weppos, Apr 23, 2007 IP
  3. UrbanMonk

    UrbanMonk Peon

    Messages:
    505
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Thanks I'll do that now
    great avatar by the way haha!
     
    UrbanMonk, Apr 23, 2007 IP
  4. Phooey

    Phooey Active Member

    Messages:
    413
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    80
    #4
    Even if you ping search engines with a new updated sitemap right away when you delete posts, it's still going to try to access the pages it had previously crawled. Once it fails to access them a few times, it'll stop and will remove that page from it's index.
     
    Phooey, Apr 23, 2007 IP
  5. peanutpad

    peanutpad Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    use your htaccess file to do a redirect on any missing pages
     
    peanutpad, Jun 14, 2007 IP