Adsense Crawler can't get it right

Discussion in 'AdSense' started by scubita, Jan 28, 2009.

0
  1. #1
    Looking at Adsense Site Diagnostics i see every single day same errors:

    Blocked UR: 3 or 4 OLD AND NON EXISTENT urls Reason Blocked: Not Found.

    Of course you can't find them moron, they don't exist for one year!!!

    WTF is going on with this crawler? Why is he so stupid to look after old files? The sitemap only shows the new files... for one almost a year now. This pisses me off cause it looks the site is losing the quality of Pay per Click because of these errors.

    Any idea about this?
     
    scubita, Jan 28, 2009 IP
  2. tata1310

    tata1310 Guest

    Messages:
    34
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Find the source of the link from where the bot crawled ur dead pages, then removed the link. IMHO the source of the link is still existed.

    Simple solutions perhaps you can redirect to your homepage.
     
    tata1310, Jan 28, 2009 IP
  3. scubita

    scubita Peon

    Messages:
    5,550
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #3
    The bot is crawling:

    > www domain . com
    > pagehere.html
    > anotherpage.html
    > andanotherpage.html

    But those pages don't exist for some time now and they are not at server. In fact, it was a html site and now its a WP based site.
     
    scubita, Jan 28, 2009 IP
  4. CharlesFolly

    CharlesFolly Banned

    Messages:
    383
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I read that they were fixing this, so just give it a sec.
     
    CharlesFolly, Jan 28, 2009 IP
  5. scubita

    scubita Peon

    Messages:
    5,550
    Likes Received:
    318
    Best Answers:
    0
    Trophy Points:
    0
    #5
    What did you read and where?
     
    scubita, Jan 28, 2009 IP