Site Crawler Diagnostics

Discussion in 'Reporting & Stats' started by whateverandever2, Jul 22, 2006.

  1. #1
    In my 'Site Crawler Diagnostics' section it says 'Our crawler was unable to access the URLs listed below. We encourage you to resolve these issues in order to allow us to crawl more of your pages and provide relevant ads.'

    But the page in question doesnt even exist? Should I just leave it?
     
    whateverandever2, Jul 22, 2006 IP
  2. tflight

    tflight Peon

    Messages:
    617
    Likes Received:
    38
    Best Answers:
    0
    Trophy Points:
    0
    #2
    If the page doesn't exist then it is likely that a crawler tried to get to that page from a broken link either on your site or from an external site. Sounds like nothing to worry about. :)
     
    tflight, Jul 22, 2006 IP
  3. whateverandever2

    whateverandever2 Peon

    Messages:
    881
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Ahh ok, well the link isnt on the site, and doing a google search doesnt find that link listed anywhere either
     
    whateverandever2, Jul 22, 2006 IP
  4. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I have this problem all the time. After extensive research, my hosting company generated a Site Map 6 months ago but keep submitting it. I do my own Site Maps now and there seems to be an overlap too.

    I have ask them to stop but it hasn't happened.

    Jim Catanich
    www.catanich.com
     
    catanich, Jul 22, 2006 IP
  5. true_promote

    true_promote Well-Known Member

    Messages:
    528
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    138
    #5
    I suggest using a sitemap for error free results.I have the same problem with my site.But in my case the page previously existed but I removed it later,still comes in search results
    Anyways nothing to worry
     
    true_promote, Jul 23, 2006 IP
  6. thegamer

    thegamer Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Hi there....do you happen to do any article submissions? or anything of that sort? Sometimes some of the article directories mess up the bottom signature section and have a broken link in there giving you a broken link listed under Google's Webmaster tools....it is an external link and nothing that is really to worry about, not that you could really do anything about it if you did since it is someone else's site having the problem, the links to your URL in the signature area usually still work, kind of an enigma.

    As for previous pages that still show up in the search results, though I still have to do this after changing my entire site yesterday, making 301 redirects for each of the invalid links keeps Google happy, but even more importantly allows you to retain at least some of the traffic those old pages generate by directing them to useful and current information on your site.
     
    thegamer, Jun 11, 2010 IP