I'm Seeing Lots Of Poorly Spidered Directories

Discussion in 'Directories' started by Pahrump Mike, Oct 6, 2006.

  1. #1
    While I was busy submitting a couple of sites to a list of directories I took a look at the Google cache on one and I noticed that some of the interior pages hadn't been spidered in many months. Here's a few examples:

    Your Weblog Here - homepage spidered 30 Sep, but then if you click on the very first category, animals, you see that it hasn't been spidered since 30 Apr. And the site shows PR6.

    Free Website Directory - Homepage spidered 29 Sep, but their Shopping Category - no cache copy available. A PR 4 site.

    Wura World - homepage spidered 30 Sep, first category, Accounting, spidered 30 Jun. Another PR4 directory.

    Any opinions on what this may mean? It took me a short period of time to come up with these examples, and I only looked at 6 directories in order to come up with a list of 3 that seemed to be drawing no interest from Google.
     
    Pahrump Mike, Oct 6, 2006 IP
  2. ! Ask !

    ! Ask ! Peon

    Messages:
    3,282
    Likes Received:
    260
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Kingbloom is another example really big cache problems
    Probably google doesn’t have any interested on this sites because of duplicated content, most directories are only human edited scrapper sites.
     
    ! Ask !, Oct 6, 2006 IP
  3. affnice

    affnice Peon

    Messages:
    215
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    if you noticed subcategories most of them gone to supplemental result thats maybe the problem, once out from supplemental result it will crawl frequently
     
    affnice, Oct 6, 2006 IP
  4. mystikmedia

    mystikmedia Jedi Master

    Messages:
    5,564
    Likes Received:
    498
    Best Answers:
    0
    Trophy Points:
    270
    #4
    Hmm. Well, I don't know how reliable this is. What makes me say that is pages on Alive Directory that do not even show as being cached get traffic from Google for searches that go to those pages. So, it seems that Google may know about pages, but for some reason, does not show their cache. Perhaps the same is with showing the latest cache date?
     
    mystikmedia, Oct 6, 2006 IP
  5. ! Ask !

    ! Ask ! Peon

    Messages:
    3,282
    Likes Received:
    260
    Best Answers:
    0
    Trophy Points:
    0
    #5
    The cached pages also depend on the datacenter you are using, as everybody knows the information stored is different from datacenter to datacenter.
     
    ! Ask !, Oct 6, 2006 IP