Auto Generating Pages

Discussion in 'Programming' started by Ferrarislave, Aug 20, 2006.

  1. #1
    How does this work? I see many sites autogenerating content for visitors that search for it. These sites are usally legit, and also rank well.

    My question is, how does Google index these pages since they are not linked to? Also, how would using a 404 handler help? These questions where sparked by shoemoneys recent webmaster radio session. :)
     
    Ferrarislave, Aug 20, 2006 IP
  2. brandnewx

    brandnewx Peon

    Messages:
    988
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    0
    #2
    It must be linked to first. Some sites display "recent searches" or "last 50 searches" links on home page, so i guess that's why google indexes them.
     
    brandnewx, Aug 21, 2006 IP
  3. Darrin

    Darrin Peon

    Messages:
    123
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Could someone elaberate on this a little?

    This may not be the right question for pragramming necessarily, but how do these sites get indexed? Do they create dynamic pages and then create pages dynamically with links to all of them with all kinds of different key workds?

    I've noticed this a number of times when I search for a phrase and sites come up that are obviously dynamically generated off of my key phrase that is passed by the search engine. Were all of these key phrases defined and linked to in advance, indexed, and then it's just coincidence that I typed one it and it showed up in the top 10 in the search?

    Thanks,
    -Darrin
     
    Darrin, Aug 21, 2006 IP
  4. Ferrarislave

    Ferrarislave Peon

    Messages:
    1,129
    Likes Received:
    38
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Can someone chime in and elaborate more on this? How do these sites do it?

    For example this site?

    http://www.raqrea.info/

    It seems to be scraping info from various websites and posting links to those sites and ranking well....
     
    Ferrarislave, Aug 21, 2006 IP
  5. ccoonen

    ccoonen Well-Known Member

    Messages:
    1,606
    Likes Received:
    71
    Best Answers:
    0
    Trophy Points:
    160
    #5
    first of all - you need a source for the keywords. First of all - if you have an internal search on your site - you can query the highest hit words, or terms, then display them dynamically on your page (I do it on my site at http://www.golfscramblesearch.com/search/) Not only does it give me free hits for people searching on them popuplar terms - but it also keeps my page fresh with always new content :)
     
    ccoonen, Aug 21, 2006 IP
  6. ccoonen

    ccoonen Well-Known Member

    Messages:
    1,606
    Likes Received:
    71
    Best Answers:
    0
    Trophy Points:
    160
    #6
    A second approach is to build a scraper - and you can find sites/search engines that give the highest hit key terms. I would not advise this approach because these are the "big" dogs - i would try going after niche keyterms that people don't already have a ton of sites built just around them. For instance: Online casino - you can kiss that keyterm good bye, or insurance, viagra, etc... hehe
     
    ccoonen, Aug 21, 2006 IP
  7. Ferrarislave

    Ferrarislave Peon

    Messages:
    1,129
    Likes Received:
    38
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Do you rank well for the keywords you dynamically generate?
     
    Ferrarislave, Aug 21, 2006 IP