1 million result every 24 hours

Discussion in 'PHP' started by jovany, Dec 27, 2009.

  1. #1
    this question is so important to many people
    i have noticed that there are alot of sites that google indexes their searched results

    for example if you searched for

    "free computer+programs"

    you find one of in google results is on the shape

    /index.php?q=free+computer+programs

    look at that part
    index.php?q=free+computer+programs
    PHP:
    and when you click the link you will see it is just a search result in the site

    how can that done please ???

    i have a search engine and i want to store words entered by users in mysql database and then allow it to be crawled daily

    i see other search engines that they has every 24 hours an new over million of results that have been indexed by google and when i see them every day i see google crawl new results

    plz help me
     
    jovany, Dec 27, 2009 IP
  2. gaven

    gaven Peon

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Well dont take it otherwise but this is quite a vague question
    almost like how to make or run search engine
    basic things
    google do have many servers all around the world.
    I think they work optimizing their algorithm every day
    Results are fetched from nearest server.
    Query,database optimization
    and many more
     
    gaven, Dec 27, 2009 IP
  3. dOCnOK

    dOCnOK Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    try this

    every time your search engine do a search query store the query result and the query address in your DB

    and crate a page that list all search query and another page to show the result like this

    example.com/search.php?q=free+computer+programs
    example.com/search.php?q=free+computer+games
    example.com/search.php?q=free+computer+hacks

    when google crawler visit this page he will follow each query link and read each query result
    so it be listed in google search result
     
    dOCnOK, Dec 27, 2009 IP
  4. JAY6390

    JAY6390 Peon

    Messages:
    918
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Basically you need to just add them to the sitemap, and when google crawls the sitemap it will find them all. instead of using horrible searches like that with the GET use pretty urls such as /search/free-computer-games/
    then change that back into a search when google crawls it. You could also have a list of recent 100 searches etc pages that google could crawl (where you just store each search in a table with the time they were inserted) then list the last 100. Google will see that and update accordingly
     
    JAY6390, Dec 27, 2009 IP
  5. jovany

    jovany Peon

    Messages:
    78
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    thanks to all of you friends but how to store every searched word in mysql database if the search engine was based on php
     
    jovany, Dec 27, 2009 IP