dynamically change query term in the url

Discussion in 'PHP' started by pragan, Jun 18, 2008.

  1. #1
    hi,

    I am trying to write a script which can do the following. I do not have any idea of how to write it ..but have the idea of how it should/will work.

    I have a list of words in an excel file(almost 5000words). I need to take each word and then put in the search query of any search engine(for example ask.com) and store the result that appears under "related words"/"suggested words"/"narrow your search words" in a file.

    Example:
    If you search for the word "forum" in ask.com, we can see the url as
    http://www.ask.com/web?q=forum&search=search&qsrc=0&o=0&l=dir

    and the search result page contains "Narrow Your Search"

    Roman Forum
    Free Forum
    ..
    ...
    etc.

    So I need to write a script that can take word by word from my excel list and put it in the url (bold text) and then store only the "result under "Narrow your search result" in a file.
    http://www.ask.com/web?q=nextword&search=search&qsrc=0&o=0&l=dir

    Please let me know if its something possible and if I can have look at any examples..I would need to complete this as soon as possible.

    I can explain it in a more better way if the above explaination is not clear.

    Regards
     
    pragan, Jun 18, 2008 IP
  2. GreatMetro

    GreatMetro Peon

    Messages:
    117
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    You should google "Screen Scraping"
     
    GreatMetro, Jun 27, 2008 IP
  3. wowla_123

    wowla_123 Peon

    Messages:
    147
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #3
    If you are only interested in related keywords, you can use Yahoo API for this purpose. See an example at http://web.vovla.com/index.php?p=forum&res=1 (check the left column). Using API, you won't need page scrapping.
     
    wowla_123, Jun 27, 2008 IP