1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Help needed for crawling

Discussion in 'PHP' started by jyotsna, Sep 13, 2005.

0
  1. #1
    Hi All,

    In my new project I have to fetch the content of the two web sites and store in my database. Please help me in this regard.

    Thanks in advance.
    Jyotsna. Ch.
     
    jyotsna, Sep 13, 2005 IP
  2. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Go to phpclasses.org and search for 'spider' or 'crawler' - it;s all done for you :)

    Also check hotscripts.com for code inspiration.
     
    T0PS3O, Sep 13, 2005 IP
  3. yfs1

    yfs1 User Title Not Found

    Messages:
    13,798
    Likes Received:
    922
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Just as a side note, if you don't own the two sites, make sure to get permission first ;)
     
    yfs1, Sep 13, 2005 IP
  4. jyotsna

    jyotsna Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thank you TOPS30 and yfs1. If I have any doubt I will disturb you again.
     
    jyotsna, Sep 13, 2005 IP
  5. jyotsna

    jyotsna Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I searched in php classes and hot scripts. But in both I can't find useful thing for crawling the site content. (They are intended for meta tags)

    Please send me the class or sample program for this.

    Thanks.
     
    jyotsna, Sep 13, 2005 IP
  6. Gmorkster

    Gmorkster Peon

    Messages:
    202
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #6
    What exactly do you need and how well versed are you in PHP? What you need might not exactly be a piece of cake :)
     
    Gmorkster, Sep 14, 2005 IP
  7. jyotsna

    jyotsna Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Actually there is a site displays the details about a movie (image, title, year, cast, etc...). I need to extract the content and using that content I have to extract the values for those and store in my database.

    Now I have the content. Please help me in extracting the data.
    The content is like this.

    [ <TR><TD WIDTH='10%'><FONT FACE='VERDANA' COLOR='#000000' SIZE='-2'><FONT COLOR=#000000><B>Cast:</B></FONT></TD>
    <TD COLSPAN='2'><FONT FACE='VERDANA' COLOR='#000000' SIZE='-2'> <A HREF='search.dvd?cast=Carrie Ng'>Carrie Ng</A>, <A HREF=search.dvd?cast=Simon Yam'>Simon Yam</A>, <A HREF='search.dvd?cast=Chingmy Yau'>Chingmy Yau</A>, <A HREF='search.dvd?cast=Svenvara Madoka'>Svenvara Madoka</A>, <A HREF='search.dvd?cast=Yiu Waio'>Yiu Waio</A>, <A HREF='search.dvd?cast=Kelly Yao'>Kelly Yao</A></TD></TR>
    ]

    I need to extract
    Carrie Ng, Simon Yam, Chingmy Yau, Svenvara Madoka, Yiu Waio, Kelly Yao

    Thanks and regards,
    Jyotsna. Ch.
     
    jyotsna, Sep 15, 2005 IP