Cron and PHP Execution time

Discussion in 'PHP' started by sojic, May 29, 2009.

  1. #1
    I have to make simple "crawler" which working like this:

    I have 100 rss feeds in database. With simplepie, I get rss content and extract links.

    Using simple_html_dom, I parse all extracted links.

    So... this should execute on shared hosting server every x hours.... but... it is possible PHP execution time to "break" the process.

    Any ideas how to do this, but to avoid high execution time?
     
    sojic, May 29, 2009 IP
  2. joebert

    joebert Well-Known Member

    Messages:
    2,150
    Likes Received:
    88
    Best Answers:
    0
    Trophy Points:
    145
    #2
    Break it down into multiple cron jobs that run at shorter intervals maybe ?
     
    joebert, May 29, 2009 IP
  3. sojic

    sojic Active Member

    Messages:
    133
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    90
    #3
    Yes, that I have on my mind.
     
    sojic, May 30, 2009 IP