Well i use a cron job on my arcade site , it downloads new games everyday and stocks the database. The games are inserted into a queue from which i can select and add them.
I use cron jobs every 5 minutes to launch my own cron daemon, which will launch some k cron jobs then