I developed a submission tool which will submit a url to hundreds of search engines, and language used is perl. The search engines are stored in sql database, and just read the url information from submission form and then submit to the search engnes one by one. However, during the test, the submission will always stop before th end. Some times it will stop at #18 SE, sometimes #49, while sometime #100, and the total directories in the database is 285. My server is unix and apache. Can anybody help me what's wrong for this?
without any errors it would be hard to tell does your script just stop when it encounters an error ? could it be some type of cgi / mod_perl timeout issue ?
No, it doesn't show any errors. I display the submission process in browser, and also send emails for those successfully submitted. It just stops at #18, or #49, or #100, etc, without showing any errors. However, for example, if it stops at #49, I got email from #129 directory. What do you mean cgi /mod_perl timeout? How to change it?
i haven't had much experience with mod_perl / cgi - so not sure. but if your are still getting results from #129 when your browser stops 1/2 way - maybe your not sending enough data to the browser for it to keep the connection alive ?