A bad mod_rewrite rule ended up logging a lot of stuff to the error log. The way Apache works is the httpd processes are killed and restarted after a certain number of requests, so only the new httpd processes were affected. Which is why it would work sometimes and not others (depending on the process your request was routed to).