In order to build a system to maintain thousands of cron jobs on a Linux system, I'm facing the problem of being able to handle them in a scalable way. I need to use a database (I was thinking of using MySQL) for storing the jobs instead of default plaintext files.
Does anyone know if there is a module or plugin for any cron daemon that can handle this task?
Thank you in advance
What you really need for this is a job scheduler.
Please check this list: http://en.wikipedia.org/wiki/List_of_job_scheduler_software can be useful for you
Another option, assuming you're on an OS that supports the cron.d directory structure, is to break your jobs into individual .cron files and manage them via the configuration management tool of your choice (Puppet, for instance)
Otherwise, go with a job scheduler...
Here's another possible solution:
https://github.com/bvandenbos/resque-scheduler
Not the same as cron, but if you have temporary or sporadic jobs, Resque is a good option.
