create automatic jobs

[antgonza]

This can be used to empty folders in the upload folder, check that the db and the file system are consistent, etc

From @squirrelo:
Looks like you want a combination of IOLoop.PeriodicCallback and IOLoop.add_timeout
http://stackoverflow.com/questions/24089086/unexpected-tornado-ioloop-periodiccallback-behavior

[antgonza]

It also should remove unused file paths.

[josenavas]

This issue is quite broad. We should better define which are the things that we want to do.

Also, IMOO we don't want to do this in the IOLoop, because that will be running on the server itself, so we are not freeing the main system of doing some work. Ideally this can be multiple cron jobs that start at qiita webserver start time.

[squirrelo]

We may be able to have two IOloops going, one for web server and one as a cron-type thing.

[josenavas]

Thanks @squirrelo
But this means that the IOloop is still executed on the server machine right? I was thinking in something that is submitted to the queues and executed in a worker.

[antgonza]

Good point so perhaps an IOloop that starts a job in the workers is the way to go.

[wasade]

Yes, one of the motivations to make job submission as easy as possible with
moi, and without a need to tie it to a user

On Wed, Apr 22, 2015 at 2:58 AM, Antonio Gonzalez notifications@github.com
wrote:

Good point so perhaps an IOloop that starts a job in the workers is the
way to go.

—
Reply to this email directly or view it on GitHub
#814 (comment).