lizard-worker

Itroduction

This the messaging application to manage the tasks. It uses the RabbitMQ as message broker and pika to send en consume messages from the broker.

Development installation

The first time, you'll have to run the "bootstrap" script to set up setuptools and buildout:

$> python bootstrap.py

And then run buildout to set everything up:

$> bin/buildout

Create models

$> bin/django syncdb

(On windows it is called bin\buildout.exe).

You'll have to re-run buildout when you or someone else made a change in setup.py or buildout.cfg.

The current package is installed as a "development package", so changes in .py files are automatically available (just like with python setup.py develop).

If you want to use trunk checkouts of other packages (instead of released versions), add them as an "svn external" in the local_checkouts/ directory and add them to the develop = list in buildout.cfg.

Tests can always be run with bin/test or bin\test.exe.

Open website on http://localhost:8000/.... to monitor the logging Open website on http://10.100.155.150:55672 to monitor the broker

For more information about RabbitMQ take a look at http://www.rabbitmq.com/.

Configuration

Add BROKER_SETTINGS and QUEUES to the project settings (see example in workersettings.py)

Add PERFORM_TASK_MODULE and PERFORM_TASK_FUNCTION that have to be calling on worker's callback (see example in workersettings.py)

Define TaskTypes and WorkflowTemplates using admin interface.

Management commands

lw_logging_worker - Run logging worker. The worker listens to logging

queue, retrieves the messages and insert they into storage

lw_task_worker - Run task worker. The worker listens to the queue

with the same code as passed task code, retrieves message, performs the task, sends loggings to 'logging' queue.

lw_workerbeat - Run workerbeat to send the heartbeat message to configured queues.

lw_supervisor_worker - Use the worker to start task-workers remotely.

Only for unix systems.

lw_start_scenario - Start scenario.

lw_manage_worker - Run it to send a command to supervisor worker.

lw_perform_task - Run the task directly without broker.