Celery Manager

[ryannova]

Create a celery manager that automatically manages the celery workers and restarts them accordingly when they have become unresponsive.

merlin manager command was added and there are 3 options run start and stop.

• run: starts the manager but is processing blocking but allows users to see the manager outputs and will be the main function for replacing merlin monitor for allocation management.
• start: starts the manager in a background process and is non-blocking.
• stop: stops the manager from a background or run process.

[lucpeterson]

Ping on this. Is the plan to merge the new test stuff in and then keep going?

[bgunnar5]

@lucpeterson yeah that's the plan. Once the new tests are merged then all these tests should pass. We'll still need to create tests for the manager itself but I'm going to get started on that hopefully this week. We also need to figure out a good way to integrate the manager command with the existing monitor command, as there's a lot of overlap there.