cs untested account fixes etc

[jasonmotha]

Description

Checks all platform accounts for jobs before marking them as missing from queue. And a --no-queue-monitor flag if you want to run run_cs without queue-monitor thread running.

ucgmsim/qcore#254 depends on this PR (needs to be merged at the same time)

Changes were tested in cs_fixes branch and then the changes applied to master.

[shot0829]

Looks good.
But I'm curious about the use case of no-queue-monitor.
Were you trying to run the same install/batch of simulations using different account to speed it up?
Did you have different task_config to prevent two daemons submitting jobs for the same event?

[jasonmotha]

Good question. Yeah, was using it to submit jobs on both queues. Mainly to level the CH use on both accounts to keep our fairshare steady. Because I was limiting n_jobs, both run_cybershake threads didn't get around to submitting jobs at the same time. Most of the time when I'd use something like this, I'd dump jobs into the queue and then kill the process.
If I were to leave two copies running over a longer period, separate config files would be a better option!

Looks good. But I'm curious about the use case of no-queue-monitor. Were you trying to run the same install/batch of simulations using different account to speed it up? Did you have different task_config to prevent two daemons submitting jobs for the same event?

[jasonmotha]

@sungeunbae I'll merge this now as it's currently out of sync with qcore, but if you have any other change requests I can open another PR?