Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add atm start, atm status and atm stop commands #130

Closed
csala opened this issue Apr 25, 2019 · 4 comments · Fixed by #133
Closed

Add atm start, atm status and atm stop commands #130

csala opened this issue Apr 25, 2019 · 4 comments · Fixed by #133
Assignees
Milestone

Comments

@csala
Copy link
Contributor

csala commented Apr 25, 2019

Add CLI commands to start ATM as a cluster.

Options should work as follows:

  • atm start: starts one or more workers in background, in wait mode
  • atm stop: stops all the workers
  • atm status: shows information about whether there is a cluster running or not and about how many workers it has.

The start command should start a master process using python-daemon, and this should use multiprocessing to spawn other workers as required.
A pid file for the master process should be used to control whether the ATM is up or not.

Also, optionally, the start command should spawn a REST API app on a separated process.

@beevabeeva
Copy link

Awesome. I might be able to help with this. It's probably a good time to mention that I plan on basing my honours research on extending ATM to use parallelised GPU based ML algorithms, and run across an HPC cluster.

I'd first start with a naive approach: make a bash or Python script that would take in cluster run parameters, based on the example given by @csala in #128

@csala
Copy link
Contributor Author

csala commented Apr 25, 2019

Awesome. I might be able to help with this. It's probably a good time to mention that I plan on basing my honours research on extending ATM to use parallelised GPU based ML algorithms, and run across an HPC cluster.

I'd first start with a naive approach: make a bash or Python script that would take in cluster run parameters, based on the example given by @csala in #128

Thanks for the help offer @beevabeeva! However this is currently being tackled by @pvk-developer in a python based approach, so I think it would be best if you wait for him to finish his development in order to avoid having multiple people working on the same.

On the other side the research around adding GPU based algorithms sound promising! Perhaps you'd like to open a separated issue to discuss the approach and align it with the future developments that are coming into ATM?

@csala csala added this to the 0.1.2 milestone Apr 28, 2019
@csala
Copy link
Contributor Author

csala commented May 3, 2019

Closed via #133

@csala csala closed this as completed May 3, 2019
@beevabeeva
Copy link

beevabeeva commented May 5, 2019

Thanks for the help offer @beevabeeva! However this is currently being tackled by @pvk-developer in a python based approach, so I think it would be best if you wait for him to finish his development in order to avoid having multiple people working on the same.

That is great, thanks!

On the other side the research around adding GPU based algorithms sound promising! Perhaps you'd like to open a separated issue to discuss the approach and align it with the future developments that are coming into ATM?

Will do. I am currently writing up the research proposal. It will be done on the 18th of May, at which point I will open a new issue with a link to the proposal pdf. Thanks for the support thus far!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants