Highlight lack of ongoing support on README #197
Conversation
| @@ -1,8 +1,17 @@ | |||
| # ClusterManagers | |||
|
|
|||
| Support for different job queue systems commonly used on compute clusters. | |||
| > [!WARNING] | |||
There was a problem hiding this comment.
Might be a good idea to grab a repostatus.org badge. "Unsupported" or "Suspended" seem like likely fits?
There was a problem hiding this comment.
Wonder if we could have it at a finer level, like "Unsupported" on the different individual cluster managers? Since it seems like from the discourse thread that there are certain managers that work well.
There was a problem hiding this comment.
Fwiw I use and try to help maintaining the lsf manager.
There was a problem hiding this comment.
Indeed it sounds like lsf is known to work well. Any others? We could just have a column with whether a method works or not
There was a problem hiding this comment.
Condor works with some common filesystem mounted assumptions
There was a problem hiding this comment.
Could it be worth it to also have a clause explaining that most cluster managers are not expected to be guaranteed to work out of the box. I need to supply quite a few extra program flags to the LSF manger and I also need a separate hack to find an open port for the workers for it to work on my system. I don't consider it a bug or deficit that ClusterManagers can't find a set of working arguments for me automatically.
For the maintenance status question:
Would it be useful if the level of support is indicated through a column with maintainer names (with something like "maintainer needed" indicates that it is not well maintained)?
There was a problem hiding this comment.
@DrChainsaw I think both of those ideas are really good.
There was a problem hiding this comment.
Where does this stand - did you want to add that stuff to the table in the readme?
There was a problem hiding this comment.
Sounds good to me. Sorry I didn’t adjust the pr yet; just busy with teaching
There was a problem hiding this comment.
All good! There's no real urgency, just want to make sure I'm not the one holding it up 😉
Since many of the cluster managers do not actually work (#196 #189 #185 #179 #163 ...), I think it is very important to state this up-front on the README. Currently the README explicitly states that all of these cluster managers are "currently supported" which causes users like myself to spend an enormous amount of time trying to get it working, only to find out it is not actually maintained/tested.
I sincerely empathize that it is very hard to find an active maintainer for all of these cluster managers. So I think it is just much better to be up front about this lack of ongoing support so that users don't get stuck.