-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Elastic Horovod on Spark auto-scale #1956
Elastic Horovod on Spark auto-scale #1956
Conversation
171c508
to
3910088
Compare
3910088
to
9e791b7
Compare
7e544be
to
45c8fd0
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good! To unblock this for now, let's skip the failing tests. We can put together a follow-up PR to determine the root cause and fix them.
@@ -194,14 +194,31 @@ def wait_for_initial_registration(self, timeout): | |||
self._wait_cond.release() | |||
|
|||
def wait_for_command_start(self, timeout=None): | |||
"""Waits for a command to start. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The overloaded behavior is a little tricky to follow. I would consider breaking this out into two methods: one that raises an exception and takes a Timeout object, and another that takes a numerical value and returns the state at the end of the timeout.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
You are right, this is horrible. I have split it up into two methods. Thanks!
8d06549
to
448501f
Compare
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
…sting Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
Signed-off-by: Enrico Minack <github@enrico.minack.dev>
448501f
to
f69a110
Compare
Blocked by #2063.