-
Notifications
You must be signed in to change notification settings - Fork 652
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add temporary fix for ray import pandas race condition #1174
Add temporary fix for ray import pandas race condition #1174
Conversation
Signed-off-by: simon-mo <xmo@berkeley.edu>
Codecov Report
@@ Coverage Diff @@
## master #1174 +/- ##
==========================================
- Coverage 86.95% 86.43% -0.52%
==========================================
Files 62 62
Lines 6315 6318 +3
==========================================
- Hits 5491 5461 -30
- Misses 824 857 +33
Continue to review full report at Codecov.
|
@simon-mo @devin-petersohn does this appear to work around the issue? |
I tried running tests on Ray several times and didn't have any fails even with 100 pytest workers. So I think the issue is indeed fixed. TeamCity confit is probably wrong and that's the reason why CI testing failed. I restarted it with modified config. |
🤖 TeamCity test results bot 🤖Ray Tests
Dask Tests
Python Tests
|
looks like it's passing the ray test? is there anyway to keep re-run the teamcity build multiple time? |
Yes Ray test passed with 48 workers (TeamCity system has 48 CPU cores). I don't know a way to repeat TC tests other than to restart them manually, but as I wrote before, I ran tests on another system with 100 workers and they all passed to, so I think this race condition is really fixed with this change. |
Signed-off-by: Devin Petersohn <devin.petersohn@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @simon-mo!
What do these changes do?
Attempt to address issues raised in ray-project/ray#7879
flake8 modin
black --check modin
git commit -s
added andpassing