Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework list_tasks: change raise error to warning for bad tasks to avoid crashing for bad server state #1244

Merged
merged 1 commit into from
Jun 12, 2023

Conversation

LennartPurucker
Copy link
Contributor

Closes #1234

@codecov-commenter
Copy link

Codecov Report

Patch coverage has no change and project coverage change: -0.12 ⚠️

Comparison is base (bb3793d) 85.24% compared to head (09deee0) 85.12%.

Additional details and impacted files
@@             Coverage Diff             @@
##           develop    #1244      +/-   ##
===========================================
- Coverage    85.24%   85.12%   -0.12%     
===========================================
  Files           38       38              
  Lines         5008     5009       +1     
===========================================
- Hits          4269     4264       -5     
- Misses         739      745       +6     
Impacted Files Coverage Δ
openml/tasks/functions.py 85.32% <0.00%> (-0.47%) ⬇️

... and 1 file with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@mfeurer
Copy link
Collaborator

mfeurer commented Apr 17, 2023

Hey, is this still an issue? I don't think we should add workaround code for uncommon bugs on the server (i.e. they happened only once so far) and rather fix things on the server instead.

@LennartPurucker
Copy link
Contributor Author

Hey, is this still an issue? I don't think we should add workaround code for uncommon bugs on the server (i.e. they happened only once so far) and rather fix things on the server instead.

Mhm, I would say the current workflow (i.e., crashing) is an issue, and the alternative workflow (i.e., warning instead of crashing) would be better. But I see your point that we technically are only following the server specification.

I would leave this to your judgment. Feel free to close the PR.

@PGijsbers
Copy link
Collaborator

PGijsbers commented Apr 25, 2023

I vote +1 on merging this.

Philosophically I agree that openml-python should not accommodate to all kind of buggy server states. However specifically for this case, I think the pragmatic approach to issue a warning instead of an error leads to a much better user experience. My reason for preferring this is because the error is more likely than not caused by tasks in which the user had no interest to begin with (to contrast, I would not add work-arounds for actually downloading and instantiating such a corrupted task, for example).

@mfeurer
Copy link
Collaborator

mfeurer commented Jun 12, 2023

Merging this now as two people would like to have this merged.

@mfeurer mfeurer merged commit a4ec4bc into develop Jun 12, 2023
@LennartPurucker LennartPurucker deleted the skip_bad_task_not_crash branch October 18, 2024 09:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

KeyError on list_tasks
4 participants