Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix error analysis cohort filter for string label values #1766

Merged
merged 1 commit into from
Oct 7, 2022

Conversation

imatiach-msft
Copy link
Contributor

Description

Fix the cohort filter to support string label values. Otherwise, when creating a filter based on "True Y" or "Predicted Y", and changing the base cohort, error analysis can fail to filter the data correctly because the filter from UI is in terms of indexes while the data itself has string values.

Checklist

  • I have added screenshots above for all UI changes.
  • I have added e2e tests for all UI changes.
  • Documentation was updated if it was needed.

@codecov-commenter
Copy link

codecov-commenter commented Oct 6, 2022

Codecov Report

Merging #1766 (794ce37) into main (c044957) will increase coverage by 3.51%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##             main    #1766      +/-   ##
==========================================
+ Coverage   88.30%   91.81%   +3.51%     
==========================================
  Files          89       73      -16     
  Lines        5250     4118    -1132     
==========================================
- Hits         4636     3781     -855     
+ Misses        614      337     -277     
Flag Coverage Δ
unittests 91.81% <100.00%> (+3.51%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ranalysis/erroranalysis/_internal/cohort_filter.py 87.74% <100.00%> (+0.56%) ⬆️
raiwidgets/raiwidgets/cohort.py
raiwidgets/raiwidgets/interfaces.py
raiwidgets/raiwidgets/error_analysis_constants.py
raiwidgets/raiwidgets/model_analysis_dashboard.py
raiwidgets/raiwidgets/dashboard.py
raiwidgets/raiwidgets/error_handling.py
...iwidgets/raiwidgets/model_performance_dashboard.py
raiwidgets/raiwidgets/responsibleai_dashboard.py
...iwidgets/raiwidgets/fairness_metric_calculation.py
... and 7 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@imatiach-msft imatiach-msft force-pushed the ilmat/fix-cohort-filter branch 2 times, most recently from fa7e498 to 4e06d9e Compare October 6, 2022 17:19
1 similar comment
erroranalysis/tests/test_cohort_filter.py Outdated Show resolved Hide resolved
erroranalysis/tests/test_cohort_filter.py Outdated Show resolved Hide resolved
@imatiach-msft imatiach-msft force-pushed the ilmat/fix-cohort-filter branch from 4e06d9e to 794ce37 Compare October 6, 2022 21:58
@imatiach-msft imatiach-msft requested a review from gaugup October 6, 2022 21:59
@imatiach-msft imatiach-msft merged commit 0e6446d into main Oct 7, 2022
@imatiach-msft imatiach-msft deleted the ilmat/fix-cohort-filter branch October 7, 2022 13:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants