-
Notifications
You must be signed in to change notification settings - Fork 383
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update the way to get the length of elements obtained in e2e tests #1450
Conversation
Codecov Report
@@ Coverage Diff @@
## main #1450 +/- ##
==========================================
- Coverage 89.34% 87.00% -2.34%
==========================================
Files 80 100 +20
Lines 3556 4801 +1245
==========================================
+ Hits 3177 4177 +1000
- Misses 379 624 +245
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
How was this passing earlier? |
Surprisingly, this isn't failing in oss at all. This issue is present when using e2e lib in AML. So updated to easy code as using 'be' was not recommended. But nothing wrong with using 'be' though. |
Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com>
1 similar comment
* fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
…ategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com>
…el (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
* Update postbuild with changes in main (#1451) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> * Update predicted class value to uneditable text in counterfactual panel (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
* Update postbuild with changes in main (#1451) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> * Update predicted class value to uneditable text in counterfactual panel (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
…ext field (#1459) * Update postbuild with changes in main (#1451) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> * fix unable to input decimal point * add displayedData to make sure prediction call works * update comment * Update predicted class value to uneditable text in counterfactual panel (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * remove unused change * remove line break * add e2e tests * update e2e * fix flaky test Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com>
* execute e2e tests even with flighted versions of dashboard * rename model stats to model overview, add v1 and v2 for new experience * basic test harness for individual notebook execution and flighted notebook execution, more ID tags added to model overview component * more ids in model overview * Update postbuild with changes in main (#1451) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> * remove randomness from notebooks * small fixes * lots of new IDs and tests * make first set of tests work for first dataset * Update predicted class value to uneditable text in counterfactual panel (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * document e2e-widget options in CONTRIBUTING.md and flightCombinations in e2e-widget.js * lintfix * fix torch bytetensor input type * torch manual seed instead of set_rng_state * modularize e2e-widget script and propagate changes into github actions workflow, remove postbuild triggers, split pipeline into two * fix pipeline naming * remove commas * remove erroneous comma * single quotes * rename folder * CensusClassificationModelDebugging -> CensusClassificationModelAssessment * ignore csv files * clean up remaining renaming operations from debugging -> assessment * update CONTRIBUTING.md, use flighting data, add adjustments for binary classification * diabetes decision making notebook updates to tests * rename test folder to match notebook name, add housing decision making test cases * add multiclass dnn model debugging test case * lintfix * merge follow-up * lintfix * notebook and test case naming: assessment -> debugging * add only naming changes * lintfix * cleanup Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
* execute e2e tests even with flighted versions of dashboard * rename model stats to model overview, add v1 and v2 for new experience * basic test harness for individual notebook execution and flighted notebook execution, more ID tags added to model overview component * more ids in model overview * Update postbuild with changes in main (#1451) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * Fix TypeError: Cannot read properties of undefined (reading 'treatAsCategorical')" (#1452) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * more update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> * remove randomness from notebooks * small fixes * lots of new IDs and tests * make first set of tests work for first dataset * Update predicted class value to uneditable text in counterfactual panel (#1458) * fix error on machines with pyspark installed where passed dataframe is not spark pandas (#1415) * add postbuild branch trigger (#1417) * Fix causal UI strings according to classification/regression tasks (#1419) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix description for model overview (#1425) * fix description for model overview * keep new description for new model overview * fix failing to create error report when filter_features is empty list (#1421) * filter out missing values from what if dropdown to prevent explanation dashboard from crashing (#1418) * Remove |Set Value| blurb in case it is not availble in counterfactual panel (#1426) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add y-axis description to counterfactual feature importance chart (#1423) Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * Add the user class name to causal UI strings (#1422) * Fix causal UI strings according to classification/regression tasks Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix lint error Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix UI test Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add the user class name to causal UI strings Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> * fix math.min / max for array size more than 10^7 (#1427) Signed-off-by: Ke Xu <xuke@microsoft.com> * upgrade pytest and lightgbm to try to fix random pytest segfault test failures (#1424) s * fix flaky notebook causing build failures by adding retry logic (#1431) * Upper bound SciKit-Learn to address freeze in causal (#1432) <!--- Provide a general summary of your changes in the Title above --> ## Description Replaces #1429 to address #1430 . Causal analysis is getting stuck with the latest release of SciKit-Learn. This contains: - Test case which gets stuck with SciKit-Learn 1.1.0 - Upper bound on SciKit-Learn in `requirements.txt` ## Checklist <!--- Make sure to satisfy all the criteria listed below. --> - [x] I have added screenshots above for all UI changes. - [x] Documentation was updated if it was needed. - [x] New tests were added or changes were manually verified. Signed-off-by: Richard Edgar <riedgar@microsoft.com> * fix dependency chart axis updating with incorrect values in explanation dashboard (#1437) * fix codecov and widget test screenshot uploads (#1428) * release raiwidgets and responsibleai v0.18.2 (#1439) * fix (#1441) Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix cohort name conflict and not run few tests for AML (#1442) * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Few e2e tests changes to accommodate AML static tests (#1445) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Fix locators logic for string features - data explorer and model statistics components (#1446) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * lintfix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * fix Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * Add more unittests RAI dashboard input class (#1448) * Add unit tests for ResponsibleAIDashboardInput Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Add more tests Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Fix imports Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Address code review comments Signed-off-by: Gaurav Gupta <gaugup@microsoft.com> * Update the way to get the length of elements obtained in e2e tests (#1450) * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * skip what-if create tests for AML Signed-off-by: vinutha karanth <vinutha.karanth@gmail.com> * update cf predicted class to non-editable text Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> * document e2e-widget options in CONTRIBUTING.md and flightCombinations in e2e-widget.js * lintfix * fix torch bytetensor input type * torch manual seed instead of set_rng_state * modularize e2e-widget script and propagate changes into github actions workflow, remove postbuild triggers, split pipeline into two * fix pipeline naming * remove commas * remove erroneous comma * single quotes * rename folder * CensusClassificationModelDebugging -> CensusClassificationModelAssessment * ignore csv files * clean up remaining renaming operations from debugging -> assessment * update CONTRIBUTING.md, use flighting data, add adjustments for binary classification * diabetes decision making notebook updates to tests * rename test folder to match notebook name, add housing decision making test cases * add multiclass dnn model debugging test case * lintfix * merge follow-up * lintfix * notebook and test case naming: assessment -> debugging * lintfix * fix test data accessors, lintfix * fix heatmap cell test * use lodash * lintfix * delete spec files that aren't required * simplify modelAssessmentDatasets.ts using lodash * make e2e-widget.js work with empty -f arg * add error throwing back * move id inside component and remove extra div * lintfix * adjust for aria-label in regression case * add multiclass aria-label * lintfix * lintfix Co-authored-by: Ilya Matiach <ilmat@microsoft.com> Co-authored-by: Gaurav Gupta <47334368+gaugup@users.noreply.github.com> Co-authored-by: xuke444 <40614413+xuke444@users.noreply.github.com> Co-authored-by: Richard Edgar <riedgar@microsoft.com> Co-authored-by: Vinutha Karanth <vinutha.karanth@gmail.com> Co-authored-by: tongy-msft <91754176+tongyu-microsoft@users.noreply.github.com>
Signed-off-by: vinutha karanth vinutha.karanth@gmail.com
Description
One of the causal test was failing for the way we were getting the length of the elements. This is the updated way to get the length.
Add collapse dropdown before clicking on cancel button in panel
Checklist