Adding Summary Stats feature (#302)

* quick draft for simple stats sum functionality * draft for simple stats avg functionality * draft for simple stats std functionality * draft for simple stats count functionality * expand rankers to work with dq and ss results * fix comparison plots * rename simplestats to summarystats * change row count api to not use columns * add support for python 3.11 and drop support for python 3.7 * add sampling error to sum stats avg * add sampling error to sum stats sum * add summary stats std samling error * add summary stats median * fix weird pattern matching issue * Re-add python 3.7 support, conditional imports for pandas and scipy based on python version Signed-off-by: niels <niels@nannyml.com> * Linting + style changes. Added test for Rannker using UnseenValues result Signed-off-by: niels <niels@nannyml.com> * stats avg tutorial * summary stats docs * add sampling error * merge bug fix * Fix dependency issues + update workflows to include python 3.11 Signed-off-by: Niels Nuyttens <niels@nannyml.com> * Exclude numpy 1.25 as it crashes test Signed-off-by: Niels Nuyttens <niels@nannyml.com> * Conditional bump in matplotlib version --------- Signed-off-by: niels <niels@nannyml.com> Signed-off-by: Niels Nuyttens <niels@nannyml.com> Co-authored-by: niels <niels@nannyml.com> Co-authored-by: Niels Nuyttens <niels.nuyttens@nannyml.com>
NannyML · Jun 19, 2023 · 990505c · 990505c
1 parent b686b41
commit 990505c
Show file tree

Hide file tree

Showing 63 changed files with 9,082 additions and 1,176 deletions.
diff --git a/.github/workflows/dev.yml b/.github/workflows/dev.yml
@@ -20,7 +20,7 @@ jobs:
     # The type of runner that the job will run on
     strategy:
       matrix:
-        python-versions: ['3.7', '3.8', '3.9', '3.10']
+        python-versions: ['3.7', '3.8', '3.9', '3.10', '3.11']
         os: [ubuntu-20.04]
 #        os: [ubuntu-18.04, macos-latest, windows-latest]
     runs-on: ${{ matrix.os }}

diff --git a/docs/_static/tutorials/stats/avg-car_value.svg b/docs/_static/tutorials/stats/avg-car_value.svg
diff --git a/docs/_static/tutorials/stats/avg-debt_to_income_ratio.svg b/docs/_static/tutorials/stats/avg-debt_to_income_ratio.svg
diff --git a/docs/_static/tutorials/stats/avg-driver_tenure.svg b/docs/_static/tutorials/stats/avg-driver_tenure.svg
diff --git a/docs/_static/tutorials/stats/count.svg b/docs/_static/tutorials/stats/count.svg
diff --git a/docs/_static/tutorials/stats/median-car_value.svg b/docs/_static/tutorials/stats/median-car_value.svg
diff --git a/docs/_static/tutorials/stats/median-debt_to_income_ratio.svg b/docs/_static/tutorials/stats/median-debt_to_income_ratio.svg
diff --git a/docs/_static/tutorials/stats/median-driver_tenure.svg b/docs/_static/tutorials/stats/median-driver_tenure.svg
diff --git a/docs/_static/tutorials/stats/std-car_value.svg b/docs/_static/tutorials/stats/std-car_value.svg
diff --git a/docs/_static/tutorials/stats/std-debt_to_income_ratio.svg b/docs/_static/tutorials/stats/std-debt_to_income_ratio.svg
diff --git a/docs/_static/tutorials/stats/std-driver_tenure.svg b/docs/_static/tutorials/stats/std-driver_tenure.svg
diff --git a/docs/_static/tutorials/stats/sum-car_value.svg b/docs/_static/tutorials/stats/sum-car_value.svg
diff --git a/docs/_static/tutorials/stats/sum-debt_to_income_ratio.svg b/docs/_static/tutorials/stats/sum-debt_to_income_ratio.svg
diff --git a/docs/_static/tutorials/stats/sum-driver_tenure.svg b/docs/_static/tutorials/stats/sum-driver_tenure.svg