Feature Monitoring

[hangfei]

Feature monitoring for scalar features.

SQL schema:
For numeric features

feature_name | feature_type | mean | median | max | min | coverage |

For string/boolean features:

feature_name | feature_type | cardinality | coverage

coverage = (total_count - missing_count) / total_count
cardinality = count of different items. For example, ["apple", "apple", "orage" ] => cardinatily is 2(apple and orange)

For example:
input feature table:

+----+------+--------+-----+--------------------+---------+
|key0|f_null|f_string|f_int|            f_double|f_boolean|
+----+------+--------+-----+--------------------+---------+
|   1|  null|   apple|    1|  0.7191070126381514|     true|
|   2|  null|   apple|    0|   0.631537113156793|    false|
|   5|  null|  orange|    1|  0.8990245049992188|    false|
|   3|  null|    null|    0|  0.5762385339376767|    false|
|   4|  null|  orange|    0|  0.4366523814297121|    false|
|   8|  null|  orange|    0| 0.14328502026059808|    false|
|  10|  null|  orange|    0|  0.9389259655580797|     true|
|   6|  null|  orange|    0|  0.7877756383579947|    false|
|   7|  null|  orange|    1|0.056606459160327804|    false|
|   9|  null|  orange|    1|  0.6003317209869276|    false|
+----+------+--------+-----+--------------------+---------+

+------------+------------+----------+----+----+----+----+--------+
|feature_name|feature_type|      date|mean| avg| min| max|coverage|
+------------+------------+----------+----+----+----+----+--------+
|      f_null|      double|2022-06-07|null|null|null|null|     0.0|
+------------+------------+----------+----+----+----+----+--------+

+------------+------------+----------+----+----+----+----+--------+
|feature_name|feature_type|      date|mean| avg| min| max|coverage|
+------------+------------+----------+----+----+----+----+--------+
|      f_null|      double|2022-06-07|null|null|null|null|     0.0|
+------------+------------+----------+----+----+----+----+--------+

+------------+------------+----------+----+---+---+---+--------+
|feature_name|feature_type|      date|mean|avg|min|max|coverage|
+------------+------------+----------+----+---+---+---+--------+
|       f_int|     integer|2022-06-07| 0.4|0.4|  0|  1|     1.0|
+------------+------------+----------+----+---+---+---+--------+

+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+
|feature_name|feature_type|      date|              mean|               avg|                 min|               max|coverage|
+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+
|    f_double|      double|2022-06-07|0.5789484350485481|0.5789484350485481|0.056606459160327804|0.9389259655580797|     1.0|
+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+

+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+
|feature_name|feature_type|      date|              mean|               avg|                 min|               max|coverage|
+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+
|    f_double|      double|2022-06-07|0.5789484350485481|0.5789484350485481|0.056606459160327804|0.9389259655580797|     1.0|
+------------+------------+----------+------------------+------------------+--------------------+------------------+--------+

+------------+------------+----------+-----+------+--------+-----------+
|feature_name|feature_type|      date|  min|   max|coverage|cardinality|
+------------+------------+----------+-----+------+--------+-----------+
|    f_string|      string|2022-06-09|apple|orange|     0.9|          3|
+------------+------------+----------+-----+------+--------+-----------+
+------------+------------+----------+-----+----+--------+-----------+
|feature_name|feature_type|      date|  min| max|coverage|cardinality|
+------------+------------+----------+-----+----+--------+-----------+
|   f_boolean|     boolean|2022-06-09|false|true|     1.0|          2|
+------------+------------+----------+-----+----+--------+-----------+