SEEPS

[nicholasloveday]

We should add SEEPS to scores https://doi.org/10.1002/qj.656

It's a WMO metric and used in several ML papers to evaluate precipitation forecasts.

[yingkaisha]

Hi Nicholas,

SEEPS has been implemented in weatherbench2. I will just link it here, and maybe their scripts can help.

https://github.com/google-research/weatherbench2/blob/75fb2b94cf00bae4c632948d1addfcc86cacc300/scripts/compute_climatology.py#L147

https://github.com/google-research/weatherbench2/blob/75fb2b94cf00bae4c632948d1addfcc86cacc300/weatherbench2/metrics.py#L418

It has two parts: (1) Calculate quantile-based thresholds; and (2) Compute SEEPS on each grid.

[nicholasloveday]

Thanks @yingkaisha! I've already created some prototype code. I'll compare my version with the WeatherBench2 implementation to see if they give the same result.

I was actually thinking of using WeatherBench2 data for the tutorial for this as it has the ERA5 SEEPS thresholds.