Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loss scalings #5

Open
1 of 2 tasks
mc4117 opened this issue Dec 13, 2024 · 0 comments · May be fixed by #52
Open
1 of 2 tasks

Loss scalings #5

mc4117 opened this issue Dec 13, 2024 · 0 comments · May be fixed by #52

Comments

@mc4117
Copy link
Member

mc4117 commented Dec 13, 2024

This issue will coordinate the different loss scaling work being conducted.

There are a series of issues that we will work on:

  • The use of 'variable' scalars for loss functions and how to use them for validation metrics
  • The pressure level scalar configuration does not work as expected (see separate issue Pressure Level Scalings only applied in specific circumstances #7)
  • Do we need to change the code pattern to better distinguish between loss scalings we have: ie applied per variables, scalings applied for vertical levels or spatial scalings?
  • Related to the above point, where should the scaling code live? At the moment much of the scaling functionality is having to take place on forecaster.py which could quickly become bloated

There is a PR on stretched grid RMSE ecmwf/anemoi-training#199
and a draft PR on using tendency scale losses ecmwf/anemoi-training#186.

There will be a series of future PRs:

  1. To fix how the variables are scaled in the validation metrics (@HCookie @jswijnands @havardhhaugen) Fix 'all' validation metrics anemoi-training#202
  2. To fix the pressure level scalings (@sahahner; @pinnstorm; @mc4117)

PR's

@JesperDramsch JesperDramsch transferred this issue from ecmwf/anemoi-training Dec 19, 2024
@sahahner sahahner linked a pull request Dec 27, 2024 that will close this issue
1 task
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment