Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Aimodel] Enable ppss control for weight_recent, balance_classes, calibrate_probs #729

Closed
trentmc opened this issue Mar 2, 2024 · 0 comments · Fixed by #730
Closed

[Aimodel] Enable ppss control for weight_recent, balance_classes, calibrate_probs #729

trentmc opened this issue Mar 2, 2024 · 0 comments · Fixed by #730
Assignees
Labels
Type: Enhancement New feature or request

Comments

@trentmc
Copy link
Member

trentmc commented Mar 2, 2024

We recently updated Aimodel.py where it would

  1. reweight the most recent sample by 10x, and second-most-recent by 5x
  2. always balance classes
  3. always calibrate probabilities

But it's not clear which helps, or not. We need to be able to test these better without hacking things on and off.

Ideally we can also add new techniques to solve a given problem.

How: add control for (1)(2)(3) to ppss.yaml, specifically ai_model_ss.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: Enhancement New feature or request
Projects
None yet
1 participant