You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Current, the summary metrics from the sdgym summary command are % coverage, avg time, avg score. We can update them to be more informative about the synthesizers' comparative performance and accuracy.
Expected behavior
Performance (time) metrics: One idea is to use a leaderboard approach. We can display how many times a given synthesizer had the best relative modeling time.
Quality metrics: TBD
The text was updated successfully, but these errors were encountered:
Problem Description
Current, the summary metrics from the
sdgym summary
command are% coverage, avg time, avg score
. We can update them to be more informative about the synthesizers' comparative performance and accuracy.Expected behavior
Performance (time) metrics: One idea is to use a leaderboard approach. We can display how many times a given synthesizer had the best relative modeling time.
Quality metrics: TBD
The text was updated successfully, but these errors were encountered: