You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Current scatter_dataset creates sub datasets of strictly equal lengths by duplicating some examples when necessary. This is for epoch triggers to work correctly.
However, it is generally unnecessary for validator datasets, and sometimes we want to switch off this behavior, i.e., sometimes we don't want to duplicate some examples.
Therefore, I propose to add force_equal_length flag to scatter_dataset, with the default value of True (to keep the current default behavior).
The text was updated successfully, but these errors were encountered:
Current
scatter_dataset
creates sub datasets of strictly equal lengths by duplicating some examples when necessary. This is for epoch triggers to work correctly.However, it is generally unnecessary for validator datasets, and sometimes we want to switch off this behavior, i.e., sometimes we don't want to duplicate some examples.
Therefore, I propose to add
force_equal_length
flag toscatter_dataset
, with the default value ofTrue
(to keep the current default behavior).The text was updated successfully, but these errors were encountered: