You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It would be good to enforce that each synthesizer the user passes in is unique. Eg. the following would NOT be allowed:
importsdgym# This should not be allowedsdgym.benchmark_single_table(
synthesizers=['GaussianCopulaSynthesizer', 'GaussianCopulaSynthesizer'],
custom_synthesizers=[MyCustomSynthesizerClass, MyCustomSynthesizerClass]
)
Rationale: The benchmarking framework is designed to work on unique (synthesizer, dataset) pairs. If users want to do multiple iterations, then they can run the script more times.
Expected behavior
Before executing anything else, check to see if the synthesizers are unique. If they are not, throw an error.
Version: 0.8.0 (in development)
Problem Description
Currently, the user can provide synthesizers to
benchmark_single_table
via thesynthesizers
or thecustom_synthesizers
parameters.It would be good to enforce that each synthesizer the user passes in is unique. Eg. the following would NOT be allowed:
Rationale: The benchmarking framework is designed to work on unique
(synthesizer, dataset)
pairs. If users want to do multiple iterations, then they can run the script more times.Expected behavior
Before executing anything else, check to see if the synthesizers are unique. If they are not, throw an error.
The text was updated successfully, but these errors were encountered: