Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Hyperopt] Allow default shared parameter search spaces #2171

Closed
arnavgarg1 opened this issue Jun 21, 2022 · 0 comments · Fixed by #2133
Closed

[Hyperopt] Allow default shared parameter search spaces #2171

arnavgarg1 opened this issue Jun 21, 2022 · 0 comments · Fixed by #2133
Assignees
Labels
feature New feature or request

Comments

@arnavgarg1
Copy link
Contributor

It would be helpful to enable using a new defaults keyword within hyperopt to set default parameters for feature groups. This will help add search spaces more concisely for datasets with a large number of features while also reducing the search space to allow for a deeper search during hyperopt.

For e.g., a user should be able to add

"defaults.input_features.text.cell_type": {"space": "choice", "categories": ["lstm", "gru"]}

in their hyperopt search space so that all text input features use the sampled cell_type for that particular trial.

The API for this change will be as follows: defaults.<feature_group>.<feature_type>.<parameter>, where:

  • feature_group: either input_features or output_features to distinguish which features to apply this to
  • feature_type: the feature type in question, for e.g., text/category/sequence etc.
  • parameter: the parameter that one wants to search over for that particular feature type, for e.g., vocab_size for text

Example Configuration:

hyperopt:
    goal: minimize
    parameters:
        trainer.learning_rate:
            lower: 0.0001
            upper: 0.01
            space: loguniform
        defaults.input_features.text.cell_type:
            space: choice
            categories: ["lstm", "rnn", "gru"]
        defaults.output_features.category.vocab_size:
            space: randint
            lower: 4
            upper: 8
        ....
    ....
@arnavgarg1 arnavgarg1 added the feature New feature or request label Jun 21, 2022
@arnavgarg1 arnavgarg1 self-assigned this Jun 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant