SMAC is based on Sequential Model-Based Optimization (SMBO). It adapts the most prominent previously used model class (Gaussian stochastic process models) and introduces the model class of random forests to SMBO in order to handle categorical parameters. The SMAC supported by nni is a wrapper on the SMAC3 github repo.
Note that SMAC on nni only supports a subset of the types in the search space spec: choice
, randint
, uniform
, loguniform
, and quniform
.