search_space
The search_space config group determines the hyperparameter search space during a --multirun. See Hyperparameter optimization
for a general introduction and hpo for more config options on how to use this. The syntax of defining the search
space is also documented by hydra.
By default (search_space=none) no search space is defined. An example configuration is given below.
example
- sampling.batch_size
- default: choice(32, 64, 128)
searches these three variants of a batch size (adapting the “sampling.batch_size” config)
- optimizer.lr
- default: interval(0.0001, 0.2)
searches the given interval for a learning rate (adapting the “optimizer.lr” config)