PyTorch + Optuna!
Optuna is a hyperparameter optimization framework applicable to machine learning frameworks and black-box optimization solvers. PyTorch is an open source machine learning framework use by may deep learning programmers and researchers. Let’s see how they can work together!
Creating the Objective Function
Defining the hyperparameters to be tuned
Running the Trials
Pruning — Early Stopping of Poor Trials
To the Future, and Beyond!