_        __  __ _      
    /\        | |      |  \/  | |     
   /  \  _   _| |_ ___ | \  / | |     
  / /\ \| | | | __/ _ \| |\/| | |     
 / ____ \ |_| | || (_) | |  | | |____ 
/_/    \_\__,_|\__\___/|_|  |_|______|

AutoML: taking the human expert out of the loop


Home HPOlibAutomated Hyperparameter Importance Analysis


We're organizing an AutoML workshop at ICML 2016.

We're organizing an AutoML workshop at ICML 2015.

ChaLearn is organizing an AutoML challenge.

We organized an AutoML workshop at ICML 2014.

Overview: What is AutoML?

Machine learning (ML) has achieved considerable successes in recent years and an ever-growing number of disciplines rely on it. However, this success crucially relies on human machine learning experts to perform the following tasks:

As the complexity of these tasks is often beyond non-experts, the rapid growth of machine learning applications has created a demand for off-the-shelf machine learning methods that can be used easily and without expert knowledge. We call the resulting research area that targets progressive automation of machine learning AutoML.
Although it focuses on end users without expert knowledge, AutoML also offers new tools to machine learning experts, for example to:

Following the paradigm of Programming by Optimization, AutoML advocates the development of flexible software packages that can be instantiated automatically in a data-driven way.

Examples of AutoML

AutoML aims to create software that can be used out-of-the-box by ML novices. Some recent examples showcase what is possible:


AutoML draws on many disciplines of machine learning, prominently including

Hyperparameter optimization systems

Several recent systems for the Bayesian optimization of machine learning hyperparameters facilitate AutoML. These include:

We offer a common interface to these in the hyperparameter optimization library, HPOlib.