Oríon: Experiment Version Control for Efficient Hyperparameter Optimization

Christos Tsirigotis, Xavier Bouthillier, François Corneau-Tremblay, Peter Henderson, Reyhane Askari, Samuel Lavoie-Marchildon, Tristan Deleu, Dendi Suhubdy, Michael Noukhovitch, Frédéric Bastien and others
AutoML Workshop at the International Conference on Machine Learning, 2018

PDF Code

We present Oríon, a new black-box optimization tool currently in development that is designed to adapt to the workflow of machine learning researchers for minimal obstruction. We propose a new version control system for experiments, which can significantly improve the organization of research projects in machine learning as well as the efficiency of hyperparameter optimization. The entire tool is built with the goals of promoting reproducibility, fair benchmarking of different machine learning models, and providing a platform for the research of black-box optimization algorithms.

BibTeX:

@inproceedings{tsirigotis2018orion,
    author = {Tsirigotis, Christos and Bouthillier, Xavier and Corneau-Tremblay, Fran{\c{c}}ois and Henderson, Peter and Askari, Reyhane and Lavoie-Marchildon, Samuel and Deleu, Tristan and Suhubdy, Dendi and Noukhovitch, Michael and Bastien, Fr{\'e}d{\'e}ric and others},
    booktitle = {AutoML Workshop at the International Conference on Machine Learning},
    month = {july},
    title = {Or{\'\i}on: Experiment Version Control for Efficient Hyperparameter Optimization},
    url = {https://openreview.net/forum?id=r1xkNLPixX},
    year = {2018}
}