Authors
Geoffrey Hinton, Oriol Vinyals, Jeff Dean
Publication date
2015/3/9
Journal
arXiv preprint arXiv:1503.02531
Description
Abstract: A very simple way to improve the performance of almost any machine learning
algorithm is to train many different models on the same data and then to average their
predictions. Unfortunately, making predictions using a whole ensemble of models is
cumbersome and may be too computationally expensive to allow deployment to a large
number of users, especially if the individual models are large neural nets. Caruana and his
collaborators have shown that it is possible to compress the knowledge in an ensemble ...
algorithm is to train many different models on the same data and then to average their
predictions. Unfortunately, making predictions using a whole ensemble of models is
cumbersome and may be too computationally expensive to allow deployment to a large
number of users, especially if the individual models are large neural nets. Caruana and his
collaborators have shown that it is possible to compress the knowledge in an ensemble ...
Total citations
Scholar articles
G Hinton, O Vinyals, J Dean - arXiv preprint arXiv:1503.02531, 2015
Dates and citation counts are estimated and are determined automatically by a computer program.