Impact of subsampling and pruning on random forests - Université Paris Cité Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2016

Impact of subsampling and pruning on random forests

Résumé

Random forests are ensemble learning methods introduced by Breiman (2001) that operate by averaging several decision trees built on a randomly selected subspace of the data set. Despite their widespread use in practice, the respective roles of the different mechanisms at work in Breiman's forests are not yet fully understood, neither is the tuning of the corresponding parameters. In this paper, we study the influence of two parameters , namely the subsampling rate and the tree depth, on Breiman's forests performance. More precisely, we show that fully developed sub-sampled forests and pruned (without subsampling) forests have similar performances, as long as respective parameters are well chosen. Moreover, experiments show that a proper tuning of subsampling or pruning lead in most cases to an improvement of Breiman's original forests errors.

Dates et versions

hal-01287521 , version 1 (14-03-2016)
hal-01287521 , version 2 (24-11-2017)
hal-01287521 , version 3 (07-05-2019)

Identifiants

Citer

Roxane Duroux, Erwan Scornet. Impact of subsampling and pruning on random forests. 2016. ⟨hal-01287521v2⟩
255 Consultations
908 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More