MATLAB Answers


How does predict with ensemble regression works?

Asked by Tania
on 13 Aug 2014
Latest activity Commented on by Machine Learning on 10 Feb 2015
This might be a silly question...iam using bagging with regression trees. I built for instance 10 different trees, then I average them. when I then use predict to predict my y value, how does it work? does it somehow average the fitted y values?!
thanks for your help!!


Sign in to comment.

1 Answer

Answer by Shashank Prasanna on 13 Aug 2014
Edited by Shashank Prasanna on 13 Aug 2014
 Accepted Answer

For classification the output of the ensemble is the class that gets majority vote from all the learners. For regression the results are averaged.


So for instance, if i have 10 observations and I built 5 different trees. i take all their predicted y values of the different trees and average them,yes?
Short answer is yes.
However if you want a more accurate y you have to look into boosting.

Sign in to comment.