For each record, the predictions from all available models are then averaged for the final prediction. For a classification problem, a majority vote of the models is used. Bagging is short for “bootstrap aggregating.”
Week #7 – Bagging
In predictive modeling, bagging is an ensemble method that uses bootstrap replicates of the original training data to fit predictive models.