Committees

Preliminaries Basic machine learning concepts Probability Theory concepts expectation correlated random variable Analysis of Committees1 The committee is a native inspiration for how to combine several models(or we can say how to combine the outputs of several models). For example, we can combine all the models by:
[ y_{COM}(X)=frac{1}{M}sum_{m=1}^My_m(X)tag{1} ]
Then we want to find out whether this average prediction of models is better than every one of them.