82014-09-29 13:27:04PeterWatson72014-09-29 13:26:37PeterWatson62014-09-29 13:24:54PeterWatson52013-03-08 10:17:19localhostconverted to 1.6 markup42008-05-28 08:45:25PeterWatson32008-05-27 15:52:46PeterWatson22008-05-27 15:52:12PeterWatson12008-05-27 15:51:54PeterWatson

The $$R^text{2}$$ statistic which summarises a multiple regression has a drawback that it never decreases with the addition of subsequent predictors. An adjusted form of R-squared can decrease with the addition of a subsequently uninformative predictor. This aids model selection by penalising overly parametrised models. For a sample size of n, with p predictors, Adjusted $$R2 $$ = 1 - [ (1 - $$R2 $$) (n-1)/(n-p-1) ] The adjusted $$R2 $$ may take negative values. In such a case the adjusted $$R2 $$ is given the value of zero. Example A sample of size 10 has a $$R2 $$ of 0.623 . A predictor, probability, is added which increases the $$R2 $$ to 0.635. The adjusted $$R2 $$ are 0.576 and 0.531 for the one and two predictor models which, by convention, we equate to zero. Taken together the two predictors do not explain much variance in the outcome. The addition of the second predictor, probability, actually reduces the value of the adjusted R-squared. Reference Cohen, J. & Cohen P. (1983) Applied multiple regression/correlation analysis for the behavioral sciences. lawrence Erlbaum, Hillsdale, NJ.