FAQ/Dunnett - CBU statistics Wiki

Revision 14 as of 2012-04-20 12:17:20

Clear message
location: FAQ / Dunnett

Comparing group means to a control group mean

Rutherford (2001, p.90) mentions that comparing two or more conditions which have had the same value differenced from them (e.g. a control group score) induces a correlation of 0.5 between these conditions (see [http://books.google.co.uk/books?id=c5aOZEniMqwC&pg=PA90&lpg=PA90&dq=anova+%26+compare+to+a+control+condition&source=bl&ots=mGGyhHpoIz&sig=BWXM-J-nFNjCbrq5m7novKNo1Z4&hl=en&sa=X&ei=yUGQT9ChC83B8gOR-_GqBA&ved=0CEMQ6AEwBg#v=onepage&q=anova%20%26%20compare%20to%20a%20control%20condition&f=false here.])

This is something which is not assumed in between subjects designs where each group represents different subjects. So for example, subtracting the control score from each group score and performing a one-way ANOVA on the differences (A - Control) and (B - Control), where we have a control group and treatment groups, A and B, ignores this induced correlation.

He suggests instead using Dunnett’s test on an ANOVA involving the group means (e.g. for the Control, A and B groups) possibly as a set of planned comparisons although Dunnett's test is usually done as a post-hoc test following an ANOVA with an overall significant main effect of group to guard against obtaining false positive results. Dunnett's test is also described in Howell (1997). It is also computed for one-way between subjects designs in SPSS. Dunnett uses a modified t statistic, td, as its critical value which is also given in an appendix in Howell’s book.

One computes a t statistic of form

$$\frac{\mbox{treatment group mean – control group mean}}{\sqrt{\frac{2 MSE}{n}}} $$

where MSE is the mean square error term for the main effect of group (assuming there is no interaction) in an anova and n is the number (assumed equal) in each group and compares this to the t statistic, td. A harmonic mean could be used if the group sizes are 'almost' equal (see Howell, 1997)).

The form of the above is a very similar calculation to the Tukey test but using a different critical value.

See also Kirk (1995) who describes th use of Dunnett’s test amongst others.

References

Kirk, R. E. (1995) Experimental Design: Procedures for the Behavioral Sciences. Pacific Grove: Brooks/Cole.

Howell, D. C. (1997) Statistical Methods for Psychologists. Wadsworth,Belmont,CA. Probably in other editions as well.

Rutherford, A. (2001) ANOVA and ANCOVA a GLM approach. Wiley:New York