FAQ/Dunnett - CBU statistics Wiki

Revision 25 as of 2012-04-24 08:51:57

Clear message
location: FAQ / Dunnett

Comparing group means to a control group mean

Rutherford (2001, p.90) mentions that comparing two or more conditions which have had the same value differenced from them (e.g. a control group score) induces a correlation of 0.5 between these conditions (see [http://books.google.co.uk/books?id=c5aOZEniMqwC&pg=PA90&lpg=PA90&dq=anova+%26+compare+to+a+control+condition&source=bl&ots=mGGyhHpoIz&sig=BWXM-J-nFNjCbrq5m7novKNo1Z4&hl=en&sa=X&ei=yUGQT9ChC83B8gOR-_GqBA&ved=0CEMQ6AEwBg#v=onepage&q=anova%20%26%20compare%20to%20a%20control%20condition&f=false here.])

This is something which is not assumed in between subjects designs where each group represents different subjects. So for example, subtracting the control score from each group score and performing a one-way ANOVA on the differences (A - Control) and (B - Control), where we have a control group and treatment groups, A and B, ignores this induced correlation.

He suggests instead using Dunnett’s test on an ANOVA involving the group means (e.g. for the Control, A and B groups) possibly as a set of planned comparisons although Dunnett's test is usually done as a post-hoc test following an ANOVA with an overall significant main effect of group to guard against obtaining false positive results. Dunnett's test is also described in Howell (1997). It is also computed for one-way between subjects designs in SPSS. Dunnett uses a modified t statistic, td, as its critical value which is also given in an appendix in Howell’s book.

One computes a t statistic of form

$$\frac{\mbox{treatment group mean – control group mean}}{\sqrt{\frac{2 MSE}{n}}} $$

where MSE is the mean square error term for the main effect of group (assuming there is no interaction) obtained from the error term in a one-way ANOVA and n is the number (assumed equal) in each group and compares this to the t statistic, td. A harmonic mean could be used if the group sizes are 'almost' equal (see Howell, 1997).

Notice that the form of the above t statistic is a very similar to the Tukey test but it uses a different critical value. Dunnett's test can also be used in repeated measures ANOVA.

See also Kirk (1995) who describes th use of Dunnett’s test amongst others.

R code for evaluating the p-value for Dunnett's observed t is [:FAQ/dr: here]. Alternatively the critical value, td, for a given alpha may also be obtained using R code illustrated [http://rgm2.lab.nig.ac.jp/RGM2/func.php?rd_id=MCPMod:critVal here] and this latter code is reproduced [:FAQ/dunR: here.]

References

Kirk, R. E. (1995) Experimental Design: Procedures for the Behavioral Sciences. Pacific Grove: Brooks/Cole.

Howell, D. C. (1997) Statistical Methods for Psychologists. Wadsworth,Belmont,CA. Probably in other editions as well.

Rutherford, A. (2001) ANOVA and ANCOVA a GLM approach. Wiley:New York