FAQ/pearson - CBU statistics Wiki

Revision 10 as of 2010-09-01 15:05:15

Clear message
location: FAQ / pearson

The relationship between the Pearson zero-order correlation and a simple regression coefficient

The Pearson correlation equals the beta coefficient in SPSS which is the regression estimate from using one standardized predictor to predict a standardized outcome (see for example Cohen and Cohen (1983), pp 41-44 and the regression talk given as part of the [:StatsCourse2009:Graduate Statistics Programme October-December 2009]). In addition, the t-test in the regression for the unstandardized coefficient, B, is equivalent to testing if a zero-order correlation equals zero. The regression model is assumed to contain the intercept as well as the predictor.

The following syntax for regression and correlations in SPSS give equivalent tests of whether a Pearson correlation between two continuous variables, x and y, is zero.

REGRESSION
  /MISSING LISTWISE
  /STATISTICS COEFF OUTS R ANOVA
  /CRITERIA=PIN(.05) POUT(.10)
  /NOORIGIN
  /DEPENDENT y
  /METHOD=ENTER x  .

CORRELATIONS
  /VARIABLES=y x
  /PRINT=TWOTAIL NOSIG
  /MISSING=PAIRWISE .

Howell (2005) and Cohen and Cohen (1983) also show how two regression coefficients from two independent groups obtained from a simple regression of x on y may be compared using a t-test. Ng and Wilcox (2010) suggest two tests of the difference in independent group simple regression coefficients which are more robust (having better accuracy of type I error) to the usual t-test when the groups have different variances or are non-normal. R code to fit these two models is in two functions, called regci and olswbtest. These functions may be downloaded by simply typing at a R prompt the one line:

source('http://www-rcf.usc.edu/~rwilcox/Rallfun-v12')

Note the 'v12' may change as versions are updated. If there is an error using the above line go to Rand Wilcox's [http://www-rcf.usc.edu/~rwilcox/ website] to see if the version number has changed.

Details of using these function are given in the appendix to Ng and Wilcox (2010).

References

Cohen J, & Cohen P (1983). Applied multiple regression/correlation analysis for the behavioral sciences (2nd edition). Hillsdale, NJ: Erlbaum.

Howell DC (2005). Statistical methoids for psychology. Fifth edition. Wadsworth:London. Details of comparing regression coefficients are also in earlier versions of this book available in the CBSU library.

Ng M and Wilcox RR (2010). Comparing the regression slopes of independent groups. British Journal of Mathematical and Statistical Psychology 63 319-340.