This macro is from David Nicholls, Senior Support Statistician at SPSS. [COPY AND PASTE SYNTAX '''IN THE BOX''' BELOW INTO A SPSS SYNTAX WINDOW] then below the patsed syntax type MKAPPASC VARS=varlist. where varlist is the list of variables containing the ratings for each rater. So. for example, MKAPPASC VARS=r1 r2 r3. evaluates the kappa for the three raters whose ratings per case are contained in columns called r1 r2 r3. {{{ *************************************** * MACRO NAME: MKAPPASC.SPS * * * README FILE:MKAPPASC.RM * * * SPSS REQUIREMENTS:Release 4.0 or above * * Advanced Statistics Module * * AUTHOR: David Nichols [mailto:nichols@spss.com] * * LAST UPDATED: 04/08/97 * ************************************** preserve. set printback=off mprint=off. save outfile='ka_tmp1.sav'. define mkappasc (vars=!charend('/')). set mxloops=1000. count ms_=!vars (missing). select if ms_=0. matrix. get x /var=!vars. compute c=mmax(x). compute y=make(nrow(x),c,0). loop i=1 to nrow(x). loop j=1 to ncol(x). loop k=1 to c. do if x(i,j)=k. compute y(i,k)=y(i,k)+1. end if. end loop. end loop. end loop. compute pe=msum((csum(y)/msum(y))&**2). compute k=ncol(x). compute pa=mssq(y)/(nrow(y)*k*(k-1))-(1/(k-1)). compute kstat=(pa-pe)/(1-pe). compute num=2*(pe-(2*k-3)*(pe**2)+2*(k-2)*msum((csum(y)/msum(y))&**3)). compute den=nrow(y)*k*(k-1)*((1-pe)**2). compute ase=sqrt(num/den). compute z=kstat/ase. compute sig=1-chicdf(z**2,1). save {kstat,ase,z,sig} /outfile='ka_tmp2.sav' /variables=kstat,ase,z,sig. end matrix. get file='ka_tmp2.sav'. formats all (f11.8). variable labels kstat 'Kappa' /ase 'ASE' /z 'Z-Value' /sig 'P-Value'. report format=list automatic align(center) /variables=kstat ase z sig /title "Estimated Kappa, Asymptotic Standard Error," "and Test of Null Hypothesis of 0 Population Value". get file='ka_tmp1.sav'. !enddefine. }}} * The macro first saves your working data file to a file named ka_tmp1.sav. The macro creates two new files, ka_tmp1.sav and ka_tmp2.sav, which contain respectively your original data, and a file used to store the values printed in the reported output. '''MAKE SURE YOU HAVE NO EXISTING FILES CALLED KA_TMP1.SAV OR KA_TMP2.SAV AS THESE WILL BE OVERWRITTEN.''' * Multiple invocations of the macro in the same interactive session will produce the following note: >The macro name specified on the DEFINE command duplicates the name of a previously defined macro. This instance will take precedence. This warning does not indicate a problem and may be ignored.