Diff for "FAQ/wavelength_eg" - CBU statistics Wiki
location: Diff for "FAQ/wavelength_eg"
Differences between revisions 9 and 10
Revision 9 as of 2011-06-09 09:38:49
Size: 2009
Editor: PeterWatson
Comment:
Revision 10 as of 2013-03-08 10:17:09
Size: 2013
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 5: Line 5:
For two groups where the mean of A > mean of B it is a plot of sensitivity at each of T thresholds (Probability of being in group A given you have a value less than or equal to t) against 1 - specificity (probability of being in group B given you have a value less than or equal to t) as seen [attachment:rocplot.jpg here]. For two groups where the mean of A > mean of B it is a plot of sensitivity at each of T thresholds (Probability of being in group A given you have a value less than or equal to t) against 1 - specificity (probability of being in group B given you have a value less than or equal to t) as seen [[attachment:rocplot.jpg|here]].
Line 16: Line 16:
These probabilities are evaluated at each observed score, t and plotted with sensitivity on the y-axis and 1-specificity on the x-axis. The points may be joined together to form a curve and the area under the curve evaluated using, for example, the trapezium rule. The area under the ROC curve may be computed on the raw data [:FAQ/roc: using the LOGISTIC REGRESSION procedure in SPSS] or a [:FAQ/rocplot: SPSS macro.]  These probabilities are evaluated at each observed score, t and plotted with sensitivity on the y-axis and 1-specificity on the x-axis. The points may be joined together to form a curve and the area under the curve evaluated using, for example, the trapezium rule. The area under the ROC curve may be computed on the raw data [[FAQ/roc| using the LOGISTIC REGRESSION procedure in SPSS]] or a [[FAQ/rocplot| SPSS macro.]]

Working out 2 group signal detection diagnostics

The area under Receiver Operating Characteristic (ROC) curves is a way of describing the magnitude of how well separated two groups are with respect to some diagnostic.

For two groups where the mean of A > mean of B it is a plot of sensitivity at each of T thresholds (Probability of being in group A given you have a value less than or equal to t) against 1 - specificity (probability of being in group B given you have a value less than or equal to t) as seen here.

The sensitivity is the blue horizontal area and 1-specificity is the diagonal orange area evaluated at a score of 1. These can also be evaulated using frequencies. You can see that as sensitivity increases so does 1-specificity (with the threshold increasing ie line moving to the right). When the line is at the far left both sensitivity and 1-specificity are zero and when the line is on the far right they are both equal to unity.

True

A

B

Score

<= t

a

b

> t

c

d

In the above table the sensitivity is the proportion of observations in group A which have values less than or equal to t and 1-specificty is the proportion of observations in group B which have a value less than or equal to a particular score t.

These probabilities are evaluated at each observed score, t and plotted with sensitivity on the y-axis and 1-specificity on the x-axis. The points may be joined together to form a curve and the area under the curve evaluated using, for example, the trapezium rule. The area under the ROC curve may be computed on the raw data using the LOGISTIC REGRESSION procedure in SPSS or a SPSS macro.

None: FAQ/wavelength_eg (last edited 2014-03-31 11:50:25 by PeterWatson)