Diff for "FAQ/onesp" - CBU statistics Wiki
location: Diff for "FAQ/onesp"
Differences between revisions 8 and 9
Revision 8 as of 2013-03-08 10:17:24
Size: 2341
Editor: localhost
Comment: converted to 1.6 markup
Revision 9 as of 2014-07-21 12:05:31
Size: 2342
Editor: PeterWatson
Comment:
Deletions are marked like this. Additions are marked like this.
Line 18: Line 18:
Suppose we wish to test that sensitivity is at least 90%. We are ''not''interested'' in sensitivities greater than 90% since our interest is in detecting unacceptable values of sensitivity which will be ''lower'' than 90%. In this case, therefore, we would carry out a one-tailed test (using, for example, a one-sample binomial test). In testing our new quicker tool we are only interested in testing if it is less effective than our existing diagnostic tool. In this scenario, a one-tailed test would be appropriate. Suppose we wish to test that sensitivity is at least 90%. We are ''not'' interested'' in sensitivities greater than 90% since our interest is in detecting unacceptable values of sensitivity which will be ''lower'' than 90%. In this case, therefore, we would carry out a one-tailed test (using, for example, a one-sample binomial test). In testing our new quicker tool we are only interested in testing if it is less effective than our existing diagnostic tool. In this scenario, a one-tailed test would be appropriate.

When and how do I evaluate a one-sided test

Steve Simon has written a very good article (see here) explaining how to evaluate one and two-sided p-values. if this link is broken the wording is reproduced here.

One-tailed tests provide more power to detect an effect, so it may be tempting to use a one-tailed test whenever you have a hypothesis about the direction of an effect. Before doing so, consider the consequences of missing an effect in the other direction. Imagine you have developed a new drug that you believe is an improvement over an existing drug. You wish to maximize your ability to detect the improvement, so you opt for a one-tailed test. In doing so, you fail to test for the possibility that the new drug is less effective than the existing drug. The consequences in this example are extreme, but they illustrate a danger of inappropriate use of a one-tailed test.

Another example where you would use a one-tailed test is for testing the discriminability of two sets of tests for diagnosing dementia. You could produce a 2x2 table of

For example

Dementia_1

Normal_1

Dementia_2

a

b

Normal_2

c

d

where _1 represents a gold standard reference test of dementia and _2 our own new quicker and simpler dementia diagnosis test. The tool is simpler and less time consuming to use that the standard diagnostic tool so would be advantageous to use clinically both for patients and clinicians.

We can assess the proportions sensitivity (a/(a+c)) and specificity (d/(b+d)) to ensure our new test ddoes a good job of identifying dementia cases whilst not giving too many false positive results.

Suppose we wish to test that sensitivity is at least 90%. We are not interested in sensitivities greater than 90% since our interest is in detecting unacceptable values of sensitivity which will be lower than 90%. In this case, therefore, we would carry out a one-tailed test (using, for example, a one-sample binomial test). In testing our new quicker tool we are only interested in testing if it is less effective than our existing diagnostic tool. In this scenario, a one-tailed test would be appropriate.

None: FAQ/onesp (last edited 2017-06-22 11:10:01 by PeterWatson)