Basic statistics for clinicians: 1. Hypothesis testing

G Guyatt, R Jaeschke, N Heddle, D Cook, H Shannon, S Walter, G Guyatt, R Jaeschke, N Heddle, D Cook, H Shannon, S Walter

Abstract

In the first of a series of four articles the authors explain the statistical concepts of hypothesis testing and p values. In many clinical trials investigators test a null hypothesis that there is no difference between a new treatment and a placebo or between two treatments. The result of a single experiment will almost always show some difference between the experimental and the control groups. Is the difference due to chance, or is it large enough to reject the null hypothesis and conclude that there is a true difference in treatment effects? Statistical tests yield a p value: the probability that the experiment would show a difference as great or greater than that observed if the null hypothesis were true. By convention, p values of less than 0.05 are considered statistically significant, and investigators conclude that there is a real difference. However, the smaller the sample size, the greater the chance of erroneously concluding that the experimental treatment does not differ from the control--in statistical terms, the power of the test may be inadequate. Tests of several outcomes from one set of data may lead to an erroneous conclusion that an outcome is significant if the joint probability of the outcomes is not taken into account. Hypothesis testing has limitations, which will be discussed in the next article in the series.

References

1. 1. Biometrics. 1987 Sep;43(3):487-98
2. 1. Br Med J (Clin Res Ed). 1988 Apr 30;296(6631):1210-1
3. 1. J Clin Epidemiol. 1991;44(8):839-49
4. 1. N Engl J Med. 1991 Aug 1;325(5):303-10
5. 1. Mayo Clin Proc. 1988 Aug;63(8):813-5
6. 1. JAMA. 1992 Nov 4;268(17):2420-5
7. 1. JAMA. 1993 Nov 3;270(17):2093-5
8. 1. JAMA. 1993 Nov 3;270(17):2096-7
9. 1. N Engl J Med. 1987 Aug 13;317(7):426-32
10. 1. Lancet. 1981 Dec 19-26;2(8260-61):1399-402
11. 1. Br Med J (Clin Res Ed). 1983 May 7;286(6376):1489-93
12. 1. N Engl J Med. 1983 Sep 22;309(12):709-13
13. 1. Arch Intern Med. 1985 Apr;145(4):709-12
14. 1. N Engl J Med. 1985 Sep 26;313(13):793-9
15. 1. Br J Hosp Med. 1987 Apr;37(4):356-7

Source: PubMed