Skip to content
AP Statistics · Inference for Quantitative Data: Means

Hypothesis testing

Hypothesis testing appears in 51 reviewed AP Statistics questions and sits in Inference for Quantitative Data: Means. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Hypothesis testing is tested

Example 1Easier
In a study examining whether a new fertilizer increases crop yield, the null hypothesis is H0: the new fertilizer has no effect on yield. A Type I error in this context would be:
  1. AUsing too small a sample size to detect a real effect.
  2. BApplying the fertilizer to the wrong type of crop.
  3. CConcluding the fertilizer has no effect when it actually does.
  4. DConcluding the fertilizer increases yield when it actually has no effect.Correct

Why D is right

A Type I error (false positive) is rejecting the null hypothesis when it is actually true. Here, the null hypothesis is that the fertilizer has no effect. A Type I error means concluding that the fertilizer works (rejecting H0) when in reality it has no effect on yield.
Why the other 3 choices miss
A
Using too small a sample size to detect a real effect relates to low statistical power, which increases the probability of a Type II error, not a Type I error.
B
Applying the fertilizer to the wrong crop is an experimental design error, not a Type I error in hypothesis testing.
C
Concluding the fertilizer has no effect when it actually does is a Type II error (false negative) — failing to reject H0 when H0 is false.
Example 2Easier
A Type II error in a hypothesis test is described as:
  1. AFailing to reject the null hypothesis when it is false.Correct
  2. BCollecting insufficient data to conduct a valid test.
  3. CUsing too small a significance level (alpha).
  4. DRejecting the null hypothesis when it is true.

Why A is right

A Type II error (also called a false negative) occurs when the null hypothesis is actually false (there is a real effect) but the test fails to detect it and does not reject H0. The probability of a Type II error is denoted beta (β), and statistical power = 1 - β.
Why the other 3 choices miss
B
Insufficient data is a practical issue that may increase the probability of a Type II error (by reducing power), but it is not the definition of a Type II error.
C
Using too small an alpha level (e.g., 0.001 instead of 0.05) makes it harder to reject H0, increasing the probability of a Type II error, but the alpha level itself is not the definition of a Type II error.
D
Rejecting a true null hypothesis is a Type I error (false positive), not a Type II error. These are the two types of errors, and they are distinct.
Example 3Medium
A significance level of α = 0.05 in hypothesis testing means:
  1. AThe probability the null hypothesis is true is 5%.
  2. BThere is a 5% chance of rejecting a null hypothesis that is true.Correct
  3. COnly 5% of experiments conducted at this level will produce correct results.
  4. DThe study has a 95% probability of detecting a real effect if one exists.

Why B is right

The significance level α is the probability of committing a Type I error — rejecting the null hypothesis when it is actually true. Setting α = 0.05 means the researcher accepts a 5% chance of a false positive (incorrectly concluding there is an effect when there is none).
Why the other 3 choices miss
A
The significance level is not a statement about the probability that H0 is true. That would require prior probabilities and Bayesian reasoning. Alpha is the long-run false positive rate under the frequentist framework.
C
The significance level has nothing to do with the proportion of experiments producing correct results. It specifically controls the false positive rate.
D
The probability of detecting a real effect is statistical power (1 - β), not α. Power depends on α, the effect size, and the sample size, but α alone does not determine power.

Studied alongside

Other concepts from Inference for Quantitative Data: Means.