Skip to content
AP Statistics · Exploring One-Variable Data and Collecting Data

Generalizability

Generalizability appears in 19 reviewed AP Statistics questions and sits in Exploring One-Variable Data and Collecting Data. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Generalizability is tested

Example 1Medium
A clinical trial for a weight loss drug includes only men aged 30-50 from one hospital. The results show the drug is effective. A doctor at another hospital wants to prescribe it to a 65-year-old woman. Why should the doctor be cautious?
  1. AThe trial's narrow inclusion criteria (men aged 30-50) limit generalizability; the drug's effectiveness and safety may differ for women and older patientsCorrect
  2. BThe drug was only tested at one dosage level
  3. CThe clinical trial was not double-blind
  4. DClinical trials always produce unreliable results

Why A is right

The trial studied a specific subpopulation (men aged 30-50 from one hospital). The drug's effects may differ by sex, age, and other factors not represented in the trial. Prescribing to a 65-year-old woman extends beyond the trial's scope of inference, so caution is warranted.
Why the other 3 choices miss
B
Incorrect because the number of dosage levels is not mentioned and is not the primary concern; the issue is the limited study population.
C
Incorrect because the blinding status of the trial is not mentioned and is not the primary reason for caution in this context.
D
Incorrect because clinical trials are the gold standard for evaluating medical treatments; the concern here is generalizability, not reliability.
Example 2Medium
A two-sample t-test examines if mean test scores differ between students who study in groups versus alone. The study is based on a convenience sample from one university. Even if the test is statistically significant, what is the primary limitation?
  1. AStatistical significance guarantees the difference is educationally meaningful.
  2. BThe t-test assumes equal variances, which may not hold.
  3. CThe two-sample t-test cannot detect mean differences.
  4. DResults from one university may not generalize.Correct

Why D is right

While statistical significance indicates a real effect in the sample, a convenience sample from one university may not represent all students. Students at one institution differ in many ways from the broader student population. The results may not generalize (lack external validity).
Why the other 3 choices miss
A
Statistical significance does not guarantee practical or educational significance. A small but statistically significant difference may not matter in practice — but this choice also doesn't address the primary generalizability concern.
B
Welch's two-sample t-test (standard in AP Statistics) does not require equal variances. Equal variance is not a necessary assumption.
C
Two-sample t-tests are specifically designed to detect mean differences. This claim is false.

Studied alongside

Other concepts from Exploring One-Variable Data and Collecting Data.