A two-sample t-test examines if mean test scores differ between students who study in groups versus alone. The study is based on a convenience sample from one university. Even if the test is statistically significant, what is the primary limitation?
- AStatistical significance guarantees the difference is educationally meaningful.
- BThe t-test assumes equal variances, which may not hold.
- CThe two-sample t-test cannot detect mean differences.
- DResults from one university may not generalize.Correct
Why D is right
While statistical significance indicates a real effect in the sample, a convenience sample from one university may not represent all students. Students at one institution differ in many ways from the broader student population. The results may not generalize (lack external validity).
Why the other 3 choices miss
- A
- Statistical significance does not guarantee practical or educational significance. A small but statistically significant difference may not matter in practice — but this choice also doesn't address the primary generalizability concern.
- B
- Welch's two-sample t-test (standard in AP Statistics) does not require equal variances. Equal variance is not a necessary assumption.
- C
- Two-sample t-tests are specifically designed to detect mean differences. This claim is false.