A school district examines reading scores across 10 elementary schools. For each school, the percentage of students receiving free lunch and the mean reading score are recorded. The regression yields r-squared = 0.78. A district official states: "This proves that free lunch programs lower reading scores." Which of the following is the most valid criticism?
- ATen schools is always too few observations to perform regression
- BReading scores should be measured using the median, not the mean
- CThe r-squared value is not high enough to support any conclusion
- DThe analysis uses aggregated school-level data rather than individual student data, and the correlation between aggregated variables can overstate the individual-level relationshipCorrect
Why D is right
This is an example of the ecological fallacy — drawing conclusions about individuals from aggregated (group-level) data. Correlations using group averages tend to be higher than correlations at the individual level. Additionally, the free lunch percentage is a proxy for socioeconomic status, and causal language is inappropriate for an observational study.
Why the other 3 choices miss
- A
- Incorrect because while 10 observations is small, regression can be performed with as few as 3 observations; the critical issues are the ecological fallacy and the causal claim.
- B
- Incorrect because the choice between mean and median is a secondary concern; the primary issue is the ecological fallacy and the inappropriate causal inference.
- C
- Incorrect because r-squared = 0.78 is actually quite high; the problem is the level of analysis and the causal claim, not the strength of the correlation.