Skip to content
AP Statistics · Regression Analysis

Model limitations

Model limitations appears in 5 reviewed AP Statistics questions and sits in Regression Analysis. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Model limitations is tested

Example 1Medium
A model predicts weekly sales (y, in hundreds) from advertising spending (x, in thousands of dollars). The regression equation is y-hat = 5 + 2.3x, and r^2 = 0.81. A marketing manager uses this equation to predict sales for an advertising budget of $50,000 (x = 50). The data used to build the model had advertising budgets ranging from $2,000 to $15,000. This prediction is problematic because
  1. Aadvertising spending cannot be used as an explanatory variable
  2. Bthe model should use log-transformed data
  3. Cthe prediction involves extrapolation far beyond the range of the observed dataCorrect
  4. Dthe r^2 is not high enough for prediction

Why C is right

The model was built using advertising budgets from $2,000 to $15,000 (x = 2 to x = 15 in thousands). Predicting for x = 50 ($50,000) is extreme extrapolation. The linear relationship between advertising and sales may not hold at much higher spending levels — returns on advertising often diminish. The model's predictions outside its data range are unreliable.
Why the other 3 choices miss
A
Incorrect. Advertising spending is a perfectly reasonable explanatory variable for sales. The issue is predicting at a value far outside the range of the data used to build the model.
B
Incorrect. There is no indication that a log transformation is needed. The issue is extrapolation, not model specification.
D
Incorrect. r^2 = 0.81 indicates a strong linear relationship within the observed data range. The problem is not model quality but the prediction being outside the data range.
Example 2Harder
A regression analysis of the relationship between hours of exercise per week (x) and resting heart rate (y) includes data from adults aged 20-60. The regression equation is y-hat = 80 - 1.5x. A personal trainer uses this equation to predict the resting heart rate of a 75-year-old who exercises 3 hours per week. Which concern is most relevant?
  1. AThe r^2 value must be very low for a model with a negative slope
  2. BThe prediction is unreliable because the 75-year-old is outside the population used to develop the model, and age may modify the exercise-heart rate relationshipCorrect
  3. CThe y-intercept of 80 is unrealistically high
  4. DThe model underestimates the heart rate because the slope is negative

Why B is right

The model was developed using adults aged 20-60. Applying it to a 75-year-old involves extrapolating to a population not represented in the data. Age is likely a lurking variable that modifies the exercise-heart rate relationship (older adults may respond differently to exercise). The prediction may be unreliable because the model's assumptions may not hold for elderly individuals.
Why the other 3 choices miss
A
Incorrect. A negative slope does not imply a low r^2. Strong negative linear relationships can have high r^2 values.
C
Incorrect. A resting heart rate of 80 bpm for someone who exercises 0 hours per week is a reasonable baseline value. The y-intercept is not problematic.
D
Incorrect. A negative slope is expected (more exercise is associated with lower resting heart rate). The sign of the slope is not the concern; the concern is applying the model outside its intended population.

Studied alongside

Other concepts from Regression Analysis.