Skip to content
AP Statistics · Exploring One-Variable Data and Collecting Data

Order effects

Order effects appears in 3 reviewed AP Statistics questions and sits in Exploring One-Variable Data and Collecting Data. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

How Order effects is tested

Example 1Harder
A researcher studying the effect of sleep on athletic performance uses a matched pairs design. Each athlete performs a physical test after 6 hours of sleep and then repeats the same test after 8 hours of sleep, with the order randomized. Why is the order of treatments randomized?
  1. ATo allow athletes to improve their performance between tests.
  2. BTo satisfy the independence condition required before running a matched pairs t-test.
  3. CTo ensure that each athlete gets the same number of hours of sleep overall across both tests.
  4. DTo balance practice and carryover effects across the two sleep conditions.Correct

Why D is right

Randomizing the order in a matched pairs (crossover) design controls for carryover effects (e.g., learning the test, muscle fatigue) and order effects (e.g., always having more energy at first). By randomly assigning half the athletes to do 6-hour sleep first and the other half to do 8-hour sleep first, these effects are balanced across the two conditions.
Why the other 3 choices miss
A
Allowing athletes to improve between tests would be a confound, not a goal. Randomizing order helps reveal whether such improvement (practice effect) is influencing results.
B
Independence in the matched pairs t-test refers to the differences being independent, not to the order of treatments. The order randomization serves a different purpose.
C
Total sleep hours are not the concern here. The total sleep would actually vary by design (some get 6 first, some get 8 first). The concern is about systematic advantages of doing one condition before the other.
Example 2Medium
In a paired t-test, why is it important that the order of treatments is randomized when both treatments are applied to the same subjects?
  1. ATo make the standard deviation of the differences equal to zero
  2. BTo reduce the effect of lurking variables and order effects on the differencesCorrect
  3. CTo guarantee the differences are normally distributed
  4. DTo ensure the sample size is large enough

Why B is right

Randomizing the order of treatments helps control for order effects (such as practice, fatigue, or carryover effects) that could confound the results. Without randomization, systematic differences due to order rather than treatment could bias the paired differences.
Why the other 3 choices miss
A
Incorrect because randomization does not reduce variability to zero. It aims to eliminate systematic bias, not eliminate all variability.
C
Incorrect because randomization does not guarantee normality of differences. Normality depends on the population distribution and sample size.
D
Incorrect because randomization does not affect sample size; it affects the internal validity of the comparison.

Studied alongside

Other concepts from Exploring One-Variable Data and Collecting Data.