A researcher tests whether a new memory training app improves performance on a word-recall task. She assigns participants to either the training group or a no-treatment group based on when they sign up (first 30 get training, next 30 get no treatment). Which flaw is MOST problematic for this study's internal validity?
- AThe study lacks ecological validity because word-recall tasks do not reflect real-world memory demands
- BThe study has low external validity because its sample of volunteers is not representative of the general adult population
- CThe dependent variable (word recall) is not operationalized because the number of recalled words is subjective
- DThe lack of random assignment means the groups may differ systematically (e.g., early sign-ups may be more motivated)Correct
Why D is right
Internal validity — the confidence that the IV (training) caused changes in the DV (word recall) — requires that groups be equivalent at the start. Without random assignment, systematic differences between groups (e.g., early sign-ups may be more motivated or tech-savvy) become confounds that can explain any observed differences, independent of the training app.
Why the other 3 choices miss
- A
- Incorrect because ecological validity refers to generalizability to real-world settings; the question asks about internal validity, which concerns whether the IV caused the DV, not whether the task mirrors real-world conditions.
- B
- Incorrect because external validity (generalizability) is a concern, but the question specifies internal validity; the most immediate problem is the non-random assignment creating pre-existing group differences.
- C
- Incorrect because counting the number of correctly recalled words is an objective, well-operationalized measure; it is not subjective.