A researcher hypothesizes that people conform to a unanimous group's incorrect judgment more when they must answer aloud in front of the group than when they answer privately in writing. In a study of 20 participants, the public-response group conformed slightly more often than the private-response group, but the difference was not statistically significant (p = .12). A student concludes that the study proves response privacy has no effect on conformity. Why is the student's conclusion incorrect?
- AFailing to reject the null hypothesis does not prove it true; a sample this small may lack the power to detect a real effectCorrect
- BA p-value of .12 means there is an 88 percent chance that privacy really does affect conformity, so a real effect is quite likely
- CBecause the public group conformed more often, the raw difference shows that privacy does affect conformity
- DA p-value of .12 is below the .15 cutoff that psychologists use, so the result counts as significant
Why A is right
The research-methods idea is that a nonsignificant result means the researcher fails to reject the null hypothesis. It does not prove the null is true. With only 20 participants split between two conditions, the study has low statistical power. A real situational effect on conformity, such as more conformity under public responding (the normative social influence covered in topic 4.3, Psychology of Social Situations), could exist and still go undetected. That would be a Type II error. Absence of evidence is not evidence of absence, so the student cannot conclude that privacy has no effect.
Why the other 3 choices miss
- B
- Incorrect because a p-value is not the probability that the hypothesis is true or false. It is the probability of getting results at least this extreme if the null hypothesis were true, so 1 - p does not give the chance of a real effect.
- C
- Incorrect because a raw difference between group means can easily come from chance (sampling error). Inferential statistics exist to judge whether such a difference is reliable, and this one was not statistically significant, so it cannot show that privacy affects conformity.
- D
- Incorrect because the conventional alpha level in psychology is .05, not .15. Since p = .12 is above .05, the result is not statistically significant.