Skip to content
AP Psychology · Cognition

Cross modal perception

Cross modal perception appears in 3 reviewed AP Psychology questions and sits in Cognition. Below are worked examples showing exactly how the exam tests it, with the answer marked and every distractor explained.

Cross-modal perception happens when information from one sense changes what you perceive through another sense. The brain combines the senses into one experience instead of treating each separately.

Why it matters

It shows that perception is an integrated construction, not a set of separate sensory channels. The McGurk effect, described by McGurk and MacDonald in 1976, is the standard example.

How the exam tests it

Questions ask what the McGurk effect shows. When audio of "ba" is paired with video of lips saying "ga," people often hear "da," so what you see changes what you hear even though the sound is the same.

Don’t confuse it with

Sensory interaction is another name for this same idea, so treat the two terms as equivalent; smell affecting taste and the McGurk effect are examples of both. Synesthesia is different, because one sense triggers an extra experience in another, such as seeing colors when you hear music.

Cross modal perception in real questions

Example 1Medium
Research on cross-modal perception shows that information from one sense can influence the perception of another. The McGurk effect is a classic example. What does the McGurk effect demonstrate?
  1. AHearing a word while seeing an object causes faster recognition of the object due to multisensory redundancy
  2. BWatching someone's hand be touched causes the observer to feel a phantom touch on their own hand through mirror neuron activation
  3. CTasting sweet flavors is enhanced by the visual presence of red-colored food, demonstrating color-taste cross-modal interaction
  4. DVisual information about lip movements can alter the perception of what sound is heard, even when the actual audio is unchangedCorrect

Why D is right

The McGurk effect (McGurk & MacDonald, 1976) demonstrates that speech perception is multimodal — vision influences what we hear. When the audio of one syllable (e.g., 'ba') is dubbed onto a video of someone saying a different syllable (e.g., 'ga'), observers typically perceive an intermediate sound (e.g., 'da') — not matching either the audio or visual input alone. The visual lip movements override or combine with the auditory input, demonstrating that the brain integrates information from multiple senses to construct a unified percept.
Why the other 3 choices miss
A
Incorrect because faster object recognition from multisensory redundancy describes a different cross-modal effect (multisensory facilitation or the redundant signals effect); the McGurk effect specifically involves the visual information CHANGING the perceived speech sound, not simply speeding recognition.
B
Incorrect because observing someone being touched and feeling a phantom touch involves the rubber hand illusion (or related body ownership phenomena) and is related to mirror neuron research; this is not the McGurk effect, which is about audiovisual speech perception integration.
C
Incorrect because color affecting taste perception describes a different (though real) cross-modal effect involving vision and gustation; this is not the McGurk effect, which involves vision affecting AUDITORY speech perception specifically.

Studied alongside

Other concepts from Cognition.