Skip to main content icon/video/no-internet

Cross-Modal Transfer

Can a person born blind, upon gaining sight, differentiate between a sphere and a cube using vision alone? In other words, can knowledge previously learned by touch be used to inform vision? This question, first posed by William Molyneux in the late 17th century, concerns cross-modal (across senses) transfer, when information gathered in one sensory modality (e.g., touch) transfers to knowledge in another sensory modality (e.g., vision). Cross-modal (CM) transfer results from stimulus characteristics that are related across the senses. For example, an object with a rough texture has a property (roughness) that is readily picked up by touch, but that can be detected by vision as well, as a visually uneven surface. For this reason, CM transfer is sometimes referred to as intermodal (between senses) equivalence.

Though there may be CM transfers across all senses, most research focuses on transfer between vision and touch, with some research on transfer between vision and audition. This entry describes methods of testing CM transfer, transfer between vision and touch, and transfer between hearing and vision.

Methods

To test CM transfer, adults are asked to recognize by sight (or touch or sound) an object they previously experienced in a different modality. Another method involves training subjects on a task with one modality, then asking them to perform an analogous task in another modality. Performance on the second task is compared with that of subjects who had no training on the first task. Faster learning or better performance of the first group is attributed to CM transfer.

A method typically used with infants involves familiarizing them with a stimulus in one modality until they are habituated to it (no longer show interest), then presenting the same object in another modality paired with a new object. Infants show evidence of cross-modal transfer if they explore the new object longer, as they have already learned about the familiar object in the first modality.

Transfer between Vision and Touch

Although adults can transfer information from touch to vision and from vision to touch, there are situations in which they do not succeed, or are less accurate. For example, after holding an apple with closed eyes, an adult may be able to identify it when shown a visual array of differently shaped objects. Experimental factors that affect performance include length of exposure, object complexity, and stimulus properties (e.g., length versus shape). Another crucial factor is the degree to which vision and touch can derive the same information about a stimulus, known as perceptual equivalence, which depends on how strongly the stimulus characteristics are related across the senses. For example, if touch and vision were equally accurate at picking up an object's roughness, then roughness would be perceptually equivalent for touch and vision.

Shape

Overall, adults can visually recognize a shape (e.g., a cylinder or a prism) they previously felt and can identify by touch a shape they just saw. However, there is often an asymmetry, such that they are better at CM transfer from touch to vision than from vision to touch. Similarly, newborns can visually recognize a shape they previously felt, at least when they explored it with their right hands, but often fail to transfer the same shape information from vision to touch with either hand throughout the first year of life. The opposite asymmetry is found occasionally during development and depends on how different the test shapes are from one another, as well as the length of time subjects explore the objects.

...

  • Loading...
locked icon

Sign in to access this content

Get a 30 day FREE TRIAL

  • Watch videos from a variety of sources bringing classroom topics to life
  • Read modern, diverse business cases
  • Explore hundreds of books and reference titles

Sage Recommends

We found other relevant content for you on other Sage platforms.

Loading