Motor theory of speech perception

Motor theory of speech perception
When we hear spoken words we sense that they are made of auditory sounds. The motor theory of speech perception argues that behind the sounds we hear are the intended movements of the vocal tract that pronounces them.

The motor theory of speech perception is the hypothesis that people perceive spoken words by identifying the vocal tract gestures with which they are pronounced rather than by identifying the sound patterns that speech generates.[1][2][3][4][5] It originally claimed that speech perception is done through a specialized module that is innate and human-specific. Though the idea of a module has been qualified in more recent versions of the theory,[5] the idea remains that the role of the speech motor system is not only to produce speech articulations but also to detect them.

The hypothesis has gained more interest outside the field of speech perception than inside. This has increased particularly since the discovery of mirror neurons that link the production and perception of motor movements, including those made by the vocal tract.[5] An alternative interpretation of research linking speech perception to speech production, however, is that it links to speech imitation rather than speech perception.[6]

The theory was initially proposed in the Haskins Laboratories in the 1950s by Alvin Liberman and Franklin S. Cooper, and developed further by Donald Shankweiler, Michael Studdert-Kennedy, Ignatius Mattingly, Carol Fowler and Douglas Whalen.

Contents

Origins and development

The hypothesis has its origins in research using pattern playback to create reading machines for the blind that would substitute sounds for orthographic letters.[7] This led to a close examination of how spoken sounds correspond to the acoustic spectrogram of them as a sequence of auditory sounds. This found that successive consonants and vowels overlap in time with one another (a phenomenon known as coarticulation).[8][9][10] This suggested that speech is not heard like an acoustic "alphabet" or "cipher," but as a "code" of overlapping speech gestures.

Associationist approach

Initially, the theory was associationist: infants mimic the speech they hear and that this leads to behavioristic associations between articulation and its sensory consequences. Later, this overt mimicry would be short-circuited and become speech perception.[9] This aspect of the theory was dropped, however, with the discovery that prelinguistic infants could already detect most of the phonetic contrasts used to separate different speech sounds.[1]

Cognitivist approach

The behavioristic approach was replaced by a cognitivist one in which there was a speech module.[1] The module detected speech in terms of hidden distal objects rather than at the proximal or immediate level of their input. The evidence for this was the research finding that speech processing was special such as duplex perception.[11]

Changing distal objects

Initially, speech perception was assumed to link to speech objects that were both

  • the invariant movements of speech articulators[9]
  • the invariant motor commands sent to muscles to move the vocal tract articulators[12]

This was later revised to include the phonetic gestures rather than motor commands,[1] and then the gestures intended by the speaker at a prevocal, linguistic level, rather than actual movements.[13]

Modern revision

The "speech is special" claim has been dropped,[5] as it was found that speech perception could occur for nonspeech sounds (for example, slamming doors for duplex perception).[14]

Mirror neurons

The discovery of mirror neurons has led to renewed interest in the motor theory of speech perception, and the theory still has its advocates,[5] although there are also critics.[15]

Support

Nonauditory gesture information

If speech is identified in terms of how it is physically made, then nonauditory information should be incorporated into speech percepts even if it is still subjectively heard as "sounds". This is, in fact, the case.

  • The McGurk effect shows that seeing the production of a spoken syllable that differs from one an auditory one synchronized with it affects the perception of the auditory one. In other words, if someone hears "ba" but sees a video of someone pronouncing "ga", what they hear is different—some people believe they hear "da".
  • People find it easier to hear speech in noise if they can see the speaker.[16]
  • People can hear syllables better when their production can be felt haptically.[17]

Categorical perception

Using a speech synthesizer, speech sounds can be varied in place of articulation along a continuum from /bɑ/ to /dɑ/ to /ɡɑ/, or in voice onset time on a continuum from /dɑ/ to /tɑ/ (for example). When listeners are asked to discriminate between two different sounds, they perceive sounds as belonging to discrete categories, even though the sounds vary continuously. In other words, 10 sounds (with the sound on one extreme being /dɑ/ and the sound on the other extreme being /tɑ/, and the ones in the middle varying on a scale) may all be acoustically different from one another, but the listener will hear all of them as either /dɑ/ or /tɑ/. Likewise, the English consonant /d/ may vary in its acoustic details across different phonetic contexts (the /d/ in /du/ does not technically sound the same as the one in /di/, for example), but all /d/'s as perceived by a listener fall within one category (voiced alveolar stop) and that is because "linguistic representations are abstract, canonical, phonetic segments or the gestures that underlie these segments."[18] This suggests that humans identify speech using categorical perception, and thus that a specialized module, such as that proposed by the motor theory of speech perception, may be on the right track.[19]

Speech imitation

If people can hear the gestures in speech, then the imitation of speech should be very fast, as in when words are repeated that are heard in headphones as in speech shadowing.[20] People can repeat heard syllables more quickly than they would be able to produce them normally.[21]

Speech production

  • Hearing speech actives vocal tract muscles,[22] and the motor cortex[23] and premotor cortex.[24] The integration of auditory and visual input in speech perception also involves such areas.[25]
  • Disrupting the premotor cortex disrupts the perception of speech units such as stop consonants.[26]
  • The activation of the motor areas occurs in terms of the phonemic features which link with the vocal track articulators that create speech gestures.[27]
  • The perception of a speech sound is aided by pre-emptively stimulating the motor representation of the articulators responsible for its pronunciation .[28]

Perception-action meshing

Evidence exists that perception and production are generally coupled in the motor system. This is supported by the existence of mirror neurons that are activated both by seeing (or hearing) an action and when that action is carried out.[29] Another source of evidence is that for common coding theory between the representations used for perception and action.[30]

Criticisms

The motor theory of speech perception is not widely held in the field of speech perception, though it is more popular in other fields, such as theoretical linguistics. As three of its advocates have noted, "it has few proponents within the field of speech perception, and many authors cite it primarily to offer critical commentary".[5]p. 361 Several critiques of it exist.[15][31]

Multiple sources

Speech perception is affected by nonproduction sources of information, such as context. Individual words are hard to understand in isolation but easy when heard in sentence context. It therefore seems that speech perception uses multiple sources that are integrated together in an optimal way.[15]

Production

The motor theory of speech perception would predict that speech motor abilities in infants predict their speech perception abilities, but in actuality it is the other way around.[32] It would also predict that defects in speech production would impair speech perception, but they do not.[33] However, this only affects the first and already superseded behaviorist version of the theory, where infants were supposed to learn all production-perception patterns by imitation early in childhood. This is no longer the mainstream view of motor-speech theorists.

Speech module

Several sources of evidence for a specialized speech module have failed to be supported.

  • Duplex perception can be observed with door slams.[14]
  • The McGurk effect can also be achieved with nonlinguistic stimuli, such as showing someone a video of a basketball bouncing but playing the sound of a ping-pong ball bouncing.[citation needed]
  • As for categorical perception, listeners can be sensitive to acoustic differences within single phonetic categories.

As a result, this part of the theory has been dropped by some researchers.[5]

Sublexical tasks

The evidence provided for the motor theory of speech perception is limited to tasks such as syllable discrimination that use speech units not full spoken words or spoken sentences. As a result, "speech perception is sometimes interpreted as referring to the perception of speech at the sublexical level. However, the ultimate goal of these studies is presumably to understand the neural processes supporting the ability to process speech sounds under ecologically valid conditions, that is, situations in which successful speech sound processing ultimately leads to contact with the mental lexicon and auditory comprehension."[34] This however creates the problem of " a tenuous connection to their implicitt target of investigation, speech recognition".[34]

Imitation

The motor theory of speech perception faces the problem that the research linking speech perception to speech production is also consistent with the brain processing speech to imitate spoken words. The brain must have a means to do this if language is to exist, since a child's vocabulary expansion requires a means to learn novel spoken words, as does an adult's picking up of new names.[6] Imitation has to be initiated for all vocalizations since a word's novelty cannot be known until after it is heard, and so after when the information needed to identify its articulation gestures and motor goals has gone. As result vocal imitation needs to be initiated by default into short term memory for every heard spoken vocalizations.[6] If speech perception uses multiple sources of information, this default imitation processing would provide as a secondary use an extra source for word perception. Since imitation will be most needed for vocalizations that are not proper words, this could explain why sublexical tasks that do not use proper words so strongly link to processing of motor gestures.[6]

Birds

It has been suggested that birds also hear each others' bird song in terms of vocal gestures.[35]

See also

References

  1. ^ a b c d Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M. (1967). Perception of the speech code. Psychol Rev.74(6):431-61. PubMed
  2. ^ Liberman AM, Mattingly IG. (1985). The motor theory of speech perception revised. Cognition. 21(1):1-36. PubMed
  3. ^ Liberman AM, Mattingly IG. (1989). A specialization for speech perception. Science. 243(4890):489-94. PubMed
  4. ^ Liberman AM, Whalen DH. (2000). On the relation of speech to language. Trends Cogn Sci. 4(5):187-196. PubMed
  5. ^ a b c d e f g Galantucci B, Fowler CA, Turvey MT. (2006). The motor theory of speech perception reviewed. Psychon Bull Rev. 13(3):361-77. PubMed
  6. ^ a b c d Skoyles JR. (1998). Speech phones are a replication code. Med Hypotheses. 50(2):167-73. PubMed
  7. ^ Liberman, A. M. (1996). Speech: A special code. Cambridge, MA: MIT Press. ISBN 978-0262121927
  8. ^ Liberman AM, Delattre P, Cooper FS. (1952). The role of selected stimulus-variables in the perception of the unvoiced stop consonants. Am J Psychol. 65(4):497-516. PubMed
  9. ^ a b c Liberman AM, Delattre PC, Cooper FS, Gerstman LJ. (1954). The role of consonant–vowel transitions in the perception of the stop and nasal consonants. Psychological Monographs: General & Applied, 68, 1-13.
  10. ^ Fowler CA. Saltzman E. (1993). Coordination and coarticulation in speech. Language and Speech, 36, 171-195. PubMed
  11. ^ Liberman AM, Isenberg D, Rakerd B. (1981). Duplex perception of cues for stop consonants: evidence for a phonetic mode. Percept Psychophys. 30(2):133-43. PubMed
  12. ^ Liberman, A. M. (1970). The grammars of speech and language. Cognitive Psychology,1:301–323 doi:10.1016/0010-0285(70)90018-6
  13. ^ Liberman AM, Mattingly IG. (1985). The motor theory of speech perception revised. Cognition. Oct;21(1):1-36. PMID 4075760
  14. ^ a b Fowler CA, Rosenblum LD. (1990). Duplex perception: a comparison of monosyllables and slamming doors. J Exp Psychol Hum Percept Perform. 16(4):742-54. PubMed
  15. ^ a b c Massaro DW, Chen TH. (2008). The motor theory of speech perception revisited. Psychon Bull Rev. 15(2):453-7. PubMed
  16. ^ MacLeod A, Summerfield Q. (1987) Quantifying the contribution of vision to speech perception in noise. Br J Audiol. 21(2):131-41. PubMed
  17. ^ Fowler CA, Dekle DJ. (1991) Listening with eye and hand: cross-modal contributions to speech perception. J Exp Psychol Hum Percept Perform. 17(3):816-28. PubMed
  18. ^ Nygaard, L.C., Pisoni, D.B. (1995). "Speech Perception: New Directions in Research and Theory". In J.L. Miller, P.D. Eimas. Handbook of Perception and Cognition: Speech, Language, and Communication. San Diego: Academic Press. ISBN 978-0124977709. 
  19. ^ Liberman, A.M., Harris, K.S., Hoffman, H.S., Griffith, B.C. (1957). "The discrimination of speech sounds within and across phoneme boundaries". Journal of Experimental Psychology 54 (5): 358–368. doi:10.1037/h0044417. PMID 13481283. http://www.haskins.yale.edu/Reprints/HL0022.pdf. 
  20. ^ Marslen-Wilson W. (1973). Linguistic structure and speech shadowing at very short latencies. Nature, 244, 522-523. PubMed
  21. ^ Porter RJ. Lubker JF. (1980). Rapid reproduction of vowel-vowel sequences, Evidence for a fast and direct acoustic-motoric linkage in speech. Journal of Speech and Hearing Research, 23, 593-602. PubMed
  22. ^ Fadiga L, Craighero L, Buccino G, Rizzolatti G. (2002). Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur J Neurosci. 15:399-402.PubMed
  23. ^ Watkins KE, Strafella AP, Paus T. (2003). Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia. 41:989-94. PubMed
  24. ^ Wilson SM, Saygin AP, Sereno MI, Iacoboni M. (2004). Listening to speech activates motor areas involved in speech production. Nat Neurosci. 7:701-2. PubMed
  25. ^ Skipper JI, van Wassenhove V, Nusbaum HC, Small SL. (2007). Hearing lips and seeing voices: how cortical areas supporting speech production mediate audiovisual speech perception. Cereb Cortex. 17:2387-99. PubMed
  26. ^ Meister IG, Wilson SM, Deblieck C, Wu AD, Iacoboni M. (2007). The essential role of premotor cortex in speech perception. Curr Biol. 17:1692-6.PubMed
  27. ^ Pulvermüller F, Huss M, Kherif F, Moscoso del Prado Martin F, Hauk O, Shtyrov Y. (2006). Motor cortex maps articulatory features of speech sounds. Proc Natl Acad Sci U S A. 103:7865-70. PubMed
  28. ^ D'Ausilio A, Pulvermüller F, Salmas P, Bufalari I, Begliomini C, Fadiga L. (2009). The motor somatotopy of speech perception. Curr Biol. 19:381-5. PubMed
  29. ^ Rizzolatti G., Craighero L., The mirror-neuron system, Annual Review of Neuroscience. 2004;27:169-92 PubMed
  30. ^ Hommel B, Müsseler J, Aschersleben G, Prinz W. (2001). The Theory of Event Coding (TEC): a framework for perception and action planning. Behav Brain Sci. 24(5):849-78. PubMed
  31. ^ Lane H. (1965). The motor theory of speech perception: A critical review. Psychol Rev. 72:275-309. PMID 14348425
  32. ^ Tsao FM, Liu HM, Kuhl PK. (2004). Speech perception in infancy predicts language development in the second year of life: a longitudinal study. Child Dev. 75(4):1067-84. PMID 15260865
  33. ^ MacNeilage PF, Rootes TP, Chase RA. (1967). Speech production and perception in a patient with severe impairment of somesthetic perception and motor control. J Speech Hear Res. 10(3):449-67. PMID 6081929 abstract
  34. ^ a b Hickok G, Poeppel D. (2007). The cortical organization of speech processing. Nat Rev Neurosci. 8(5):393-402. PubMed page 394
  35. ^ Williams H, Nottebohm F. (1985) Auditory responses in avian vocal motor neurons: a motor theory for song perception in birds. Science. 229(4710):279-82. PubMed

External links


Wikimedia Foundation. 2010.

Игры ⚽ Нужно сделать НИР?

Look at other dictionaries:

  • Speech perception — is the process by which the sounds of language are heard, interpreted and understood. The study of speech perception is closely linked to the fields of phonetics and phonology in linguistics and cognitive psychology and perception in psychology.… …   Wikipedia

  • Speech repetition — Children copy with their own mouths the words spoken by the mouths of those around them. This enables them to learn the pronunciation of words not already in their vocabulary. Speech repetition is the saying by one individual of the spoken… …   Wikipedia

  • Motor-Theorie — Die Motor Theorie der Sprachwahrnehmung (motor theory of speech perception) ist eine Theorie zur Wahrnehmung von Sprache, die in den 60er Jahren in den Haskins Laboratories entwickelt wurde (vgl. Liberman et al. (1967)). Inhaltsverzeichnis 1… …   Deutsch Wikipedia

  • Categorical perception — is the perception of different sensory phenomena as being qualitatively,or categorically, different. It is opposed to continuous perception , the perception of different sensory phenomena as being located on a smooth continuum.Categorical… …   Wikipedia

  • speech — /speech/, n. 1. the faculty or power of speaking; oral communication; ability to express one s thoughts and emotions by speech sounds and gesture: Losing her speech made her feel isolated from humanity. 2. the act of speaking: He expresses… …   Universalium

  • Perception — For other uses, see Perception (disambiguation). Perceptual redirects here. For the Brian Blade album, see Perceptual (album). Robert Fludd s depiction of perception (1619) …   Wikipedia

  • Speech recognition — For the human linguistic concept, see Speech perception. The display of the Speech Recognition screensaver on a PC, in which the character responds to questions, e.g. Where are you? or statements, e.g. Hello. Speech recognition (also known as… …   Wikipedia

  • Motor cognition — The concept of motor cognition grasps the notion that cognition is embodied in action, and that the motor system participates in what is usually considered as mental processing, including those involved in social interaction.[1] The fundamental… …   Wikipedia

  • Common coding theory — is a cognitive psychology theory describing how perceptual representations (e.g. of things we can see and hear) and motor representations (e.g. of hand actions) are linked. The theory claims that there is a shared representation (a common code)… …   Wikipedia

  • Mirror neuron — A mirror neuron is a neuron that fires both when an animal acts and when the animal observes the same action performed by another.[1][2] [3] Thus, the neuron mirrors the behaviour of the other, as though the observer were itself acting. Such… …   Wikipedia

Share the article and excerpts

Direct link
… Do a right-click on the link above
and select “Copy Link”