Benefits for Voice Learning Caused by Concurrent Faces Develop over Time

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

Fersiynau electronig

Dogfennau

Dangosydd eitem ddigidol (DOI)

  • R. Zaske
  • C. Muhl
  • S.R. Schweinberger
Recognition of personally familiar voices benefits from the concurrent presentation of the corresponding speakers’ faces. This effect of audiovisual integration is most pronounced for voices combined with dynamic articulating faces. However, it is unclear if learning unfamiliar voices also benefits from audiovisual face-voice integration or, alternatively, is hampered by attentional capture of faces, i.e., “face-overshadowing”. In six study-test cycles we compared the recognition of newly-learned voices following unimodal voice learning vs. bimodal face-voice learning with either static (Exp. 1) or dynamic articulating faces (Exp. 2). Voice recognition accuracies significantly increased for bimodal learning across study-test cycles while remaining stable for unimodal learning, as reflected in numerical costs of bimodal relative to unimodal voice learning in the first two study-test cycles and benefits in the last two cycles. This was independent of whether faces were static images (Exp. 1) or dynamic videos (Exp. 2). In both experiments, slower reaction times to voices previously studied with faces compared to voices only may result from visual search for faces during memory retrieval. A general decrease of reaction times across study-test cycles suggests facilitated recognition with more speaker repetitions. Overall, our data suggest two simultaneous and opposing mechanisms during bimodal face-voice learning: while attentional capture of faces may initially impede voice learning, audiovisual integration may facilitate it thereafter.
Iaith wreiddiolSaesneg
CyfnodolynPLoS ONE
Cyfrol10
Rhif y cyfnodolyn11
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 20 Tach 2015

Cyfanswm lawlrlwytho

Nid oes data ar gael
Gweld graff cysylltiadau