The effect of auditory input on multimodal reading comprehension: An examination of adult readers' eye movements.

Journal article


Pellicer-Sánchez, A., Conklin, K., Rodgers, M. P. H. and Parente, F. 2021. The effect of auditory input on multimodal reading comprehension: An examination of adult readers' eye movements. The Modern Language Journal. 105 (4), pp. 936-956. https://doi.org/10.1111/modl.12743
AuthorsPellicer-Sánchez, A., Conklin, K., Rodgers, M. P. H. and Parente, F.
Abstract

Comprehension of many types of texts involves constructing meaning from text and pictures. However, research examining how second language (L2) learners process text and pictures and the relationship with comprehension is scarce. Thus, while verbal input is often presented in written and auditory modes simultaneously (i.e., audio of text with simultaneous reading of it), we do not know how the auditory input affects L2 adult learners’ processing of text and pictures and its relation to comprehension. In the current study, L2 adult learners and native (L1) adults read and read while listening to an illustrated story while their eye movements were recorded. Immediately after reading, they completed a comprehension test. Results showed that the presence of auditory input allowed learners to spend more time looking at pictures and supported a better integration of text and pictures. No differences were observed between L2 and L1 readers’ allocation of attention to text and pictures. Both reading conditions led to similar levels of comprehension. Processing time on the text was positively related to comprehension for L2 readers, while it was associated to lower comprehension for L1 readers. Processing time on images was positively related to comprehension only for L1 readers.

KeywordsBilingualism; Second language acquisition; Vocabulary acquisition; Eye tracking
Year2021
JournalThe Modern Language Journal
Journal citation105 (4), pp. 936-956
PublisherWiley Online Library
ISSN1540-4781
Digital Object Identifier (DOI)https://doi.org/10.1111/modl.12743
Web address (URL)https://onlinelibrary.wiley.com/doi/abs/10.1111/modl.12743
Accepted author manuscript
License
File Access Level
Controlled
Output statusPublished
Publication dates
Online29 Oct 2021
Publication process dates
Accepted07 Aug 2021
Deposited28 Jul 2023
Permalink -

https://repository.derby.ac.uk/item/9zx8q/the-effect-of-auditory-input-on-multimodal-reading-comprehension-an-examination-of-adult-readers-eye-movements

  • 1
    total views
  • 0
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

The effect of frequency of exposure on the processing and learning of collocations: A comparison of first and second language readers’ eye movements
Ana Pellicer-Sánchez, Anna Siyanova-Chanturia and Fabio Parente 2022. The effect of frequency of exposure on the processing and learning of collocations: A comparison of first and second language readers’ eye movements. Applied Psycholinguistics. 43 (3), pp. 1-30. https://doi.org/10.1017/s014271642200011x
Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?
Maratos, F., Chu, K., Lipka, S., Parente, F. and Stupple, E. 2022. Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects? Cognitive Processing. 24, pp. 59-70. https://doi.org/10.1007/s10339-022-01111-3
Authors' Responses to Peer Review of “Influence of the COVID-19 Lockdown on the Physical and Psychosocial Well-being and Work Productivity of Remote Workers: Cross-sectional Correlational Study”
Yessica Abigail Tronco Hernández, Fabio Parente, Mark A Faghy, Clare M P Roscoe, Frances A Maratos and Maratos, F. 2021. Authors' Responses to Peer Review of “Influence of the COVID-19 Lockdown on the Physical and Psychosocial Well-being and Work Productivity of Remote Workers: Cross-sectional Correlational Study”. JMIR Publications. https://doi.org/10.2196/34609
Influence of the COVID-19 lockdown on remote workers’ physical and psychosocial wellbeing and work productivity
Yessica Abigail Tronco Hernandez, Fabio Parente, Mark A. Faghy, Clare M. P. Roscoe and Frances Maratos 2021. Influence of the COVID-19 lockdown on remote workers’ physical and psychosocial wellbeing and work productivity. PsyArXiv. https://doi.org/10.31234/osf.io/dnuk3
Influence of the COVID-19 Lockdown on the Physical and Psychosocial Well-being and Work Productivity of Remote Workers: Cross-sectional Correlational Study (Preprint)
Yessica Abigail Tronco Hernández, Fabio Parente, Mark A Faghy, Clare M P Roscoe, Frances A Maratos and Faghy, M. 2021. Influence of the COVID-19 Lockdown on the Physical and Psychosocial Well-being and Work Productivity of Remote Workers: Cross-sectional Correlational Study (Preprint). JMIR. https://doi.org/10.2196/preprints.30708