Audiovisual Input and L2 Pronunciation Development: A Review of Caption Design, Attention, and Exposure Conditions

Authors

  • Jiaying Fu

DOI:

https://doi.org/10.54097/v2tss416

Keywords:

Audiovisual input, caption design, phonetic perception, cognitive load, extensive viewing.

Abstract

This review analyzes research on how audiovisual input supports second language pronunciation development by examining perceptual mechanisms, caption design, and exposure conditions. Studies on multi-modal alignment show that captions can guide attention to phonetic cues when they are selectively displayed or temporally synchronized with the speech signal. However, in the condition of full captions and form-focused tasks often cause excessive cognitive load. Research on caption types demonstrates that partial captions, keyword captions, and audio-synchronized highlighting promote more efficient decoding than dense or static text. Although proficiency consistently predicts learning outcomes more strongly than caption mode, long-term evidence indicates that extensive viewing still has benefit on lexical consolidation, listening confidence, and gradual reduction of caption dependence. Overall, audiovisual input is most effective when textual support is minimal, well-timed, and embedded within sustained and increasingly authentic listening. The review identifies the need for longitudinal and dose–response designs to clarify how input amount shapes measurable phonetic gains.

Downloads

Download data is not yet available.

References

[1] Flege, J. E. Second language speech learning: Theory, findings, and problems. In W. Strange (Ed.), Speech perception and linguistic experience: Issues in cross-language research. Timonium, MD: York Press. 1995, 233 - 277.

[2] Derwing, T. M., & Munro, M. J. Second language accent and pronunciation teaching: A research-based approach. TESOL Quarterly, 2005, 39 (3), 379 – 397.

[3] Norris, J. M., & Ortega, L. Does type of instruction make a difference? Substantive findings from a meta-analytic review. Language Learning, 2005, 55 (S1), 157 – 213.

[4] Mitterer, H., & McQueen, J. M. Foreign subtitles help but native-language subtitles harm foreign speech perception. PLoS ONE, 2009, 4 (11), e7785.

[5] Wisniewska, N., & Mora, J. C. Can captioned video benefit second language pronunciation? Studies in Second Language Acquisition, 2020, 42, 599 - 624.

[6] Montero Pérez, M., & Pattemore, A. Effects of captioned video on L2 speech segmentation in intermediate learners of Spanish. Language Learning & Technology, 2025, 29 (3), 205 – 225.

[7] Pannatier, F., & Bétrancourt, M. Learning from academic video with subtitles: When foreign language proficiency matters. Learning and Instruction, 2024, 90, 101863.

[8] Gesa, F., & Miralpeix, I. Extensive viewing as additional input for foreign language vocabulary learning: A longitudinal study. Language Learning and Technology, 2023, 27 (3), 99 – 121.

[9] Paivio, A. Mental Representations: A Dual Coding Approach. Oxford University Press. 1986.

[10] Galimberti, V., Mora, J. C., & Gilabert, R. Audio-synchronized textual enhancement in foreign language pronunciation learning from videos. System, 2023, 116, 103078.

[11] Sweller, J. Cognitive load during problem solving: Effects on learning. Cognitive Science, 1988, 12 (2), 257 – 285.

[12] Hutchinson, A., & Dmitrieva, O. Exposure to speech via foreign film and its effects on non-native vowel production and perception. Journal of Phonetics, 2022, 95, 1129 – 1156.

[13] Mohsen, M. & Mahdi, H. Partial versus full captioning mode to improve L2 vocabulary acquisition in a mobile-assisted language learning setting: words pronuncio] ation domain. Journal of Computing in Higher Education, 2021, 33, 524 - 543.

[14] Morton, H., Gunson, N., & Jack, M. Attitudes to Subtitle Duration and the Effect on User Responses in Speech Interactive Foreign Language Learning. Journal of Multimedia, 2011, 6, 5.

[15] Almusharraf, A., Al-Furais, M., & Al-Ghamdi, N. Exploring the effects of modality and variability on EFL learners' pronunciation of English diphthongs: A student perspective on HVPT implementation. Humanities and Social Science Communications, 2024, 11, 141.

[16] Pattemore, A., Suárez, M., & Muñoz, C. Perceptions of learning from audiovisual input and changes in L2 viewing preferences: The roles of on-screen text and proficiency. System, 2024, 121, 103662.

[17] Cárdenas-Claros, M. S., & Ramírez-Orellana, P. Progressive reduction of captions in language learning: An exploratory study on learners' perceptions. Journal of Information Technology Education: Innovations in Practice, 2024, 23, 1 – 22.

Downloads

Published

16-04-2026

Issue

Section

Articles