Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli

This paper presents an audiovisual perceptual analysis of the wh-question and wh-exclamation intonation in Brazilian Portuguese using auditory–visual congruent and incongruent stimuli, to investigate the relative importance of each modality in signaling pragmatic meanings. Ten Brazilian Portuguese s...

Full description

Saved in:
Bibliographic Details
Main Authors: Luma da Silva Miranda, João Antônio de Moraes, Albert Rilliard
Format: Article
Language:English
Published: Cambridge University Press 2024-12-01
Series:Language and Cognition
Subjects:
Online Access:https://www.cambridge.org/core/product/identifier/S1866980824000164/type/journal_article
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850117623742726144
author Luma da Silva Miranda
João Antônio de Moraes
Albert Rilliard
author_facet Luma da Silva Miranda
João Antônio de Moraes
Albert Rilliard
author_sort Luma da Silva Miranda
collection DOAJ
description This paper presents an audiovisual perceptual analysis of the wh-question and wh-exclamation intonation in Brazilian Portuguese using auditory–visual congruent and incongruent stimuli, to investigate the relative importance of each modality in signaling pragmatic meanings. Ten Brazilian Portuguese speakers (five female) were filmed while producing both speech acts 10 times. Next, artificial stimuli were created: audio and visual cues were either matched (audio and video from the same speech act) or mismatched (audio and video from the different speech acts), resulting in 10 congruent and 10 incongruent stimuli of the wh-questions and the wh-exclamations. The perceptual experiment was taken by 36 Brazilians who identified the stimulus as a question or an exclamation. Results from the logistic regression showed that the factor ‘congruence’ was significant and had a significant interaction with ‘speakers’, which means that the congruent stimuli increased the comprehension of the Brazilian Portuguese wh-questions and wh-exclamations. In contrast, the incongruent stimuli tended to lower listeners’ identification, but to a degree depending on individual speakers’ strategies. Although variation in the accuracy of expressing both speech acts was also found across speakers, this study corroborates that the visual channel impacts the perceptual identification of the pragmatic intonation function of distinguishing sentence mode.
format Article
id doaj-art-e41b5a2e7e4244f4abdc402bcd7bf827
institution OA Journals
issn 1866-9808
1866-9859
language English
publishDate 2024-12-01
publisher Cambridge University Press
record_format Article
series Language and Cognition
spelling doaj-art-e41b5a2e7e4244f4abdc402bcd7bf8272025-08-20T02:36:03ZengCambridge University PressLanguage and Cognition1866-98081866-98592024-12-01161520154010.1017/langcog.2024.16Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuliLuma da Silva Miranda0https://orcid.org/0000-0002-5529-0338João Antônio de Moraes1Albert Rilliard2Eötvös Loránd University, Budapest, HungaryFederal University of Rio de Janeiro, Rio de Janeiro, Brazil The National Council for Scientific and Technological Development, Brasília, BrazilFederal University of Rio de Janeiro, Rio de Janeiro, Brazil Université Paris Saclay, CNRS, LISN, Orsay, FranceThis paper presents an audiovisual perceptual analysis of the wh-question and wh-exclamation intonation in Brazilian Portuguese using auditory–visual congruent and incongruent stimuli, to investigate the relative importance of each modality in signaling pragmatic meanings. Ten Brazilian Portuguese speakers (five female) were filmed while producing both speech acts 10 times. Next, artificial stimuli were created: audio and visual cues were either matched (audio and video from the same speech act) or mismatched (audio and video from the different speech acts), resulting in 10 congruent and 10 incongruent stimuli of the wh-questions and the wh-exclamations. The perceptual experiment was taken by 36 Brazilians who identified the stimulus as a question or an exclamation. Results from the logistic regression showed that the factor ‘congruence’ was significant and had a significant interaction with ‘speakers’, which means that the congruent stimuli increased the comprehension of the Brazilian Portuguese wh-questions and wh-exclamations. In contrast, the incongruent stimuli tended to lower listeners’ identification, but to a degree depending on individual speakers’ strategies. Although variation in the accuracy of expressing both speech acts was also found across speakers, this study corroborates that the visual channel impacts the perceptual identification of the pragmatic intonation function of distinguishing sentence mode.https://www.cambridge.org/core/product/identifier/S1866980824000164/type/journal_articleBrazilian Portugueseincongruent stimulimultimodal perceptionwh-questionwh-exclamation
spellingShingle Luma da Silva Miranda
João Antônio de Moraes
Albert Rilliard
Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
Language and Cognition
Brazilian Portuguese
incongruent stimuli
multimodal perception
wh-question
wh-exclamation
title Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
title_full Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
title_fullStr Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
title_full_unstemmed Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
title_short Visual channel facilitates the comprehension of the intonation of Brazilian Portuguese wh-questions and wh-exclamations: evidence from congruent and incongruent stimuli
title_sort visual channel facilitates the comprehension of the intonation of brazilian portuguese wh questions and wh exclamations evidence from congruent and incongruent stimuli
topic Brazilian Portuguese
incongruent stimuli
multimodal perception
wh-question
wh-exclamation
url https://www.cambridge.org/core/product/identifier/S1866980824000164/type/journal_article
work_keys_str_mv AT lumadasilvamiranda visualchannelfacilitatesthecomprehensionoftheintonationofbrazilianportuguesewhquestionsandwhexclamationsevidencefromcongruentandincongruentstimuli
AT joaoantoniodemoraes visualchannelfacilitatesthecomprehensionoftheintonationofbrazilianportuguesewhquestionsandwhexclamationsevidencefromcongruentandincongruentstimuli
AT albertrilliard visualchannelfacilitatesthecomprehensionoftheintonationofbrazilianportuguesewhquestionsandwhexclamationsevidencefromcongruentandincongruentstimuli