Leveraging large language models for automated detection of velopharyngeal dysfunction in patients with cleft palate

BackgroundHypernasality, a hallmark of velopharyngeal insufficiency (VPI), is a speech disorder with significant psychosocial and functional implications. Conventional diagnostic methods rely heavily on specialized expertise and equipment, posing challenges in resource-limited settings. This study e...

Full description

Saved in:
Bibliographic Details
Main Authors: Myranda Uselton Shirk, Catherine Dang, Jaewoo Cho, Hanlin Chen, Lily Hofstetter, Jack Bijur, Claiborne Lucas, Andrew James, Ricardo-Torres Guzman, Andrea Hiller, Noah Alter, Amy Stone, Maria Powell, Matthew E. Pontell
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-03-01
Series:Frontiers in Digital Health
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fdgth.2025.1552746/full
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:BackgroundHypernasality, a hallmark of velopharyngeal insufficiency (VPI), is a speech disorder with significant psychosocial and functional implications. Conventional diagnostic methods rely heavily on specialized expertise and equipment, posing challenges in resource-limited settings. This study explores the application of OpenAI's Whisper model for automated hypernasality detection, offering a scalable and efficient alternative to traditional approaches.MethodsThe Whisper model was adapted for binary classification by replacing its sequence-to-sequence decoder with a custom classification head. A dataset of 184 audio recordings, including 96 hypernasal (cases) and 88 non-hypernasal samples (controls), was used for training and evaluation. The Whisper model's performance was compared to traditional machine learning approaches, including support vector machines (SVM) and random forest (RF) classifiers.ResultsThe Whisper-based model effectively detected hypernasality in speech, achieving a test accuracy of 97% and an F1-score of 0.97. It significantly outperformed SVM and RF classifiers, which achieved accuracies of 88.1% and 85.7%, respectively. Whisper demonstrated robust performance across diverse recording conditions and required minimal training data, showcasing its scalability and efficiency for hypernasality detection.ConclusionThis study demonstrates the effectiveness of the Whisper-based model for hypernasality detection. By providing a reliable pretest probability, the Whisper model can serve as a triaging mechanism to prioritize patients for further evaluation, reducing diagnostic delays and optimizing resource allocation.
ISSN:2673-253X