Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study

BackgroundHealth misinformation undermines responses to health crises, with social media amplifying the issue. Although organizations work to correct misinformation, challenges persist due to reasons such as the difficulty of effectively sharing corrections and information be...

Full description

Saved in:
Bibliographic Details
Main Authors: Hsin-Yu Kuo, Su-Yen Chen
Format: Article
Language:English
Published: JMIR Publications 2025-01-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2025/1/e65631
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832590474603397120
author Hsin-Yu Kuo
Su-Yen Chen
author_facet Hsin-Yu Kuo
Su-Yen Chen
author_sort Hsin-Yu Kuo
collection DOAJ
description BackgroundHealth misinformation undermines responses to health crises, with social media amplifying the issue. Although organizations work to correct misinformation, challenges persist due to reasons such as the difficulty of effectively sharing corrections and information being overwhelming. At the same time, social media offers valuable interactive data, enabling researchers to analyze user engagement with health misinformation corrections and refine content design strategies. ObjectiveThis study aimed to identify the attributes of correction posts and user engagement and investigate (1) the trend of user engagement with health misinformation correction during 3 years of the COVID-19 pandemic; (2) the relationship between post attributes and user engagement in sharing and reactions; and (3) the content generated by user comments serving as additional information attached to the post, affecting user engagement in sharing and reactions. MethodsData were collected from the Facebook pages of a fact-checking organization and a health agency from January 2020 to December 2022. A total of 1424 posts and 67,378 corresponding comments were analyzed. The posts were manually annotated by developing a research framework based on the fuzzy-trace theory, categorizing information into “gist” and “verbatim” representations. Three types of gist representations were examined: risk (risks associated with misinformation), awareness (awareness of misinformation), and value (value in health promotion). Furthermore, 3 types of verbatim representations were identified: numeric (numeric and statistical bases for correction), authority (authority from experts, scholars, or institutions), and facts (facts with varying levels of detail). The basic metrics of user engagement included shares, reactions, and comments as the primary dependent variables. Moreover, this study examined user comments and classified engagement as cognitive (knowledge-based, critical, and bias-based) or emotional (positive, negative, and neutral). Statistical analyses were performed to explore the impact of post attributes on user engagement. ResultsOn the basis of the results of the regression analysis, risk (β=.07; P=.001), awareness (β=.09; P<.001), and facts (β=.14; P<.001) predicted higher shares; awareness (β=.07; P=.001) and facts (β=.24; P<.001) increased reactions; and awareness (β=.06; P=.005), numeric representations (β=.06; P=.02), and facts (β=.19; P<.001) increased comments. All 3 gist representations significantly predicted shares (risk: β=.08; P<.001, awareness: β=.08; P<.001, and value: β=.06; P<.001) and reactions (risk: β=.04; P=.007, awareness: β=.06; P<.001, and value: β=.05; P<.001) when considering comment content. In addition, comments with bias-based engagement (β=–.11; P=.001) negatively predicted shares. Generally, posts providing gist attributes, especially awareness of misinformation, were beneficial for user engagement in misinformation correction. ConclusionsThis study enriches the theoretical understanding of the relationship between post attributes and user engagement within web-based communication efforts to correct health misinformation. These findings provide a foundation for designing more effective content approaches to combat misinformation and strengthen public health communication.
format Article
id doaj-art-72be38f4719c4057a414a03c99ca0af6
institution Kabale University
issn 1438-8871
language English
publishDate 2025-01-01
publisher JMIR Publications
record_format Article
series Journal of Medical Internet Research
spelling doaj-art-72be38f4719c4057a414a03c99ca0af62025-01-23T16:15:32ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-01-0127e6563110.2196/65631Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining StudyHsin-Yu Kuohttps://orcid.org/0000-0002-6347-388XSu-Yen Chenhttps://orcid.org/0000-0003-1066-6650 BackgroundHealth misinformation undermines responses to health crises, with social media amplifying the issue. Although organizations work to correct misinformation, challenges persist due to reasons such as the difficulty of effectively sharing corrections and information being overwhelming. At the same time, social media offers valuable interactive data, enabling researchers to analyze user engagement with health misinformation corrections and refine content design strategies. ObjectiveThis study aimed to identify the attributes of correction posts and user engagement and investigate (1) the trend of user engagement with health misinformation correction during 3 years of the COVID-19 pandemic; (2) the relationship between post attributes and user engagement in sharing and reactions; and (3) the content generated by user comments serving as additional information attached to the post, affecting user engagement in sharing and reactions. MethodsData were collected from the Facebook pages of a fact-checking organization and a health agency from January 2020 to December 2022. A total of 1424 posts and 67,378 corresponding comments were analyzed. The posts were manually annotated by developing a research framework based on the fuzzy-trace theory, categorizing information into “gist” and “verbatim” representations. Three types of gist representations were examined: risk (risks associated with misinformation), awareness (awareness of misinformation), and value (value in health promotion). Furthermore, 3 types of verbatim representations were identified: numeric (numeric and statistical bases for correction), authority (authority from experts, scholars, or institutions), and facts (facts with varying levels of detail). The basic metrics of user engagement included shares, reactions, and comments as the primary dependent variables. Moreover, this study examined user comments and classified engagement as cognitive (knowledge-based, critical, and bias-based) or emotional (positive, negative, and neutral). Statistical analyses were performed to explore the impact of post attributes on user engagement. ResultsOn the basis of the results of the regression analysis, risk (β=.07; P=.001), awareness (β=.09; P<.001), and facts (β=.14; P<.001) predicted higher shares; awareness (β=.07; P=.001) and facts (β=.24; P<.001) increased reactions; and awareness (β=.06; P=.005), numeric representations (β=.06; P=.02), and facts (β=.19; P<.001) increased comments. All 3 gist representations significantly predicted shares (risk: β=.08; P<.001, awareness: β=.08; P<.001, and value: β=.06; P<.001) and reactions (risk: β=.04; P=.007, awareness: β=.06; P<.001, and value: β=.05; P<.001) when considering comment content. In addition, comments with bias-based engagement (β=–.11; P=.001) negatively predicted shares. Generally, posts providing gist attributes, especially awareness of misinformation, were beneficial for user engagement in misinformation correction. ConclusionsThis study enriches the theoretical understanding of the relationship between post attributes and user engagement within web-based communication efforts to correct health misinformation. These findings provide a foundation for designing more effective content approaches to combat misinformation and strengthen public health communication.https://www.jmir.org/2025/1/e65631
spellingShingle Hsin-Yu Kuo
Su-Yen Chen
Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
Journal of Medical Internet Research
title Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
title_full Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
title_fullStr Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
title_full_unstemmed Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
title_short Predicting User Engagement in Health Misinformation Correction on Social Media Platforms in Taiwan: Content Analysis and Text Mining Study
title_sort predicting user engagement in health misinformation correction on social media platforms in taiwan content analysis and text mining study
url https://www.jmir.org/2025/1/e65631
work_keys_str_mv AT hsinyukuo predictinguserengagementinhealthmisinformationcorrectiononsocialmediaplatformsintaiwancontentanalysisandtextminingstudy
AT suyenchen predictinguserengagementinhealthmisinformationcorrectiononsocialmediaplatformsintaiwancontentanalysisandtextminingstudy