Practicing Meta-Analytics with Rectification

This article demonstrates the necessity of assessing homogeneity in meta-analyses using the Higgins method. The researchers realize the importance of assessing homogeneity in meta-analytic work. However, a significant issue with the Higgins method has been identified. In this article, we explain the...

Full description

Saved in:
Bibliographic Details
Main Authors: Ramalingam Shanmugam, Karan P. Singh
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Publications
Subjects:
Online Access:https://www.mdpi.com/2304-6775/13/1/2
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850279813645860864
author Ramalingam Shanmugam
Karan P. Singh
author_facet Ramalingam Shanmugam
Karan P. Singh
author_sort Ramalingam Shanmugam
collection DOAJ
description This article demonstrates the necessity of assessing homogeneity in meta-analyses using the Higgins method. The researchers realize the importance of assessing homogeneity in meta-analytic work. However, a significant issue with the Higgins method has been identified. In this article, we explain the nature of this problem and propose solutions to address it. Our narrative in this article is to point out the problem, analyze it, and present it well. A prerequisite to check the consistency of findings in comparable studies in meta-analyses is that the studies should be homogeneous, not heterogeneous. The Higgins <inline-formula><math display="inline"><semantics><mrow><msup><mrow><mi>I</mi></mrow><mrow><mn>2</mn></mrow></msup></mrow></semantics></math></inline-formula> score, a version of the Cochran Q value, is commonly used to assess heterogeneity. The Higgins score is an improvement in the Q value. However, there is a problem with Higgins score statistically. The Higgins score is supposed to follow a Chi-squared distribution, but it does not do so because the Chi-squared distribution becomes invalid once the Q score is less than the degrees of freedom. This problem was recently rectified using an alternative method (<inline-formula><math display="inline"><semantics><mrow><msup><mrow><mi>S</mi></mrow><mrow><mn>2</mn></mrow></msup></mrow></semantics></math></inline-formula> score). Using this method, we examined 14 published articles representing 133 datasets and observed that many studies declared homogeneous by the Higgins method were, in fact, heterogeneous. This article urges the research community to be cautious in making inferences using the Higgins method.
format Article
id doaj-art-2fcdb8e2f0bb4faa85b397faf47df4b6
institution OA Journals
issn 2304-6775
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Publications
spelling doaj-art-2fcdb8e2f0bb4faa85b397faf47df4b62025-08-20T01:48:58ZengMDPI AGPublications2304-67752025-01-01131210.3390/publications13010002Practicing Meta-Analytics with RectificationRamalingam Shanmugam0Karan P. Singh1School of Health Administration, Texas State University, San Marcos, TX 78666, USADepartment of Epidemiology and Biostatistics, The University of Texas at Tyler Health Science Center, School of Medicine, Tyler, TX 75708, USAThis article demonstrates the necessity of assessing homogeneity in meta-analyses using the Higgins method. The researchers realize the importance of assessing homogeneity in meta-analytic work. However, a significant issue with the Higgins method has been identified. In this article, we explain the nature of this problem and propose solutions to address it. Our narrative in this article is to point out the problem, analyze it, and present it well. A prerequisite to check the consistency of findings in comparable studies in meta-analyses is that the studies should be homogeneous, not heterogeneous. The Higgins <inline-formula><math display="inline"><semantics><mrow><msup><mrow><mi>I</mi></mrow><mrow><mn>2</mn></mrow></msup></mrow></semantics></math></inline-formula> score, a version of the Cochran Q value, is commonly used to assess heterogeneity. The Higgins score is an improvement in the Q value. However, there is a problem with Higgins score statistically. The Higgins score is supposed to follow a Chi-squared distribution, but it does not do so because the Chi-squared distribution becomes invalid once the Q score is less than the degrees of freedom. This problem was recently rectified using an alternative method (<inline-formula><math display="inline"><semantics><mrow><msup><mrow><mi>S</mi></mrow><mrow><mn>2</mn></mrow></msup></mrow></semantics></math></inline-formula> score). Using this method, we examined 14 published articles representing 133 datasets and observed that many studies declared homogeneous by the Higgins method were, in fact, heterogeneous. This article urges the research community to be cautious in making inferences using the Higgins method.https://www.mdpi.com/2304-6775/13/1/2homogeneityCochran’s Q score<i>H</i><sup>2</sup> scoreHiggin <i>I</i><sup>2</sup> score<i>S</i><sup>2</sup> scoresystematic reviews
spellingShingle Ramalingam Shanmugam
Karan P. Singh
Practicing Meta-Analytics with Rectification
Publications
homogeneity
Cochran’s Q score
<i>H</i><sup>2</sup> score
Higgin <i>I</i><sup>2</sup> score
<i>S</i><sup>2</sup> score
systematic reviews
title Practicing Meta-Analytics with Rectification
title_full Practicing Meta-Analytics with Rectification
title_fullStr Practicing Meta-Analytics with Rectification
title_full_unstemmed Practicing Meta-Analytics with Rectification
title_short Practicing Meta-Analytics with Rectification
title_sort practicing meta analytics with rectification
topic homogeneity
Cochran’s Q score
<i>H</i><sup>2</sup> score
Higgin <i>I</i><sup>2</sup> score
<i>S</i><sup>2</sup> score
systematic reviews
url https://www.mdpi.com/2304-6775/13/1/2
work_keys_str_mv AT ramalingamshanmugam practicingmetaanalyticswithrectification
AT karanpsingh practicingmetaanalyticswithrectification