On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology
Abstract Peripheral inflammatory markers (PIMs), such as C-reactive protein (CRP) or white blood cell count (WBC), have been associated with depression severity in meta-analyses and large cohort studies. However, in typically-sized psychoimmunology studies (N < 200) that explore associations betw...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Publishing Group
2025-01-01
|
| Series: | Translational Psychiatry |
| Online Access: | https://doi.org/10.1038/s41398-025-03244-3 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832585389452296192 |
|---|---|
| author | Manivel Rengasamy Daniel Moriarity Rebecca Price |
| author_facet | Manivel Rengasamy Daniel Moriarity Rebecca Price |
| author_sort | Manivel Rengasamy |
| collection | DOAJ |
| description | Abstract Peripheral inflammatory markers (PIMs), such as C-reactive protein (CRP) or white blood cell count (WBC), have been associated with depression severity in meta-analyses and large cohort studies. However, in typically-sized psychoimmunology studies (N < 200) that explore associations between PIMs and neurobiological/psychosocial constructs related to depression and studies that examine less-studied PIMs (e.g., interferon gamma), significant concerns about reproducibility of results exist. For the well-characterized association between PIMs (CRP/WBC) and depression severity, we examined statistical errors as a function of sample size in a large community cohort (n = 24,550). We further assessed how statistical errors varied as related to analytic decisions (e.g., number of covariates) and characteristics related to study design (e.g., relationships within subgroups of patients). Only large samples (e.g., n = 1000 to n = 10,000) were sufficiently powered to detect PIM-depression associations and minimized overestimation of effect sizes (e.g., effect size inflation), and greater sample sizes were required as more covariates were included in analytic models. Moderately sized samples (n > 500) generally ensured the correct directionality of effect sizes (e.g., low rates of sign reversal). Sample sizes required for 80% power also varied widely depending on study design characteristics (e.g., N = 350 to N = 10,000+). Typically-sized psychoimmunology studies examining PIM-depression associations (N < 200) are likely underpowered and at high risk of overestimation of effect sizes. Study design characteristics also notably influence power and statistical error rates. Use of large sample sizes (e.g., N > 7000) and consideration of analytic decisions (e.g., number/choice of covariates) will maximize reproducibility of psychoimmunology studies related to depression to enhance development of treatments for depression or to help understand pathophysiological mechanisms of depression. |
| format | Article |
| id | doaj-art-d9e220326363467e853afc10f7da1421 |
| institution | Kabale University |
| issn | 2158-3188 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Nature Publishing Group |
| record_format | Article |
| series | Translational Psychiatry |
| spelling | doaj-art-d9e220326363467e853afc10f7da14212025-01-26T12:53:45ZengNature Publishing GroupTranslational Psychiatry2158-31882025-01-0115111010.1038/s41398-025-03244-3On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunologyManivel Rengasamy0Daniel Moriarity1Rebecca Price2Department of Psychiatry, University of PittsburghSemel Institute for Neuroscience and Human Behavior, University of California Los AngelesDepartment of Psychiatry, University of PittsburghAbstract Peripheral inflammatory markers (PIMs), such as C-reactive protein (CRP) or white blood cell count (WBC), have been associated with depression severity in meta-analyses and large cohort studies. However, in typically-sized psychoimmunology studies (N < 200) that explore associations between PIMs and neurobiological/psychosocial constructs related to depression and studies that examine less-studied PIMs (e.g., interferon gamma), significant concerns about reproducibility of results exist. For the well-characterized association between PIMs (CRP/WBC) and depression severity, we examined statistical errors as a function of sample size in a large community cohort (n = 24,550). We further assessed how statistical errors varied as related to analytic decisions (e.g., number of covariates) and characteristics related to study design (e.g., relationships within subgroups of patients). Only large samples (e.g., n = 1000 to n = 10,000) were sufficiently powered to detect PIM-depression associations and minimized overestimation of effect sizes (e.g., effect size inflation), and greater sample sizes were required as more covariates were included in analytic models. Moderately sized samples (n > 500) generally ensured the correct directionality of effect sizes (e.g., low rates of sign reversal). Sample sizes required for 80% power also varied widely depending on study design characteristics (e.g., N = 350 to N = 10,000+). Typically-sized psychoimmunology studies examining PIM-depression associations (N < 200) are likely underpowered and at high risk of overestimation of effect sizes. Study design characteristics also notably influence power and statistical error rates. Use of large sample sizes (e.g., N > 7000) and consideration of analytic decisions (e.g., number/choice of covariates) will maximize reproducibility of psychoimmunology studies related to depression to enhance development of treatments for depression or to help understand pathophysiological mechanisms of depression.https://doi.org/10.1038/s41398-025-03244-3 |
| spellingShingle | Manivel Rengasamy Daniel Moriarity Rebecca Price On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology Translational Psychiatry |
| title | On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology |
| title_full | On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology |
| title_fullStr | On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology |
| title_full_unstemmed | On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology |
| title_short | On the pursuit of reproducibility: the importance of large sample sizes in psychoimmunology |
| title_sort | on the pursuit of reproducibility the importance of large sample sizes in psychoimmunology |
| url | https://doi.org/10.1038/s41398-025-03244-3 |
| work_keys_str_mv | AT manivelrengasamy onthepursuitofreproducibilitytheimportanceoflargesamplesizesinpsychoimmunology AT danielmoriarity onthepursuitofreproducibilitytheimportanceoflargesamplesizesinpsychoimmunology AT rebeccaprice onthepursuitofreproducibilitytheimportanceoflargesamplesizesinpsychoimmunology |