Agreement Between Isokinetic Dynamometer and Hand-held Isometric Dynamometer as Measures to Detect Lower Limb Asymmetry in Muscle Torque After Anterior Cruciate Ligament Reconstruc... by Angelica Ivarsson, Anna Cronström

“…Bland & Altman plots and Cohen's Kappa coefficient were used to assess agreement between measurements obtained from the instruments…”
Get full text

Validity and reliability International Classification of Diseases-10 codes for all forms of injury: A systematic review. by Sarah Paleczny, Nosakhare Osagie, Jai Sethi, Michael Cusimano

“…Reliability was defined by inter-rater reliability (IRR), measured by Krippendorff's alpha, Cohen's Kappa, and/or Fleiss' kappa.<h4>Results</h4>Twenty-seven published studies from 2006 to 2023 were included. …”
Get full text

Improving stroke risk prediction by integrating XGBoost, optimized principal component analysis, and explainable artificial intelligence by Lesia Mochurad, Viktoriia Babii, Yuliia Boliubash, Yulianna Mochurad

“…Cross-validation yielded an average value of 0.99, and high values of Matthew's correlation coefficient (MCC) metrics of 0.96 and Cohen's Kappa (CK) of 0.96 confirmed the generalizability and reliability of the model. …”
Get full text

A New Weighting Scheme in Weighted Markov Model for Predicting the Probability of Drought Episodes by Zulfiqar Ali, Ijaz Hussain, Muhammad Faisal, Ibrahim M. Almanjahie, Muhammad Ismail, Maqsood Ahmad, Ishfaq Ahmad

“…We provide a standardized scheme of weights for ordinal sequences of drought classifications by normalizing squared weighted Cohen Kappa. Illustrations of the proposed scheme are given by including temporal ordinal data on drought classes determined by the standardized precipitation temperature index (SPTI). …”
Get full text

Evaluation of Efficacy of Artificial Intelligence in Orthopantomogram in Detecting and Classifying Radiolucent Lesions by Sheetal Singar, Ajay Parihar, Prashanthi Reddy

“…The descriptive statistics was performed. The Cohen kappa correlation coefficient was used for assessment of reliability of the diagnostic methods. …”
Get full text

ChatGPT and oral cancer: a study on informational reliability by Mesude Çi̇ti̇r

“…Inter-rater agreement was assessed using Fleiss’s and Cohen kappa tests. The scores given by the specialties were compared with the Mann-Whitney U test. …”
Get full text

Radiographic interpretation using high-resolution Cbct to diagnose degenerative temporomandibular joint disease. by Jonas Bianchi, João Roberto Gonçalves, Antônio Carlos de Oliveira Ruellas, Júlia Vieira Pastana Bianchi, Lawrence M Ashman, Marilia Yatabe, Erika Benavides, Fabiana Naomi Soki, Lucia Helena Soares Cevidanes

“…The two radiologists presented a high agreement (Cohen's Kappa ranging from 0.80 to 0.87) for all radiographic findings (osteophyte, erosion, cysts, flattening, and sclerosis). …”
Get full text

A data pipeline for secure extraction and sharing of social determinants of health. by Tyler Schappe, Lisa M McElroy, Moronke Ogundolie, Roland Matsouaka, Ursula Rogers, Nrupen A Bhavsar

“…We compared DeGAUSS to a third-party vendor geocoding tool available at Duke Health using a cohort of adult patients referred for abdominal transplant from January 1, 2016, to December 31, 2022. We calculated Cohen's Kappa and percent disagreement at census block group and tract levels, and by Area Deprivation Index, urbanicity, and year.…”
Get full text

Low agreement and frequent invalid controls in two SARS-CoV-2 T-cell assays in people with compromised immune function. by Annette Audigé, Alain Amstutz, Macé M Schuurmans, Patrizia Amico, Dominique L Braun, Marcel P Stoeckle, Barbara Hasse, René Hage, Dominik Damm, Michael Tamm, Nicolas J Mueller, Huldrych F Günthard, Michael T Koller, Christof M Schönenberger, Alexandra Griessbach, Niklaus D Labhardt, Roger D Kouyos, Alexandra Trkola, Michael Huber, Katharina Kusejko, Heiner C Bucher, Irene A Abela, Matthias Briel, Frédérique Chammartin, Benjamin Speich, Swiss HIV Cohort Study, and the Swiss Transplant Cohort Study

“…The reliability between the tests was judged as low (Cohen's kappa [κ] = 0.20; overall percent agreement [OPA] = 66%). …”
Get full text

Evaluating AI-generated responses from different chatbots to soil science-related questions by Javad Khanifar

“…The LLMs were compared using Cohen's Kappa coefficient and the Chi-Square test. The study results indicated that the overall performance of chatbots powered by Claude 3.5 Sonnet and GPT-4o was comparable, as both models correctly answered 64.80 % of the questions. …”
Get full text

Descriptive Phenomenology from Instances of Dishonesty in Psychotherapy by Psychotherapists by Hossein Alipour, Mahdi Akbari

“…The seven-step Colaisi descriptive method was employed to analyze the data.Results: Results showed that coding reliability, measured by Cohen's Kappa agreement across five axes from four raters, yielded an average score of 0.81 (ranging from 0.72 to 0.91). …”
Get full text

Prediction of Type 2 Diabetes Mellitus using a Logistic Regression Model by Olivia Altamirano Guerrero, Ronelsys Martínez Martínez, Jhonny Alejandro Rodríguez Gutiérrez

“…To evaluate the predictive capacity of the model, Cohen's Kappa test was used. <br /><strong>Results:</strong> high blood pressure was a positive risk factor for type 2 diabetes mellitus, with a probability coefficient of 1.415. …”
Get full text

Evaluation of a modified venous excess ultrasound (VExUS) protocol for estimation of venous congestion: a cohort study by Katharine C. Martin, Edward A. Gill, Ivor J. Douglas, August A. Longino

“…Agreement between tVExUS and mVExUS scores was near-perfect (Cohen's Kappa = 0.85). Conclusion mVExUS may be as effective as tVExUS in identifying elevated RAP. …”
Get full text

Biophilic Quality Matrix: A tool to evaluate the biophilic quality of a building during early design stage by Niranjika Wijesooriya, Arianna Brambilla, Lina Markauskaite

“…The statistical analysis revealed that the Cohen's kappa was .804 for Case 1 and .823 for Case 2, both indicating a strong agreement level by the tutors. …”
Get full text

Efficiency of Automated Viral RNA Purification for Pediatric Studies of Dengue and Zika in Hyperendemic Areas by Sandra L. Delgado, Piedad M. Perilla, Doris M. Salgado, María Clemencia Rojas, Carlos F. Narváez

“…The cycle thresholds of the TaqMan Triplex® commercial kit and the in-house assay for the detection of plasma ZIKV RNA isolated with the standard protocol showed a strong association (r = 0.93, P<0.0001) and a Cohen Kappa index of 0.98 when all 249 samples were analyzed. …”
Get full text

Correlation of disease activity score using erythrocyte sedimentation rate and C-reactive protein with clinical disease activity index in rheumatoid arthritis patients by Viraj Panchal, Puja Srivastava, Dhaiwat Shukla, Devang Rana, Supriya Malhotra, Sapan Pandya

“…To assess agreement between scores Cohen's kappa value was also evaluated. P value obtained <0.05 was considered significant. …”
Get full text

Renal Dysfunction, Metabolic Syndrome and Cardiovascular Disease Mortality by David Martins, Chizobam Ani, Deyu Pan, Omolola Ogunyemi, Keith Norris

“…A model with early CKD and MetS has a higher predictive accuracy (72.0% versus 67.6%), area under the ROC (0.74 versus 0.66), and Cohen's kappa (0.38 versus 0.21) than that with MetS alone. …”
Get full text

Self-Movement Screening using the Symmio Application is Reliable and Valid for Identifying Musculoskeletal Risk Factors by Kyle Matsel, Jonathan Kirsch, Tessa Netelbeek, Rolando Rodriguez, Ervin Velic, Kate Schwartzkopf-Phifer

“… # Results The mean Cohen's kappa coefficient was 0.68 (95% CI, 0.47-0.87) and the absolute agreement was 89% between self-assessment of subjects and the observation of a trained healthcare provider. …”
Get full text

Performance assessment of ChatGPT 4, ChatGPT 3.5, Gemini Advanced Pro 1.5 and Bard 2.0 to problem solving in pathology in French language by Georges Tarris, Laurent Martin

“…Chatbot's reliability was assessed by submitting the questions in four successive rounds and comparing score variability using a Fleiss’ Kappa and a Cohen's Kappa. Results Newer chatbots outperformed both students and older chatbots as for the overall scores and multiple-response questions. …”
Get full text

Cardiovascular Risk Assessment: A Comparison of the Framingham, PROCAM, and DAD Equations in HIV-Infected Persons by Max Weyler Nery, Celina Maria Turchi Martelli, Erika Aparecida Silveira, Clarissa Alencar de Sousa, Marianne de Oliveira Falco, Aline de Cássia Oliveira de Castro, Jorge Tannus Esper, Luis Carlos Silva e Souza, Marília Dalva Turchi

“…The agreement between the CVD risk equations was assessed using Cohen's kappa coefficient. The participants' mean age was 36.8 years (SD = 10.3), 76.9% were men, and 66.3% were on antiretroviral therapy. 47.8% of the participants had abdominal obesity, 23.1% were current smokers, 20.0% had hypertension, and 2.0% had diabetes. …”
Get full text