Measurement of Interobserver Disagreement: Correction of Cohen’s Kappa for Negative Values by Tarald O. Kvålseth

“…As measures of interobserver agreement for both nominal and ordinal categories, Cohen’s kappa coefficients appear to be the most widely used with simple and meaningful interpretations. …”
Get full text

Leveraging on large language model to classify sentences: a case study applying STAGES scoring methodology for sentence completion test on ego development by Xavier Bronlet

Subjects: Get full text

Are all tuberculosis deaths correctly attributed due to tuberculosis? Analysis of causes of death (COD) using verbal autopsy: A cross-sectional study in Puducherry by Reenaa Mohan, M Rajalakshmi, G Kalaiselvan

“…Among them 34.9% of the declared TB deaths are not due to TB. Cohen’s kappa = 0.4; 95% CI: (0.858–0.985) showed moderate agreement between the raters. …”
Get full text

Evaluating physician concordance in interpretation of tracheobronchomalacia diagnosis and phenotyping using dynamic expiratory chest computed tomography by G. A. Cortes-Puentes, M. Matatko, B. J. Bartholmai, E. S. Edell, K. G. Lim

“…Inter-rater agreement was assessed using Fleiss’s Kappa for TBM diagnosis and Cohen’s Kappa for TBM phenotype classification into six categories: No TBM, Excessive Dynamic Airway Collapse (EDAC), Crescent Type, Circumferential Type, Saber-Sheath Type, and Mixed Type. …”
Get full text

The Intra- and Inter-rater Reliability of an Arm Care Screening Tool in High School Baseball Coaches by Kyle A. Matsel, Stephanie N. Brown, Matt C. Hoch, Robert J. Butler, Philip M. Westgate, Terry R. Malone, Tim L. Uhl

“…The mean Cohen’s kappa coefficient for intra-rater reliability was 0.76 (95% confidence interval, 0.54-0.95) and percent absolute agreement ranged from 0.82-0.94 among all raters. …”
Get full text

Agreement Between Isokinetic Dynamometer and Hand-held Isometric Dynamometer as Measures to Detect Lower Limb Asymmetry in Muscle Torque After Anterior Cruciate Ligament Reconstruc... by Angelica Ivarsson, Anna Cronström

“…Bland & Altman plots and Cohen's Kappa coefficient were used to assess agreement between measurements obtained from the instruments…”
Get full text

Validity and reliability International Classification of Diseases-10 codes for all forms of injury: A systematic review. by Sarah Paleczny, Nosakhare Osagie, Jai Sethi, Michael Cusimano

“…Reliability was defined by inter-rater reliability (IRR), measured by Krippendorff's alpha, Cohen's Kappa, and/or Fleiss' kappa.<h4>Results</h4>Twenty-seven published studies from 2006 to 2023 were included. …”
Get full text

Radiography may not be accurate in assessing acute ankle sprains in children by Xiongtao Li, Xiantao Shen, Si Wang, Jie Sun, Zhaoting Liu

“…Cohen’s kappa and McNemar’s tests were also utilized to assess the reliability of radiography and ultrasonography in comparison to MRI. …”
Get full text

Qualitative and quantitative agreement research on three diagnostic methods for maxillary transverse discrepancy by Zhang Ningbo, Wang Tianxiao, Yan Feng, Chen Rui, Fu Xinyu, Ren Liling

“…The intraclass correlation coefficient (ICC) was used to evaluate quantitative agreement, while Cohen's kappa was used to measure qualitative agreement. …”
Get full text

An Intelligent Gesture Classification Model for Domestic Wheelchair Navigation with Gesture Variance Compensation by H. M. Ravindu T. Bandara, K. S. Priyanayana, A. G. Buddhika P. Jayasekara, D. P. Chandima, R. A. R. C. Gopura

“…Further, those results were analyzed using Cohen’s kappa analysis in which overall accuracy, misclassification rate, precision, and Cohen’s kappa values were calculated.…”
Get full text

Vascular Access Device Infections: Current Management Practices and the Role of Multidisciplinary Teams at a Large Hospital in Northern Italy by Marta Colaneri, Lucia Galli, Martina Offer, Fabio Borgonovo, Giovanni Scaglione, Camilla Genovese, Rebecca Fattore, Monica Schiavini, Giovanni De Capitani, Maria Calloni, Arianna Bartoli, Antonio Gidaro, Chiara Cogliati, Spinello Antinori, Andrea Gori, Antonella Foschi

“…Concordance between real-life practices and VAT recommendations was evaluated using Cohen’s kappa coefficient. <b>Results</b>: Of 2419 VAD placements, 146 (6%) developed infections (84 CABSI, 62 CRBSI). …”
Get full text

Effectiveness and utilization of a cognitive screening program for primary geriatric care by David P. Salmon, Anna Malkina, Melanie L. Johnson, Christina Gigliotti, Emily A. Little, Douglas Galasko

“…Classification accuracy was shown by high agreement with the eventual clinical diagnosis in the medical record (69%; Cohen’s Kappa = .38; p < .001; 77% if MCI and dementia were collapsed; Cohen’s Kappa = .58; p < .001) and longitudinal decline in cognitive test scores only in those initially classified as having MCI or dementia. …”
Get full text

Evaluation of Efficacy of Artificial Intelligence in Orthopantomogram in Detecting and Classifying Radiolucent Lesions by Sheetal Singar, Ajay Parihar, Prashanthi Reddy

“…The descriptive statistics was performed. The Cohen kappa correlation coefficient was used for assessment of reliability of the diagnostic methods. …”
Get full text

A Cross-Sectional Comparative Study of the Performance of the Widal Test and the Typhidot Immunoassay for Typhoid Fever Diagnosis in the West Region of Cameroon by Karimo Ousenu, Innocent Mbulli Ali, Leonard Fonkeng Sama, Marcel Nsangou Ndam, Thibau Florant Tchouangueu, Christopher Bonglavnyuy Tume

“…The sensitivity, specificity, and predictive values of the positive and negative tests were calculated as well as Cohen’s kappa for agreement between the two tests. …”
Get full text

Prediction of Type 2 Diabetes Mellitus using a Logistic Regression Model by Olivia Altamirano Guerrero, Ronelsys Martínez Martínez, Jhonny Alejandro Rodríguez Gutiérrez

“…To evaluate the predictive capacity of the model, Cohen's Kappa test was used. <br /><strong>Results:</strong> high blood pressure was a positive risk factor for type 2 diabetes mellitus, with a probability coefficient of 1.415. …”
Get full text

Validation of a novel method for localization of parathyroid adenomas using SPECT/CT by Rachelle A. LeBlanc, Andre Isaac, Jonathan Abele, Vincent L. Biron, David W. J. Côté, Matthew Hearn, Daniel A. O’Connell, Hadi Seikaly, Jeffrey R. Harris

“…Overall accuracy in determining superior/inferior and right/left adenomas was calculated, as well as Cohen's Kappa to determine agreement with operative report and inter-rater reliability. …”
Get full text

The Single-Nucleotide Polymorphism (SNP) Validity to Detect Omicron Variants by Lia Gardenia Partakusuma, Luhung Budiailmiawan, null Budiman, Ida Parwati, null Aryati, Basti Andriyoko, Louisa Markus, Corine Niswara, Cut Nur Cinthia Alamanda

“…Results. Analysis using Cohen’s kappa coefficient test showed high conformity between SNP and WGS (p value <0.001; kappa coefficient = 0.948). …”
Get full text

Accuracy of Teledentistry for Diagnosis and Treatment Planning of Pediatric Patients during COVID-19 Pandemic by Ozra Golsanamloo, Sanaz Iranizadeh, Amir Reza Jamei Khosroshahi, Leila Erfanparast, Ali Vafaei, Yalda Ahmadinia, Solmaz Maleki Dizaj

“…The accuracy of the diagnosis was measured by applying Cohen’s kappa. Interexaminer reliability was measured using the intraclass correlation coefficient (ICC) and Cronbach’s alpha. …”
Get full text

Performance assessment of ChatGPT 4, ChatGPT 3.5, Gemini Advanced Pro 1.5 and Bard 2.0 to problem solving in pathology in French language by Georges Tarris, Laurent Martin

“…Chatbot's reliability was assessed by submitting the questions in four successive rounds and comparing score variability using a Fleiss’ Kappa and a Cohen's Kappa. Results Newer chatbots outperformed both students and older chatbots as for the overall scores and multiple-response questions. …”
Get full text

High Ki67 expression, HER2 overexpression, and low progesterone receptor levels in high-grade DCIS: significant associations with clinical practice implications by Hossein Schandiz, Hossein Schandiz, Lorant Farkas, Lorant Farkas, Daehoon Park, Yan Liu, Yan Liu, Solveig N. Andersen, Torill Sauer, Jürgen Geisler, Jürgen Geisler

“…Subtypes were classified, and the Ki67 interobserver diagnostic agreement between Counting Pathologist 1 (CP1) and CP2 was calculated using Cohen’s kappa coefficient at various cutoff values.ResultsThe Cohen’s kappa coefficient for interobserver agreement between CP1 and CP2 was κ = 0.586, indicating moderate agreement. …”
Get full text