Scoring of swine lung images: a comparison between a computer vision system and human evaluators

Abstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC sc...

Full description

Saved in:
Bibliographic Details
Main Authors: Robert Valeris-Chacin, Beatriz Garcia-Morante, Marina Sibila, Albert Canturri, Isaac Ballarà Rodriguez, Ignacio Bernal Orozco, Ramon Jordà Casadevall, Pedro Muñoz, Maria Pieters
Format: Article
Language:English
Published: BMC 2025-01-01
Series:Veterinary Research
Subjects:
Online Access:https://doi.org/10.1186/s13567-024-01432-5
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832594519125655552
author Robert Valeris-Chacin
Beatriz Garcia-Morante
Marina Sibila
Albert Canturri
Isaac Ballarà Rodriguez
Ignacio Bernal Orozco
Ramon Jordà Casadevall
Pedro Muñoz
Maria Pieters
author_facet Robert Valeris-Chacin
Beatriz Garcia-Morante
Marina Sibila
Albert Canturri
Isaac Ballarà Rodriguez
Ignacio Bernal Orozco
Ramon Jordà Casadevall
Pedro Muñoz
Maria Pieters
author_sort Robert Valeris-Chacin
collection DOAJ
description Abstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC scores provided by a computer vision system (CVS; AI DIAGNOS) from lung images obtained at slaughter, with scores assigned by human evaluators. In addition, intra- and inter-evaluator variability were assessed and compared to intra-CVS variability. A total of 1050 dorsal view images of swine lungs were analyzed. Total lung lesion score, lesion score per lung lobe, and percentage of affected lung area were employed as outcomes for the evaluation. The CVS showed moderate accuracy (62–71%) in discriminating between non-lesioned and lesioned lung lobes in all but the diaphragmatic lobes. A low multiclass classification accuracy at the lung lobe level (24–36%) was observed. A moderate to high inter-evaluator variability was noticed depending on the lung lobe, as shown by the intraclass correlation coefficient (ICC: 0.29–0.6). The intra-evaluator variability was low and similar among the different outcomes and lung lobes, although the observed ICC slightly differed among evaluators. In contrast, the CVS scoring was identical per lobe per image. The results of this study suggest that the CVS AI DIAGNOS could be used as an alternative to the manual scoring of CVPC during slaughter inspections due to its accuracy in binary classification and its perfect consistency in the scoring.
format Article
id doaj-art-eb121a2eb16d4ff4865d92a595b929f1
institution Kabale University
issn 1297-9716
language English
publishDate 2025-01-01
publisher BMC
record_format Article
series Veterinary Research
spelling doaj-art-eb121a2eb16d4ff4865d92a595b929f12025-01-19T12:35:09ZengBMCVeterinary Research1297-97162025-01-0156111210.1186/s13567-024-01432-5Scoring of swine lung images: a comparison between a computer vision system and human evaluatorsRobert Valeris-Chacin0Beatriz Garcia-Morante1Marina Sibila2Albert Canturri3Isaac Ballarà Rodriguez4Ignacio Bernal Orozco5Ramon Jordà Casadevall6Pedro Muñoz7Maria Pieters8Veterinary Education, Research, and Outreach (VERO), Department of Veterinary Pathobiology, College of Veterinary Medicine and Biomedical Sciences, Texas A&M UniversityUnitat Mixta d’Investigació IRTA-UAB en Sanitat Animal, Centre de Recerca en Sanitat Animal (CReSA), Campus de La Universitat Autònoma de Barcelona (UAB)Unitat Mixta d’Investigació IRTA-UAB en Sanitat Animal, Centre de Recerca en Sanitat Animal (CReSA), Campus de La Universitat Autònoma de Barcelona (UAB)Veterinary Diagnostic Laboratory, College of Veterinary Medicine, University of MinnesotaLABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.AVeterinary Diagnostic Laboratory, College of Veterinary Medicine, University of MinnesotaAbstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC scores provided by a computer vision system (CVS; AI DIAGNOS) from lung images obtained at slaughter, with scores assigned by human evaluators. In addition, intra- and inter-evaluator variability were assessed and compared to intra-CVS variability. A total of 1050 dorsal view images of swine lungs were analyzed. Total lung lesion score, lesion score per lung lobe, and percentage of affected lung area were employed as outcomes for the evaluation. The CVS showed moderate accuracy (62–71%) in discriminating between non-lesioned and lesioned lung lobes in all but the diaphragmatic lobes. A low multiclass classification accuracy at the lung lobe level (24–36%) was observed. A moderate to high inter-evaluator variability was noticed depending on the lung lobe, as shown by the intraclass correlation coefficient (ICC: 0.29–0.6). The intra-evaluator variability was low and similar among the different outcomes and lung lobes, although the observed ICC slightly differed among evaluators. In contrast, the CVS scoring was identical per lobe per image. The results of this study suggest that the CVS AI DIAGNOS could be used as an alternative to the manual scoring of CVPC during slaughter inspections due to its accuracy in binary classification and its perfect consistency in the scoring.https://doi.org/10.1186/s13567-024-01432-5Artificial intelligencealgorithmMycoplasma hyopneumoniaecranioventral pulmonary consolidationlunglesions
spellingShingle Robert Valeris-Chacin
Beatriz Garcia-Morante
Marina Sibila
Albert Canturri
Isaac Ballarà Rodriguez
Ignacio Bernal Orozco
Ramon Jordà Casadevall
Pedro Muñoz
Maria Pieters
Scoring of swine lung images: a comparison between a computer vision system and human evaluators
Veterinary Research
Artificial intelligence
algorithm
Mycoplasma hyopneumoniae
cranioventral pulmonary consolidation
lung
lesions
title Scoring of swine lung images: a comparison between a computer vision system and human evaluators
title_full Scoring of swine lung images: a comparison between a computer vision system and human evaluators
title_fullStr Scoring of swine lung images: a comparison between a computer vision system and human evaluators
title_full_unstemmed Scoring of swine lung images: a comparison between a computer vision system and human evaluators
title_short Scoring of swine lung images: a comparison between a computer vision system and human evaluators
title_sort scoring of swine lung images a comparison between a computer vision system and human evaluators
topic Artificial intelligence
algorithm
Mycoplasma hyopneumoniae
cranioventral pulmonary consolidation
lung
lesions
url https://doi.org/10.1186/s13567-024-01432-5
work_keys_str_mv AT robertvalerischacin scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT beatrizgarciamorante scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT marinasibila scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT albertcanturri scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT isaacballararodriguez scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT ignaciobernalorozco scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT ramonjordacasadevall scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT pedromunoz scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators
AT mariapieters scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators