Scoring of swine lung images: a comparison between a computer vision system and human evaluators
Abstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC sc...
Saved in:
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
BMC
2025-01-01
|
Series: | Veterinary Research |
Subjects: | |
Online Access: | https://doi.org/10.1186/s13567-024-01432-5 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832594519125655552 |
---|---|
author | Robert Valeris-Chacin Beatriz Garcia-Morante Marina Sibila Albert Canturri Isaac Ballarà Rodriguez Ignacio Bernal Orozco Ramon Jordà Casadevall Pedro Muñoz Maria Pieters |
author_facet | Robert Valeris-Chacin Beatriz Garcia-Morante Marina Sibila Albert Canturri Isaac Ballarà Rodriguez Ignacio Bernal Orozco Ramon Jordà Casadevall Pedro Muñoz Maria Pieters |
author_sort | Robert Valeris-Chacin |
collection | DOAJ |
description | Abstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC scores provided by a computer vision system (CVS; AI DIAGNOS) from lung images obtained at slaughter, with scores assigned by human evaluators. In addition, intra- and inter-evaluator variability were assessed and compared to intra-CVS variability. A total of 1050 dorsal view images of swine lungs were analyzed. Total lung lesion score, lesion score per lung lobe, and percentage of affected lung area were employed as outcomes for the evaluation. The CVS showed moderate accuracy (62–71%) in discriminating between non-lesioned and lesioned lung lobes in all but the diaphragmatic lobes. A low multiclass classification accuracy at the lung lobe level (24–36%) was observed. A moderate to high inter-evaluator variability was noticed depending on the lung lobe, as shown by the intraclass correlation coefficient (ICC: 0.29–0.6). The intra-evaluator variability was low and similar among the different outcomes and lung lobes, although the observed ICC slightly differed among evaluators. In contrast, the CVS scoring was identical per lobe per image. The results of this study suggest that the CVS AI DIAGNOS could be used as an alternative to the manual scoring of CVPC during slaughter inspections due to its accuracy in binary classification and its perfect consistency in the scoring. |
format | Article |
id | doaj-art-eb121a2eb16d4ff4865d92a595b929f1 |
institution | Kabale University |
issn | 1297-9716 |
language | English |
publishDate | 2025-01-01 |
publisher | BMC |
record_format | Article |
series | Veterinary Research |
spelling | doaj-art-eb121a2eb16d4ff4865d92a595b929f12025-01-19T12:35:09ZengBMCVeterinary Research1297-97162025-01-0156111210.1186/s13567-024-01432-5Scoring of swine lung images: a comparison between a computer vision system and human evaluatorsRobert Valeris-Chacin0Beatriz Garcia-Morante1Marina Sibila2Albert Canturri3Isaac Ballarà Rodriguez4Ignacio Bernal Orozco5Ramon Jordà Casadevall6Pedro Muñoz7Maria Pieters8Veterinary Education, Research, and Outreach (VERO), Department of Veterinary Pathobiology, College of Veterinary Medicine and Biomedical Sciences, Texas A&M UniversityUnitat Mixta d’Investigació IRTA-UAB en Sanitat Animal, Centre de Recerca en Sanitat Animal (CReSA), Campus de La Universitat Autònoma de Barcelona (UAB)Unitat Mixta d’Investigació IRTA-UAB en Sanitat Animal, Centre de Recerca en Sanitat Animal (CReSA), Campus de La Universitat Autònoma de Barcelona (UAB)Veterinary Diagnostic Laboratory, College of Veterinary Medicine, University of MinnesotaLABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.ALABORATORIOS HIPRA, S.AVeterinary Diagnostic Laboratory, College of Veterinary Medicine, University of MinnesotaAbstract Cranioventral pulmonary consolidation (CVPC) is a common lesion observed in the lungs of slaughtered pigs, often associated with Mycoplasma (M.) hyopneumoniae infection. There is a need to implement simple, fast, and valid CVPC scoring methods. Therefore, this study aimed to compare CVPC scores provided by a computer vision system (CVS; AI DIAGNOS) from lung images obtained at slaughter, with scores assigned by human evaluators. In addition, intra- and inter-evaluator variability were assessed and compared to intra-CVS variability. A total of 1050 dorsal view images of swine lungs were analyzed. Total lung lesion score, lesion score per lung lobe, and percentage of affected lung area were employed as outcomes for the evaluation. The CVS showed moderate accuracy (62–71%) in discriminating between non-lesioned and lesioned lung lobes in all but the diaphragmatic lobes. A low multiclass classification accuracy at the lung lobe level (24–36%) was observed. A moderate to high inter-evaluator variability was noticed depending on the lung lobe, as shown by the intraclass correlation coefficient (ICC: 0.29–0.6). The intra-evaluator variability was low and similar among the different outcomes and lung lobes, although the observed ICC slightly differed among evaluators. In contrast, the CVS scoring was identical per lobe per image. The results of this study suggest that the CVS AI DIAGNOS could be used as an alternative to the manual scoring of CVPC during slaughter inspections due to its accuracy in binary classification and its perfect consistency in the scoring.https://doi.org/10.1186/s13567-024-01432-5Artificial intelligencealgorithmMycoplasma hyopneumoniaecranioventral pulmonary consolidationlunglesions |
spellingShingle | Robert Valeris-Chacin Beatriz Garcia-Morante Marina Sibila Albert Canturri Isaac Ballarà Rodriguez Ignacio Bernal Orozco Ramon Jordà Casadevall Pedro Muñoz Maria Pieters Scoring of swine lung images: a comparison between a computer vision system and human evaluators Veterinary Research Artificial intelligence algorithm Mycoplasma hyopneumoniae cranioventral pulmonary consolidation lung lesions |
title | Scoring of swine lung images: a comparison between a computer vision system and human evaluators |
title_full | Scoring of swine lung images: a comparison between a computer vision system and human evaluators |
title_fullStr | Scoring of swine lung images: a comparison between a computer vision system and human evaluators |
title_full_unstemmed | Scoring of swine lung images: a comparison between a computer vision system and human evaluators |
title_short | Scoring of swine lung images: a comparison between a computer vision system and human evaluators |
title_sort | scoring of swine lung images a comparison between a computer vision system and human evaluators |
topic | Artificial intelligence algorithm Mycoplasma hyopneumoniae cranioventral pulmonary consolidation lung lesions |
url | https://doi.org/10.1186/s13567-024-01432-5 |
work_keys_str_mv | AT robertvalerischacin scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT beatrizgarciamorante scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT marinasibila scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT albertcanturri scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT isaacballararodriguez scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT ignaciobernalorozco scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT ramonjordacasadevall scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT pedromunoz scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators AT mariapieters scoringofswinelungimagesacomparisonbetweenacomputervisionsystemandhumanevaluators |