Predicting the generalization of computer aided detection (CADe) models for colonoscopy

Abstract Generalizability of AI colonoscopy algorithms is important for wider adoption in clinical practice. However, current techniques for evaluating performance on unseen data require expensive and time-intensive labels. We show that a "Masked Siamese Network" (MSN), trained to predict...

Full description

Saved in:
Bibliographic Details
Main Authors: Joel Shor, Carson McNeil, Yotam Intrator, Joseph R. Ledsam, Hiro-o Yamano, Daisuke Tsurumaru, Hiroki Kayama, Atsushi Hamabe, Koji Ando, Mitsuhiko Ota, Haruei Ogino, Hiroshi Nakase, Kaho Kobayashi, Masaaki Miyo, Eiji Oki, Ichiro Takemasa, Ehud Rivlin, Roman Goldenberg
Format: Article
Language:English
Published: Springer 2024-11-01
Series:Discover Artificial Intelligence
Subjects:
Online Access:https://doi.org/10.1007/s44163-024-00187-4
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Generalizability of AI colonoscopy algorithms is important for wider adoption in clinical practice. However, current techniques for evaluating performance on unseen data require expensive and time-intensive labels. We show that a "Masked Siamese Network" (MSN), trained to predict masked out regions of polyp images without labels, can predict the performance of Computer Aided Detection (CADe) of polyps on colonoscopies, without labels. This holds on Japanese colonoscopies even when MSN is only trained on Israeli colonoscopies, which differ in scoping hardware, endoscope software, screening guidelines, bowel preparation, patient demographics, and the use of techniques such as narrow-band imaging (NBI) and chromoendoscopy (CE). Since our technique uses neither colonoscopy-specific information nor labels, it has the potential to apply to more medical imaging domains.
ISSN:2731-0809