Publication:

Computer-Assisted Intervention in Capsule Endoscopy: A Real-Time Edge-AI Auditing System

 
dc.contributor.authorBravo, Diego
dc.contributor.authorRuano-Balseca, Josue
dc.contributor.authorGonzalez, Fabio A.
dc.contributor.authorRomero, Eduardo
dc.date.accessioned2026-11-16T13:49:38Z
dc.date.available2026-11-16T13:49:38Z
dc.date.createdwos2026
dc.date.issued2027
dc.description.abstractVideo capsule endoscopy (VCE) is the preferred first-line modality for visualizing the small bowel mucosa and evaluating obscure gastrointestinal bleeding. However, each examination generates over 50 thousand frames, making manual review time-consuming and prone to missed findings and inter-observer variability. Most AI systems rely on single-frame analysis, overlooking temporal dynamics and limiting their ability to distinguish anatomical transitions from transient artifacts. We propose a real-time auditing framework that jointly identifies the anatomical region along the gastrointestinal tract and detects anomalies through intrinsic temporal modeling. Consecutive frames are encoded using an endoscopy-pretrained CNN and processed by a lightweight Vision Transformer operating in a sequence-to-sequence manner, enabling frame-level predictions without post-processing. Evaluated on the multi-center Galar dataset ( 3.5 million frames), the proposed system achieves a macro F1-score of 90% for anatomical classification and 67% macro recall for binary anomaly detection within a unified multi-task learning framework, outperforming prior frame-wise approaches. Deployment on a low-power edge device confirms real-time performance (30.5 ms per frame, 33 FPS), enabling continuous monitoring of incomplete procedures, capsule retention, and persistent abnormalities. Our code is available at https://github.com/DiegoBravoH/CapsuleAudit.
dc.identifier.doi10.1007/978-3-032-38236-8_13
dc.identifier.isbn978-3-032-38235-1
dc.identifier.issn0302-9743
dc.identifier.urihttps://imec-publications.be/handle/20.500.12860/60809
dc.language.isoeng
dc.provenance.editstepusergreet.vanhoof@imec.be
dc.publisherSPRINGER INTERNATIONAL PUBLISHING AG
dc.source.beginpage127
dc.source.conferenceMedical Image Computing and Computer Assisted Intervention – MICCAI
dc.source.conferencedate2026-09-27
dc.source.conferencelocationStrasbourg
dc.source.endpage137
dc.source.journalMEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2026, PT XVI
dc.source.numberofpages11
dc.title

Computer-Assisted Intervention in Capsule Endoscopy: A Real-Time Edge-AI Auditing System

dc.typeProceedings paper
dspace.entity.typePublication
imec.internal.crawledAt2026-11-15
imec.internal.sourcecrawler
imec.internal.wosCreatedAt2026-11-15
Files
Publication available in collections: