Publication:
Computer-Assisted Intervention in Capsule Endoscopy: A Real-Time Edge-AI Auditing System
| dc.contributor.author | Bravo, Diego | |
| dc.contributor.author | Ruano-Balseca, Josue | |
| dc.contributor.author | Gonzalez, Fabio A. | |
| dc.contributor.author | Romero, Eduardo | |
| dc.date.accessioned | 2026-11-16T13:49:38Z | |
| dc.date.available | 2026-11-16T13:49:38Z | |
| dc.date.createdwos | 2026 | |
| dc.date.issued | 2027 | |
| dc.description.abstract | Video capsule endoscopy (VCE) is the preferred first-line modality for visualizing the small bowel mucosa and evaluating obscure gastrointestinal bleeding. However, each examination generates over 50 thousand frames, making manual review time-consuming and prone to missed findings and inter-observer variability. Most AI systems rely on single-frame analysis, overlooking temporal dynamics and limiting their ability to distinguish anatomical transitions from transient artifacts. We propose a real-time auditing framework that jointly identifies the anatomical region along the gastrointestinal tract and detects anomalies through intrinsic temporal modeling. Consecutive frames are encoded using an endoscopy-pretrained CNN and processed by a lightweight Vision Transformer operating in a sequence-to-sequence manner, enabling frame-level predictions without post-processing. Evaluated on the multi-center Galar dataset ( 3.5 million frames), the proposed system achieves a macro F1-score of 90% for anatomical classification and 67% macro recall for binary anomaly detection within a unified multi-task learning framework, outperforming prior frame-wise approaches. Deployment on a low-power edge device confirms real-time performance (30.5 ms per frame, 33 FPS), enabling continuous monitoring of incomplete procedures, capsule retention, and persistent abnormalities. Our code is available at https://github.com/DiegoBravoH/CapsuleAudit. | |
| dc.identifier.doi | 10.1007/978-3-032-38236-8_13 | |
| dc.identifier.isbn | 978-3-032-38235-1 | |
| dc.identifier.issn | 0302-9743 | |
| dc.identifier.uri | https://imec-publications.be/handle/20.500.12860/60809 | |
| dc.language.iso | eng | |
| dc.provenance.editstepuser | greet.vanhoof@imec.be | |
| dc.publisher | SPRINGER INTERNATIONAL PUBLISHING AG | |
| dc.source.beginpage | 127 | |
| dc.source.conference | Medical Image Computing and Computer Assisted Intervention – MICCAI | |
| dc.source.conferencedate | 2026-09-27 | |
| dc.source.conferencelocation | Strasbourg | |
| dc.source.endpage | 137 | |
| dc.source.journal | MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2026, PT XVI | |
| dc.source.numberofpages | 11 | |
| dc.title | Computer-Assisted Intervention in Capsule Endoscopy: A Real-Time Edge-AI Auditing System | |
| dc.type | Proceedings paper | |
| dspace.entity.type | Publication | |
| imec.internal.crawledAt | 2026-11-15 | |
| imec.internal.source | crawler | |
| imec.internal.wosCreatedAt | 2026-11-15 | |
| Files | ||
| Publication available in collections: |