Publication:
Computer-Assisted Intervention in Capsule Endoscopy: A Real-Time Edge-AI Auditing System
Date
2027
Proceedings Paper
Loading...
Journal
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2026, PT XVI
Abstract
Video capsule endoscopy (VCE) is the preferred first-line modality for visualizing the small bowel mucosa and evaluating obscure gastrointestinal bleeding. However, each examination generates over 50 thousand frames, making manual review time-consuming and prone to missed findings and inter-observer variability. Most AI systems rely on single-frame analysis, overlooking temporal dynamics and limiting their ability to distinguish anatomical transitions from transient artifacts. We propose a real-time auditing framework that jointly identifies the anatomical region along the gastrointestinal tract and detects anomalies through intrinsic temporal modeling. Consecutive frames are encoded using an endoscopy-pretrained CNN and processed by a lightweight Vision Transformer operating in a sequence-to-sequence manner, enabling frame-level predictions without post-processing. Evaluated on the multi-center Galar dataset (
3.5 million frames), the proposed system achieves a macro F1-score of 90% for anatomical classification and 67% macro recall for binary anomaly detection within a unified multi-task learning framework, outperforming prior frame-wise approaches. Deployment on a low-power edge device confirms real-time performance (30.5 ms per frame,
33 FPS), enabling continuous monitoring of incomplete procedures, capsule retention, and persistent abnormalities. Our code is available at https://github.com/DiegoBravoH/CapsuleAudit.