CRF-based model for instrument detection and pose estimation in retinal microsurgery
Summary: Detection of instrument tip in retinal microsurgery videos is extremely challenging due to rapid motion, illumination changes, the cluttered background, and the deformable shape of the instrument. For the same reason, frequent failures in tracking add the overhead of reinitialization of the tracking. In this work, a new method is proposed to localize not only the instrument center point but also its tips and orientation without the need of manual reinitialization. Our approach models the instrument as a conditional random field (CRF) where each part of the instrument is detected separately. The relations between these parts are modeled to capture the translation, rotation, and the scale changes of the instrument. The tracking is done via separate detection of instrument parts and evaluation of confidence via the modeled dependence functions. In case of low confidence feedback an automatic recovery process is performed. The algorithm is evaluated on in vivo ophthalmic surgery datasets and its performance is comparable to the state-of-the-art methods with the advantage that no manual reinitialization is needed.
- scientific article; zbMATH DE number 2018100
- Automatic positioning of surgical instruments during laparoscopic surgery with robots using automatic visual feedback
- Application of visual tracking for robot-assisted laparoscopic surgery
- Pipette Hunter 3D: fluorescent micropipette detection
- scientific article; zbMATH DE number 2043567
This page was built for publication: CRF-based model for instrument detection and pose estimation in retinal microsurgery
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2011724)