Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery

Hdl Handle:
http://hdl.handle.net/10034/620597
Title:
Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery
Authors:
Chen, Long; Tang, Wen; John, Nigel W.
Abstract:
The potential of Augmented Reality (AR) technology to assist minimally invasive surgeries (MIS) lies in its computational performance and accuracy in dealing with challenging MIS scenes. Even with the latest hardware and software technologies, achieving both real-time and accurate augmented information overlay in MIS is still a formidable task. In this paper, we present a novel real-time AR framework for MIS that achieves interactive geometric aware augmented reality in endoscopic surgery with stereo views. Our framework tracks the movement of the endoscopic camera and simultaneously reconstructs a dense geometric mesh of the MIS scene. The movement of the camera is predicted by minimising the re-projection error to achieve a fast tracking performance, while the 3D mesh is incrementally built by a dense zero mean normalised cross correlation stereo matching method to improve the accuracy of the surface reconstruction. Our proposed system does not require any prior template or pre-operative scan and can infer the geometric information intra-operatively in real-time. With the geometric information available, our proposed AR framework is able to interactively add annotations, localisation of tumours and vessels, and measurement labelling with greater precision and accuracy compared with the state of the art approaches.
Affiliation:
Bournemouth University and University of Chester
Citation:
Chen, L., Tang, W., & John, N. W. (2017-forthcoming). Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery. Healthcare Technology Letters, Special Issue On Augmented Environments for Computer-Assisted Interventions. IET
Publisher:
IET
Journal:
HealthCare Technology Letters
Publication Date:
2017
URI:
http://hdl.handle.net/10034/620597
DOI:
10.1049/htl.2017.0068
Additional Links:
http://digital-library.theiet.org/content/journals/htl?origin=/htl
Type:
Article
Language:
en
Description:
This paper is a postprint of a paper submitted to and accepted for publication in HealthCare Technology Letters and is subject to Institution of Engineering and Technology Copyright. The copy of record is available at the IET Digital Library.
EISSN:
2053-3713
Appears in Collections:
Computer Science

Full metadata record

DC FieldValue Language
dc.contributor.authorChen, Longen
dc.contributor.authorTang, Wenen
dc.contributor.authorJohn, Nigel W.en
dc.date.accessioned2017-08-15T10:20:44Z-
dc.date.available2017-08-15T10:20:44Z-
dc.date.issued2017-
dc.identifier.citationChen, L., Tang, W., & John, N. W. (2017-forthcoming). Real-time Geometry-Aware Augmented Reality in Minimally Invasive Surgery. Healthcare Technology Letters, Special Issue On Augmented Environments for Computer-Assisted Interventions. IETen
dc.identifier.doi10.1049/htl.2017.0068-
dc.identifier.urihttp://hdl.handle.net/10034/620597-
dc.descriptionThis paper is a postprint of a paper submitted to and accepted for publication in HealthCare Technology Letters and is subject to Institution of Engineering and Technology Copyright. The copy of record is available at the IET Digital Library.en
dc.description.abstractThe potential of Augmented Reality (AR) technology to assist minimally invasive surgeries (MIS) lies in its computational performance and accuracy in dealing with challenging MIS scenes. Even with the latest hardware and software technologies, achieving both real-time and accurate augmented information overlay in MIS is still a formidable task. In this paper, we present a novel real-time AR framework for MIS that achieves interactive geometric aware augmented reality in endoscopic surgery with stereo views. Our framework tracks the movement of the endoscopic camera and simultaneously reconstructs a dense geometric mesh of the MIS scene. The movement of the camera is predicted by minimising the re-projection error to achieve a fast tracking performance, while the 3D mesh is incrementally built by a dense zero mean normalised cross correlation stereo matching method to improve the accuracy of the surface reconstruction. Our proposed system does not require any prior template or pre-operative scan and can infer the geometric information intra-operatively in real-time. With the geometric information available, our proposed AR framework is able to interactively add annotations, localisation of tumours and vessels, and measurement labelling with greater precision and accuracy compared with the state of the art approaches.en
dc.language.isoenen
dc.publisherIETen
dc.relation.urlhttp://digital-library.theiet.org/content/journals/htl?origin=/htlen
dc.subjectAugmented Realityen
dc.subjectMinimally Invasive Surgeryen
dc.titleReal-time Geometry-Aware Augmented Reality in Minimally Invasive Surgeryen
dc.typeArticleen
dc.identifier.eissn2053-3713-
dc.contributor.departmentBournemouth University and University of Chesteren
dc.identifier.journalHealthCare Technology Lettersen
dc.date.accepted2017-06-30-
or.grant.openaccessYesen
rioxxterms.funderunfundeden
rioxxterms.identifier.projectunfundeden
rioxxterms.versionAMen
rioxxterms.licenseref.startdate2017-08-03-
This item is licensed under a Creative Commons License
Creative Commons
All Items in ChesterRep are protected by copyright, with all rights reserved, unless otherwise indicated.