期刊
ANNALS OF BIOMEDICAL ENGINEERING
卷 49, 期 1, 页码 287-298出版社
SPRINGER
DOI: 10.1007/s10439-020-02538-5
关键词
Augment reality surgical navigation; Surgical telementoring; Medical training; Microsoft HoloLens
资金
- Anhui Province Science and Technology Major Project [17030801004]
- OSUCCC Intramural Research Program Pelotonia Award
This paper introduces a new augmented reality system for medical training and telementored surgery, integrating 3D point tracking and remote guidance. Benchtop experiments and in vivo studies demonstrate the system's performance and clinical applicability.
This paper reports a new type of augmented reality (AR) system that integrates a Microsoft HoloLens device with a three-dimensional (3D) point tracking module for medical training and telementored surgery. In this system, a stereo camera is used to track the 3D position of a scalpel and transfer its coordinates wirelessly to a HoloLens device. In the scenario of surgical training, a virtual surgical scene with pre-recorded surgical annotations is superimposed with the actual surgical scene so that the surgical trainee is able to operate following virtual instructions. In the scenario of telementored surgery, the virtual surgical scene is co-registered with the actual surgical scene so that the virtual scalpel remotely mentored by an experienced surgeon provides the AR guidance for the inexperienced on-site operator. The performance characteristics of the proposed AR telementoring system are verified by benchtop experiments. The clinical applicability of the proposed system in telementored skin grafting surgery and fasciotomy is validated in a New Zealand rabbit model. Our benchtop and in vivo experiments demonstrate the potential to improve surgical performance and reduce healthcare disparities in remote areas with limited resources.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据