A Google Glass navigation system for ultrasound and fluorescence dual-mode image-guided surgery

Zeshu Zhang; Jing Pei; Dong Wang; Chuanzhen Hu; Jian Ye; Qi Gan; Peng Liu; Jian Yue; Benzhong Wang; Pengfei Shao; Stephen P. Povoski; Edward W. Martin Jr.; Alper Yilmaz; Michael F. Tweedle; Ronald X. Xu

doi:10.1117/12.2212250

Translator Disclaimer

7 March 2016 A Google Glass navigation system for ultrasound and fluorescence dual-mode image-guided surgery

Zeshu Zhang, Jing Pei, Dong Wang, Chuanzhen Hu, Jian Ye, Qi Gan, Peng Liu, Jian Yue, Benzhong Wang, Pengfei Shao, Stephen P. Povoski, Edward W. Martin Jr., Alper Yilmaz, Michael F. Tweedle, Ronald X. Xu

Author Affiliations +

Proceedings Volume 9698, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XIV; 96980I (2016) https://doi.org/10.1117/12.2212250
Event: SPIE BiOS, 2016, San Francisco, California, United States

Abstract

Surgical resection remains the primary curative intervention for cancer treatment. However, the occurrence of a residual tumor after resection is very common, leading to the recurrence of the disease and the need for re-resection. We develop a surgical Google Glass navigation system that combines near infrared fluorescent imaging and ultrasonography for intraoperative detection of sites of tumor and assessment of surgical resection boundaries, well as for guiding sentinel lymph node (SLN) mapping and biopsy. The system consists of a monochromatic CCD camera, a computer, a Google Glass wearable headset, an ultrasonic machine and an array of LED light sources. All the above components, except the Google Glass, are connected to a host computer by a USB or HDMI port. Wireless connection is established between the glass and the host computer for image acquisition and data transport tasks. A control program is written in C++ to call OpenCV functions for image calibration, processing and display. The technical feasibility of the system is tested in both tumor simulating phantoms and in a human subject. When the system is used for simulated phantom resection tasks, the tumor boundaries, invisible to the naked eye, can be clearly visualized with the surgical Google Glass navigation system. This system has also been used in an IRB approved protocol in a single patient during SLN mapping and biopsy in the First Affiliated Hospital of Anhui Medical University, demonstrating the ability to successfully localize and resect all apparent SLNs. In summary, our tumor simulating phantom and human subject studies have demonstrated the technical feasibility of successfully using the proposed goggle navigation system during cancer surgery.

Conference Presentation

Citation Download Citation

Zeshu Zhang, Jing Pei, Dong Wang, Chuanzhen Hu, Jian Ye, Qi Gan, Peng Liu, Jian Yue, Benzhong Wang, Pengfei Shao, Stephen P. Povoski, Edward W. Martin Jr., Alper Yilmaz, Michael F. Tweedle, and Ronald X. Xu "A Google Glass navigation system for ultrasound and fluorescence dual-mode image-guided surgery", Proc. SPIE 9698, Advanced Biomedical and Clinical Diagnostic and Surgical Guidance Systems XIV, 96980I (7 March 2016); https://doi.org/10.1117/12.2212250

ACCESS THE FULL ARTICLE