Mixed Reality system to study deformable objects: Breast Cancer application

Abstract

A significant amount of women who go through a breast cancer conservative surgery to treat early stage breast cancer undergo a repeat surgery due to concerns that residual tumor was left behind. To avoid this, tumor localization is needed to assist the surgeon in order to determine tumor extent and also, it is critical to account for tissue deformations. For these reasons, new navigation systems, like the one proposed on this project, are emerging to cover those needs. This project focuses on the use of a Mixed Reality system to improve the accuracy in placing the static hologram of the tumor and, to implement a dynamical hologram when deformation takes place. In order to do so, two different molds with objects inside have been manufactured. Next, two different approaches were considered, a mathematical approach to create a 3D CAD model of the molds and a medical approach, which consisted in performing a CT and then, segment the images. The models were post-processed and imported to the HoloLens head-mounted display. The system was tested on the molds and on a breast phantom provided by the Hospital Clinic. The results obtained were encouraging and although some things need to be improved, this exciting new use for Augmented Reality has the potential to improve the lives of many patients.