Ilung: Interactive Holographic Medical Application for Lung CT Scans Using Hololens

 
 
 
  • Abstract
  • Keywords
  • References
  • PDF
  • Abstract


    This research aims to design a holographic medical application for lung CT scans using Microsoft HoloLens. iLung application offers users the possibility to interact with the actual lung of a patient in a mixed reality and 3D environment. A prototype of the iLung was developed based on raw CT scans data and converted into 3D model generation. This paper reports the earlier stage in designing the application. Based on the application’s overview with a group of users, the findings gathered showed that iLung prototype facilitates interactive manipulation and exploring of the 3D lung object. Feedback and comments were recorded for future improvements such as air taping interaction method and voice command.

     

     

     

  • Keywords


    Hologram, CT scans, Microsoft HoloLens, Medical Application, 3D modeling.

  • References


      [1] Yang, Jinzhong; Sharp, Greg; Veeraraghavan, Harini ; van Elmpt, Wouter ; Dekker, Andre; Lustberg, Tim; Gooding, Mark, Data from Lung CT Segmentation Challenge, The Cancer Imaging Archive. (2017). http://doi.org/10.7937/K9/TCIA.2017.3r3fvz08

      [2] Clark K, Vendt B , Smith K , Freymann J, Kirby J, Koppel P, Moore P, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F, “The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository” Journal of Digital Imaging, Vol.26, Nom.6, (2013), pp:1045-1057.

      [3] Wang W, Wu X, Chen G, & Chen Z, “Holo3DGIS: Leveraging Microsoft HoloLens in 3D Geographic Information” ISPRS International Journal of Geo-Information, Vol. 7, Nom. 2, (2018), doi:10.3390/ijgi7020060

      [4] Chandar K, & Satyasavithri T, “Segmentation and 3D Visualization of Pelvic Bone from CT Scan Images” IEEE 6th International Conference on Advanced Computing (IACC), (2016), pp:430-433, doi:10.1109/iacc.2016.86

      [5] Trabelsi N, Aloui K, & Sellem DB, “3D active shape model for CT-scan liver segmentation”, International Conference on Information and Digital Technologies (IDT), (2017). doi:10.1109/dt.2017.8012093

      [6] Domínguez GM, Hernández C, Ruisoto P, Juanes AJ, Prats A, & Hernández A, “Application of the 3D slicer software in the study of the brains ventricular system”, Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing Multiculturality - TEEM, (2015), pp: 31-37, doi:10.1145/2808580.2808586

      [7] Guhl J, Tung S, & Kruger J, “Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLens”, IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). (2017). doi:10.1109/etfa.2017.8247749

      [8] Nguyen H, Ketchell S, Engelke U, Thomas HB, & Souza DP, “Augmented Reality Based Bee Drift Analysis: A User Study”, International Symposium on Big Data Visual Analytics (BDVA), (2017) doi:10.1109/bdva.2017.8114581.

      [9] Garon M, Boulet P, Doironz J, Beaulieu L, & Lalonde L, “Real-Time High Resolution 3D Data on the HoloLens”. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2016), doi:10.1109/ismar-adjunct.2016.0073.

      [10] Widmer A, Schaer R, Markonis D, Muller H, “Facilitating medical information search using Google Glass connected to a content-based medical image retrieval system”. 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (2014), doi:10.1109/embc.2014.6944625.

      [11] Kowalsk M, Nasarzewski Z, Galinski G, Garbat P, “HoloFace: Augmenting Human-to-Human Interactions on HoloLens”. IEEE Winter Conference on Applications of Computer Vision (WACV), (2018). doi:10.1109/wacv.2018.00022.

      [12] Xie T, Islam MM, Lumsden BM, Kakadiaris AI. “Holographic iRay: Exploring Augmentation for Medical Applications”. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2017), doi:10.1109/ismar-adjunct.2017.73

      [13] Kopf J, Fu C, Cohen-Or D, Deussen O, Lischinski D, Wong T, “Solid texture synthesis from 2D exemplars” ACM SIGGRAPH 2007 Papers on - SIGGRAPH 07, (2007), doi:10.1145/1275808.1276380.

      [14] Abada L, Aouat D, “Enhanced variational approach by Fast-Marching to recover a 3D shape from shading” Proceedings of the 20th International Database Engineering & Applications Symposium on - IDEAS 16, (2016), doi:10.1145/2938503.2938504.

      [15] Mujika MK, Méndez AJ, Miguel FA, “Workstation versus Free Open Source Software in radiology”. Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality – TEEM, (2017), doi:10.1145/3144826.3145411


 

View

Download

Article ID: 23720
 
DOI: 10.14419/ijet.v7i4.31.23720




Copyright © 2012-2015 Science Publishing Corporation Inc. All rights reserved.