Ilung: Interactive Holographic Medical Application for Lung CT Scans Using Hololens

  • Authors

    • Aala Al Khayer
    • Evi Indriasari Mansor
    2018-12-09
    https://doi.org/10.14419/ijet.v7i4.31.23720
  • Hologram, CT scans, Microsoft HoloLens, Medical Application, 3D modeling.

  • Abstract

    This research aims to design a holographic medical application for lung CT scans using Microsoft HoloLens. iLung application offers users the possibility to interact with the actual lung of a patient in a mixed reality and 3D environment. A prototype of the iLung was developed based on raw CT scans data and converted into 3D model generation. This paper reports the earlier stage in designing the application. Based on the application’s overview with a group of users, the findings gathered showed that iLung prototype facilitates interactive manipulation and exploring of the 3D lung object. Feedback and comments were recorded for future improvements such as air taping interaction method and voice command.

     

     

     

  • References

    1. [1] Yang, Jinzhong; Sharp, Greg; Veeraraghavan, Harini ; van Elmpt, Wouter ; Dekker, Andre; Lustberg, Tim; Gooding, Mark, Data from Lung CT Segmentation Challenge, The Cancer Imaging Archive. (2017). http://doi.org/10.7937/K9/TCIA.2017.3r3fvz08

      [2] Clark K, Vendt B , Smith K , Freymann J, Kirby J, Koppel P, Moore P, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F, “The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository†Journal of Digital Imaging, Vol.26, Nom.6, (2013), pp:1045-1057.

      [3] Wang W, Wu X, Chen G, & Chen Z, “Holo3DGIS: Leveraging Microsoft HoloLens in 3D Geographic Information†ISPRS International Journal of Geo-Information, Vol. 7, Nom. 2, (2018), doi:10.3390/ijgi7020060

      [4] Chandar K, & Satyasavithri T, “Segmentation and 3D Visualization of Pelvic Bone from CT Scan Images†IEEE 6th International Conference on Advanced Computing (IACC), (2016), pp:430-433, doi:10.1109/iacc.2016.86

      [5] Trabelsi N, Aloui K, & Sellem DB, “3D active shape model for CT-scan liver segmentationâ€, International Conference on Information and Digital Technologies (IDT), (2017). doi:10.1109/dt.2017.8012093

      [6] Domínguez GM, Hernández C, Ruisoto P, Juanes AJ, Prats A, & Hernández A, “Application of the 3D slicer software in the study of the brains ventricular systemâ€, Proceedings of the 3rd International Conference on Technological Ecosystems for Enhancing Multiculturality - TEEM, (2015), pp: 31-37, doi:10.1145/2808580.2808586

      [7] Guhl J, Tung S, & Kruger J, “Concept and architecture for programming industrial robots using augmented reality with mobile devices like microsoft HoloLensâ€, IEEE International Conference on Emerging Technologies and Factory Automation (ETFA). (2017). doi:10.1109/etfa.2017.8247749

      [8] Nguyen H, Ketchell S, Engelke U, Thomas HB, & Souza DP, “Augmented Reality Based Bee Drift Analysis: A User Studyâ€, International Symposium on Big Data Visual Analytics (BDVA), (2017) doi:10.1109/bdva.2017.8114581.

      [9] Garon M, Boulet P, Doironz J, Beaulieu L, & Lalonde L, “Real-Time High Resolution 3D Data on the HoloLensâ€. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2016), doi:10.1109/ismar-adjunct.2016.0073.

      [10] Widmer A, Schaer R, Markonis D, Muller H, “Facilitating medical information search using Google Glass connected to a content-based medical image retrieval systemâ€. 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, (2014), doi:10.1109/embc.2014.6944625.

      [11] Kowalsk M, Nasarzewski Z, Galinski G, Garbat P, “HoloFace: Augmenting Human-to-Human Interactions on HoloLensâ€. IEEE Winter Conference on Applications of Computer Vision (WACV), (2018). doi:10.1109/wacv.2018.00022.

      [12] Xie T, Islam MM, Lumsden BM, Kakadiaris AI. “Holographic iRay: Exploring Augmentation for Medical Applicationsâ€. IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), (2017), doi:10.1109/ismar-adjunct.2017.73

      [13] Kopf J, Fu C, Cohen-Or D, Deussen O, Lischinski D, Wong T, “Solid texture synthesis from 2D exemplars†ACM SIGGRAPH 2007 Papers on - SIGGRAPH 07, (2007), doi:10.1145/1275808.1276380.

      [14] Abada L, Aouat D, “Enhanced variational approach by Fast-Marching to recover a 3D shape from shading†Proceedings of the 20th International Database Engineering & Applications Symposium on - IDEAS 16, (2016), doi:10.1145/2938503.2938504.

      [15] Mujika MK, Méndez AJ, Miguel FA, “Workstation versus Free Open Source Software in radiologyâ€. Proceedings of the 5th International Conference on Technological Ecosystems for Enhancing Multiculturality – TEEM, (2017), doi:10.1145/3144826.3145411

  • Downloads

  • How to Cite

    Al Khayer, A., & Indriasari Mansor, E. (2018). Ilung: Interactive Holographic Medical Application for Lung CT Scans Using Hololens. International Journal of Engineering & Technology, 7(4.31), 408-413. https://doi.org/10.14419/ijet.v7i4.31.23720

    Received date: 2018-12-12

    Accepted date: 2018-12-12

    Published date: 2018-12-09