An augmented reality system to enhance facial expressions recognision in autistic children

  • Authors

    • Hawar Bahzad Ahmad Computer science
    2019-11-21
    https://doi.org/10.14419/jacst.v8i2.29873
  • Augmented Reality, ASC, Vuforia, Facial Expression.

  • Abstract

    In the past decade, Augmented Reality (AR) has been applied in several professional practice areas, including but not limited to autism therapy. AR supplies virtual information to the visual perceptions of users, giving the user new tools to ensure that knowledge for many processes and in many environments are comprehended efficiently. Usually, AR applications depend on virtual reality headset (VR-box) to overlay virtual objects and text on the surrounding environment of the user.
    People with autism spectrum condition (ASC) especially children are often found lacking in social interaction, including facial expres-sion and understanding of other minds which make social communication more difficult for them. This paper aims to use AR system to assist children with (ASC) in better understanding facial expressions by overlaying suggested 3d objects over the physical environment. Results of AR treatment found higher engagement and more effective compare to a non-AR system.
    This paper utilizes Vuforia to create an AR environment for the treatment of children with ASC. Vuforia is a software development kit that provides AR capabilities to smartphone devices.

  • References

    1. [1] Denis Kalkofen, Christian Sandor, Sean White, and Dieter Schmalstieg. Visualization Techniques for Augmented Reality. B. Furht (ed.), Handbook of Augmented Reality, © Springer Science+Business Media, LLC 2011. https://doi.org/10.1007/978-1-4614-0064-6_3.
      [2] Shaun M Eack, Carla A Mazefsky, Nancy J Minshew. Misinterpretation of facial expressions of emotion in verbal adults with autism spectrum disorder. Volume: 19 issue: 3, page(s): 308-315 Article first published online: February 17, 2014; Issue published: University of Pittsburgh, USA. April 1, 2015. https://doi.org/10.1177/1362361314520755.
      [3] K. Conallen and P. Reed, "A teaching procedure to help children with autistic spectrum disorder to label emotions", Research in Autism Spectrum Disorders, vol. 23, pp. 63-72, 2016. Available: 10.1016/j.rasd.2015.11.006. https://doi.org/10.1016/j.rasd.2015.11.006.
      [4] O. Golan et al., "Enhancing Emotion Recognition in Children with Autism Spectrum Conditions: An Intervention Using Animated Vehicles with Real Emotional Faces", Journal of Autism and Developmental Disorders, vol. 40, no. 3, pp. 269-279, 2009. Available: 10.1007/s10803-009-0862-9 https://doi.org/10.1007/s10803-009-0862-9.
      [5] N. S. Lakshmiprabha, A. Santos, D. Mladenov and O. Beltramello, "[Poster] An augmented and virtual reality system for training autistic children," 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, 2014, pp. 277-278. https://doi.org/10.1109/ISMAR.2014.6948448.
      [6] Teaching Aids for Children with Special Needs - Educate Autism", Educateautism.com, 2019. [Online]. Available: http://www.educateautism.com/. [Accessed: 14- Jan- 2019].
      [7] "Oculus Unity Getting Started Guide", Developer.oculus.com, 2019. [Online]. Available: https://developer.oculus.com/documentation/unity/latest/concepts/book-unity-gsg/. [Accessed: 04- Jan- 2019].
      [8] Herrera, G., Alcantud, F., Jordan, R., Blanquer, A., Labajo, G. and Pablo C.D. Development of symbolic play through the use of virtual reality tools in children with autistic spectrum disorders. Autism 12, 2 (2008), 143-157. https://doi.org/10.1177/1362361307086657.
      [9] Tartaro, A. and Cassell, J. Authorable virtual peers for autism spectrum disorders. In Combined Workshop on ECAI 2006. (8) https://doi.org/10.1145/1240866.1240881.
      [10] Z. Bai, A. F. Blackwell and G. Coulouris, "Through the looking glass: Pretend play for children with autism," 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Adelaide, SA, 2013, pp. 49-58. https://doi.org/10.1109/ISMAR.2013.6671763.
      [11] Z. Bai, A. Blackwell and G. Coulouris, "Using Augmented Reality to Elicit Pretend Play for Children with Autism", IEEE Transactions on Visualization and Computer Graphics, vol. 21, no. 5, pp. 598-610, 2015. Available: 10.1109/tvcg.2014.2385092. https://doi.org/10.1109/TVCG.2014.2385092.
      [12] A. Hani Alkurdi, "VR Mobile Acrophobia Treatment", Academic Journal of Nawroz University, vol. 6, no. 3, pp. 124-128, 2017. Available: 10.25007/ajnu.v6n3a95. (12)
      [13] "Polygonal Modeling | Maya 2016 | Autodesk Knowledge Network", Knowledge.autodesk.com, 2019. [Online]. Available: https://knowledge.autodesk.com/support/maya/learn explore/caas/CloudHelp/
      [14] Cloudhelp/2016/ENU/Maya/files/GUID-7941F97A-36E8-47FE-95D1-71412A3B3017-htm. [Accessed: 05- Nov- 2018].
      [15] "Unity - Multiplatform - Unity", Unity, 2019. [Online]. Available: https://unity3d.com/unity/features/multiplatform. [Accessed: 02- Jan- 2019].
      [16] T. Krogh-Jacobsen, "Introducing Unity 2018.3 – Unity Blog", Unity Technologies Blog, 2019. [Online]. Available: https://blogs.unity3d.com/2018/12/13/introducing-unity-2018-3/. [Accessed: 13- Des- 2018].
      [17] P. Ekman, "Are there basic emotions?†Psychological Review, vol. 99, no. 3, pp. 550-553, 1992. Available: 10.1037/0033-295x.99.3.550 [Accessed 14 August 2018]. https://doi.org/10.1037//0033-295X.99.3.550.
      [18] "Getting Started with Vuforia Engine in Unity", Library.vuforia.com, 2019. [Online]. Available: https://library.vuforia.com/articles/Training/getting-started-with-vuforia-in-unity.html. [Accessed: 11- Sep- 2018].
      [19] "How To Use the Trackable Base Class", Library.vuforia.com, 2019. [Online]. Available: https://library.vuforia.com/articles/Solution/How-To-Use-the-Trackable-Base-Class.html. [Accessed: 17- Sep- 2018].
      [20] H. Alkurdi, A. (2019). Augmented Reality Electric Circuit Experiment. 2019 International Conference On Advanced Science And Engineering (ICOASE). https://doi.org/10.1109/ICOASE.2019.8723683.

  • Downloads

  • How to Cite

    Bahzad Ahmad, H. (2019). An augmented reality system to enhance facial expressions recognision in autistic children. Journal of Advanced Computer Science & Technology (JACST), 8(2), 46-49. https://doi.org/10.14419/jacst.v8i2.29873

    Received date: 2019-09-16

    Accepted date: 2019-10-24

    Published date: 2019-11-21