Facial emotion detection technology: concept, marketing applications, business drivers and challenges

  • Authors

    • Joshi Sujata
    • Damle Madhavi
    • Kumar Vishal
    2018-03-01
    https://doi.org/10.14419/ijet.v7i1.9.9753
  • .

  • Abstract

    The manuscript should contain an abstract. The abstract should be self-contained and citation-free and should not exceed 200 words. The abstract should state the purpose, approach, results and conclusions of the work.The author should assume that the reader has some knowledge of the subject but has not read the paper. Thus, the abstract should be intelligible and complete in it-self (no numerical references); it should not cite figures, tables, or sections of the paper. The abstract should be written using third person instead of first person.

  • References

    1. [1] Marketsandmarkets.com report. Emotion Detection and Recognition Market by Technology (Bio-Sensor, NLP, Machine Learning), Software Tool (Facial Expression, Voice Recognition), Service, Application Area, End User, and Region - Global Forecast to 2021 December (2016). Retrieved on 19th December 2017 from https://www.marketsandmarkets.com/Market-Reports/emotion-detection-recognition-market-23376176.html.

      [2] Lawlor, Terry. Facial Recognition in Retail Market Research the Next Big Thing? February 14th 2017. Retrieved on 19th December (2017) from https://www.chainstoreage.com/article/facial-recognition-retail-market-research-next-big-thing/

      [3] Rick Miller .Understanding Consumers’ Emotional Fingerprint: Why Sentiment Is Misleading. March 27th (2015).

      Retrieved on 19th December 2017 from https://marketingland.com/understanding-consumers-emotional-fingerprint-sentiment-misleading-122267.

      [4] Bebawy, M. Anwar, S. Milanova, M .Active Shape Model vs. Deep Learning for Facial Emotion Recognition in Security, Cham Switzerland; Cancun Mexico: Springer International, Switzerland, pp. 1-11, (2017).

      [5] K. Matsumura, Y. Nakamura, and K. Matsui, “Mathematical representation and image generation of human faces by metamorphosis,†Electron.Commun. Jpn. vol. 80, pp. 36–46, (1997). https://doi.org/10.1002/(SICI)1520-6440(199701)80:1<36::AID-ECJC4>3.0.CO;2-5.

      [6] M. Pantic and L. J. M. Rothkrantz, “Automatic analysis of facial expressions: the state of the art,†IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, pp. 1424–1445, (2000).https://doi.org/10.1109/34.895976.

      [7] Kong, S. G., Heo, J., Abidi, B. R., Paik, J., &Abidi, M. A. Recent advances in visual and infrared face recognition - A review. Computer Vision and Image Understanding, 97(1), 103–135, (2005). https://doi.org/10.1016/j.cviu.2004.04.001.

      [8] Gregory Ware (Digital Marketing Blog).How Emotion-Detection Technology Will Change Marketing. ?. October 17th (2017). Retrieved on 19th December 2017 from https://gregorycware.wordpress.com/tag/hubspot-marketing-blog/page/87/.

      [9] A. Samal, P.A. Iyengar Automatic recognition and analysis of human faces and facial expressions: a survey, Patt. Recogn. 25 (1), 65–77, (1992).https://doi.org/10.1016/0031-3203(92)90007-6.

      [10] D. Valentin, H. Abdi, A.J. O_Toole, G.W. Cottrell, Connectionist models of face processing: a survey, Patt. Recogn. 27 (9), 1209–1230, (1994).https://doi.org/10.1016/0031-3203(94)90006-X.

      [11] R. Chellappa, C.L. Wilson, S. Sirohey, Human and machine recognition of faces: a survey, Proc.IEEE 83 (5) 705–740, (1995).https://doi.org/10.1109/5.381842.

      [12] J. Zhang, Y. Yan, M. Lades, Face recognition: Eigen face, elastic matching, and neural nets, Proc.IEEE 85 (9), 1423–1435, (1997).https://doi.org/10.1109/5.628712.

      [13] Seong G. Kong, JinguHeo, Besma R. Abidi, Joonki Paik, and Mongi A. Abidi (2004). Recent advances in visual and infrared Face recognition—a review. Computer Vision and Image Understanding 97,103–135, (2005).https://doi.org/10.1016/j.cviu.2004.04.001.

      [14] Yeasin, M., Bullot, B., & Sharma, R. Recognition of facial expressions and measurement of levels of interest from video. IEEE Transactions on Multimedia. https://doi.org/10.1109/TMM.2006.870737.

      [15] Shergill et al .Computerized Sales Assistants: The Application of Computer Technology to Measure Consumer Interest – A Conceptual Framework. Journal of Electronic Commerce Research, VOL 9, NO 2, (2008).

      [16] Consoli, D. Emotions that Influence Purchase Decisions and their Electronic Processing. Annales UniversitatisApulensis Series Oeconomica, 11(2), pp 996–1008, (2009).

      [17] Klaus R. Scherer and Ursula Scherer. Assessing the Ability to Recognize Facial and Vocal Expressions of Emotion: Construction and Validation of the Emotion Recognition Index. Nonverbal Behavhttps://doi.org/10.1007/s10919-011-0115-4.

      [18] Fuji Ren and Changqin Quan. Linguistic-based emotion analysis and recognition for measuring Consumer satisfaction: an application of affective computing. InfTechnolManag(2012) 13:321–332.

      [19] Aleix Martinez and Shichuan Du. Model of the Perception of Facial Expressions of Emotion by Humans: Research Overview and Perspectives. Journal of Machine Learning Research 13 (2012) 1589-1608, (2012).

      [20] Marketing Research Association whitepaper. The Marketing Research Applications of Facial Recognition Technology. (February 06, 2014). Retrieved on 21t December 2017 from https://www.insightsassociation.org/sites/default/files/misc_files/mra_facial-recognition-mr-applications_2-6-14.pdf.

      [21] Jan R. Landwehr, Ann L. McGill, & Andreas Herrmann. It’s got the Look: The Effect of Friendly and Aggressive “Facial†Expressions on Product Liking and Sales. Journal of MarketingVol. 75 (May 2011), 132 –146, (2016).

      [22] P.M.A. Desmet (in press). Measuring Emotions. To be published in: M.A. Blythe, A.F. Monk, K. Overbeeke, & P.C. Wright (Eds.), Funology: from usability to enjoyment.

      [23] Darwin, C. The expression of emotion in man and animals. New York: Oxford University Press. (1872). https://doi.org/10.1037/10001-000.

      [24] Tomkins, S. S., & McCarter, R. What and where are the primary affects? Some evidence for a theory. Perceptual and Motor Skills, 18(1), 119-158, (1964).https://doi.org/10.2466/pms.1964.18.1.119.

      [25] Ekman, P. Universal and cultural differences in facial expression of emotion. In J. R. Cole (Ed.), Nebraska Symposium on Motivation, Vol. 19, pp. 207-283. Lincoln, NE: Nebraska University Press, (1971).

      [26] Ekman, P. (Ed.). Darwin and facial expression; a century of research in review. New York: Academic Press, (1973).

      [27] Ekman, P., & Friesen, W. V. Constants across culture in the face and emotion. Journal of Personality and Social Psychology, 17, 124-129, (1971).https://doi.org/10.1037/h0030377.

      [28] Ekman, P., Sorenson, E. R., & Friesen, W. V. Pan cultural elements in facial displays of emotion. Science, 164(3875), 86-88, (1969).https://doi.org/10.1126/science.164.3875.86.

      [29] P. Ekman and W.V. Friesen, “Manual for the Facial Action Coding System,†Consulting Psychologists Press, (1977).

      [30] Nielsen’s press room blog. Facial Expression Analysis: The Complete Pocket Guide. February 19th (2016). Retrieved on 21st December 2017 from https://imotions.com/blog/facial-expression-analysis/.

      [31] Nielsen (Article). Nielsen Consumer Neuroscience Unveils Trailblazing Ad Testing Solution. Jun 13, (2016). Retrieved on 21st December 2017 from https://www.prnewswire.com/news-releases/nielsen-consumer-neuroscience-unveils-trailblazing-ad-testing-solution-300283682.html

      [32] A. R. Damasio. Descartes’ Error: Emotion, Reason, and the Human Brain. G. P. Putnam’s Sons, New York, (1995).

      [33] K.L. Schmidt and J.F. Cohn. Human facial expressions as adaptations: Evolutionary questions in facial expression. Yearbook of Physical Anthropology, 44:3–24, (2001).https://doi.org/10.1002/ajpa.20001.

      [34] P. Ekman, W. Friesen, Facial Action Coding System, Consulting Psychologists Press, Palo Alto, Calif., (1977).

      [35] Ann Iren Jamtøy (Working paper). “Emotion and cognition in political communicationâ€. Paper for the 3rd International Conference on Democracy as Idea and Practice, Oslo, 12-13 January (2012). Retrieved on 21st December 2017 from http://www.uio.no/english/research/interfaculty-research-areas/democracy/news-and-events/events/conferences/2012/papers-2012/Jamtoey.-wshop1pdf.pdf

      [36] Imotions Pocket Guide. Facial Expression Analysis. (2016). Retrieved on 21st December 2017 from https://imotions.com/wp-content/uploads/Guides/iMotions_Guide_FacialExpressions_2016.pdf

      [37] Shapiro Tom (Blog). How Emotion-Detection Technology Will Change Marketing. October 5, (2017). Retrieved December 20, 2017, from https://blog.hubspot.com/marketing/emotion-detection-technology-marketing

      [38] Miller Claire Cain (Article). Google Bases a Campaign on Emotions, Not Terms.January 1 (2012). Retrieved on 23rd December 2017 from http://www.nytimes.com/2012/01/02/technology/google-hones-its-advertising-message-playing-to-emotions.html.

      [39] Brandt David (Article). Emotions Give Lift to Advertising. (2016). Retrieved on 24th December 2016 from http://www.nielsen.com/content/dam/nielsenglobal/us/docs/solutions/emotions-give-a-lift-to-advertising.pdf

      [40] Research and Markets (Report) $22 Billion Emotion Detection and Recognition Market 2016-2020 by Technology, Software Tools, Services, Application Areas & End Users. February 02 (2016) Retrieved on 24th December 2017 from https://globenewswire.com/news-release/2016/02/02/806969/0/en/22-Billion-Emotion-Detection-and-Recognition-Market-2016-2020-by-Technology-Software-Tools-Services-Application-Areas-End-Users.html.

      [41] DQIndia Online (Article). Digital advertising trends in India v/s International market. March 21, (2017). Retrieved on 24th December from http://www.dqindia.com/digital-advertising-trends-in-india-vs-international-market/

      [42] Allegretti Matt (Article). Facial Recognition Technology Is Turning Heads in Advertising. October 3 (2017). Retrieved on 24th December 2017 from https://medium.com/dumbstruck/facial-recognition-technology-is-turning-heads-in-advertising-3f932c64f21e.

      [43] Frey Chris (Article). Revealed: how facial recognition has invaded shops – and your privacy. March 3 (2016). Retrieved on 24th December 2017 from https://www.theguardian.com/cities/2016/mar/03/revealed-facial-recognition-software-infiltrating-cities-saks-toronto.

      [44] The Economist (Article). “How retailers are watching shoppers’ emotionsâ€. June 8 (2017). Retrieved on 24th December 2017 from https://www.economist.com/news/business/21723162-cctv-thermal-imaging-cameras-eeg-caps-and-other-kit-boost-sales-how-retailers-are-watching

      [45] D’Mello Gwyn (Article). Meet Mitra, The 5-Foot Made-In-India Robot That Greeted PM Modi And Ivanka Trump At GES 2017. November 29 (2017). Retrieved on 24th December 2017 from https://www.indiatimes.com/technology/news/meet-mitra-the-5-foot-made-in-india-robot-that-greeted-pm-modi-and-ivanka-trump-at-ges-2017_-334629.html

      [46] Sillitoe Ben (Article). Tesco first to roll out Amscreen’s facial recognition technology. November 4 (2013). Retrieved on 24th December 2017 from http://www.essentialretail.com/in-store-ops/article/5277752c6477d-tesco-first-to-roll-out-amscreen%E2%80%99s-facial-recognition-technology

      [47] C. L. Lisetti and D. J. Schiano, “Automatic facial expression interpretation: where human-computer interaction, artificial intelligence and cognitive science intersect,†Pragmatics & Cognition, vol. 8, pp. 185–235, May (2000).

      [48] Kong, S. G., Heo, J., Abidi, B. R., Paik, J., &Abidi, M. A. Recent advances in visual and infrared face recognition - A review. Computer Vision and Image Understanding, 97(1), 103–135. https://doi.org/10.1016/j.cviu.2004.04.001.

      [49] Dutta, P. Nachamai, N. “A Contemplation of Facial Expression Recognition System in Real World Applicationsâ€. International Journal of Advances in Electronics and Computer Science, Volume-2, Issue-9, pp 13–18, (2015).

  • Downloads

  • How to Cite

    Sujata, J., Madhavi, D., & Vishal, K. (2018). Facial emotion detection technology: concept, marketing applications, business drivers and challenges. International Journal of Engineering & Technology, 7(1.9), 149-156. https://doi.org/10.14419/ijet.v7i1.9.9753

    Received date: 2018-02-26

    Accepted date: 2018-02-26

    Published date: 2018-03-01