Comparison of Eye Detection Methods using Image Processing

  • Authors

    • Vijayalaxmi Biradar
    https://doi.org/10.14419/ijet.v7i4.6.30916
  • Face, Eye, Driver, Fatigue, Skin

  • Abstract

    Driver fatigue is major factor in more number of vehicle accidents on road.  Statistics from Transport Accident Commission shows that nearly 20% of fatal road accidents involve fatigue. National Highway Traffic Safety Administration estimate that nearly 2,000 deaths, 70,000 injuries and $12.5 billion of financial losses occur annually. The development of technologies for detecting and preventing fatigue at the wheel is a major challenge faced by accident avoidance systems. Measurement of fatigue becomes difficult as it becomes more pronounced. During last decade, lot of research work has been carried out development of fatigue detection system for avoiding accidents on road. It is the summary of all related work carried out, the methods and components required in this research. The drawbacks of the existing methods, advantages and limitations are discussed in this paper. There are many technologies for Fatigue detection which are divided into biological indicators, vehicle behaviour and face analysis. This paper is a part of research work on the project “Development of Non-Intrusive Driver Fatigue Detection & Warning System to avoid on road Accidents†sanctioned under Early Career Research Award sponsored by Science & Engineering Research Board ,Govt. of India ,New Delhi at Vignan Institute of Technology & Science, Vignan Hills, Hyderabad.

     

     

  • References

    1. [1] A Jackson, P., Hilditch, C., Holmes, A., Reed, N., Merat, N. & Smith, L. “Fatigue and Road Safety: A Critical Analysis of Recent Evidenceâ€, Road Safety Web Department for Transport, Publication No. 21, (2011).

      [2] Karamjeet Singh, Rupinder Kaur,â€Physical and Physiological Drowsiness Detection Methodsâ€, International Journal of IT, Engineering and Applied Sciences Research, pp.35-43, Volume 2, (2013).

      [3] Eoh,H.J., Chung,M.K, and Kim,S.H., “Electroencephalographic study of drowsiness in simulated driven with sleep deprivation,†International Journal of Industrial Ergonomics,Volume 35, pp.307-320, (2005).

      [4] Lal,S.K.L., Craig,A., Boord,P., Kirkup,L., and Nguyen,H., “Development of an algorithm for an EEG-based driver fatigue countermeasure,†Journal of Safety Research, Volume 34, pp. 321-328, (2003).

      [5] Elsenbruch,S., Harnish,M., and Orr,W.C., “Heart rate variability during waking and sleep in healthy males and females,†Sleep, Volume 22, pp.1067-1071, (1999).

      [6] Toscani,L., Gangemi,P.F., Parigi,A., Silipo,R., Ragghianti, P., Sirabella,E., Morelli, M.,Bagnoli,L., Vergassola,R., and Zaccara,G., “Human heart rate variability and sleep stages,†The Italian Journal of Neurological Sciences, Volume 17, pp. 437-439, (1996).

      [7] Bonnet,M.H., and Arand, D.L.,“Heart rate variability: sleep stage, time of night, and arousal influencesâ€, Electroencephalography and Clinical Neurophysiology, Volume 102, pp.390-396, (1997).

      [8] Jurysta,F., Van de Borne,P., Migeotte, P.F., Dumont,M., Lanquart,J.P., Degaute, J.P.,and Linkowski,P., “A study of the dynamic interactions between sleep EEG and heart rate variability in healthy young men,†Clinical Neurophysiology, Volume 114, pp. 2146-2155, (2003).

      [9] Vanoli,E., Adamson,P.B., Lin,B., Pinna,G.D., Lazzara,R., and Orr,W.C., “Heart Rate Variability During Specific Sleep Stages - A Comparison of Healthy Subjects With Patients After Myocardial Infarction,†Circulation, Volume 91, pp. 1918-1922, (1995).

      [10] Tsunoda,M., Endo,T., Hashimoto,S., Honma,S., and Honma, K.,I., “Effects of light and sleep stages on heart rate variability in humans,†Psychiatry and Clinical Neurosciences,Volume 55, pp. 285-286, (2001).

      [11] Uno,H., “Detection Decline in Arousal Level Using Combined Physiological and Behavioral Measures,†Japan Automobile Research Institute, Volume 25 No.8, (2003).

      [12] McCall,J., and Trivedi,M., “Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation,†IEEE Trans. Intelligent Transportation Systems, Volume 7, no. 1, (2006).

      [13] P.Sudhakar Rao, Vijayalaxmi, S.Sreehari, “New procedure for Segmenting Eyes from human Faceâ€, International Journal of Emerging Technologies and Applications in Engineering, Technology and Sciences, ISSN:0974-3588 July-Dec, Volume 4,Issue 2,(2011).

      [14] Jones, M. J., and Rehg, J. M., “Statistical color models with application to skin detectionâ€, In Procedings of the CVPR , Volume. 1, pp.274–280,(1999).

      [15] Signal,L., Sclaroff,S., and Athatsos,V., “Estimation and prediction of evolving colour distributions for skin segmentation under varying illuminationâ€, In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Volume 2, pp.152–159,(2000).

      [16] Lingmin Meng and Nguyen,T.Q., "Frontal face localization using linear discriminant", in Signals, Systems, and Computers, 1999. Conference Record of the Thirty-Third Asilomar Conference on, pp. 745-749 Volume 1,(1999).

      [17]

      [18] Tsai,D., and Lin,C., "Fast normalized cross correlation for defect detection", Pattern Recog. Lett., Volume 24, pp. 2625-2631, 11, (2003).

      [19] Shou-Der Wei and Shang-Hong Lai, "Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update", Image Processing, IEEE Transactions on, Volume 17, pp. 2227-2235, (2008).

      [20] Atallah,M.J., "Faster image template matching in the sum of the absolute value of differences measure," Image Processing, IEEE Transactions on, Volume 10, pp. 659-663, (2001).

      [21] Yuille, A., Hallinan,A., Cohen,D., “Feature extraction from faces using deformable templatesâ€, International Journal of Computer Vision 8 (2),pp. 99-111, (1992).

      [22] Black,M.J., Yacoob,Y., “Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motionâ€, International Journal of Computer Vision. Volume 25(1), October, pp. 23 – 48,( 1997).

      [23] Qiong Wang, Jingyu Yang, “Eye detection in facial images with unconstrained backgroundâ€, Journal of pattern recognition research 1, published 25 Sep 2006, pp.55-62, (2006).

      [24] Qiong Wang, Jingyu Yang, “Eye location & eye state detection in facial images with unconstrained backgroundâ€, Journal of information and computing science, Volume 1, No.5, pp.284-289, (2006).

      [25] Hawlader Abdullah Al-Mamun, Nadim Jahangir, Md. Shahedul Islam and Md. Ashraful Islam, “Eye Detection in Facial Image by Genetic Algorithm Driven Deformable Template Matchingâ€, Volume 9, August, (2009).

      [26] Mihir Jain, Suman Mitra,K., Naresh Jotwani,D., “Eye detection using line edge MAP templateâ€,(2008).

      [27] Jeffrey Huang, David Lie, Xuhui Shao, Harry Wechsler, “Pose Discrimination and Eye Detection using SVMâ€, Proceeding of NATO-ASI on Face Recognition: From Theory to Applications, (1998).

      [28] Hyoung-Joon Kim and Whoi-Yul Kim, “Eye detection in facial images using Zernike moments with SVMâ€, ETRI journal, Volume 30, Nov,2, pp. 335-337,April (2008).

      [29] Shylaja S.S, Balasubramanya Murthy,K.N., Natarajan, S., Nischith, Muthuraj R, Ajay S, “Feed forward neural network based eye localization and recognition using Hough transformâ€, International journal of advanced computer science and applications, Volume 2, No.3, pp.104-109, March(2011).

      [30] Rakhi C Motwani, Mukesh C Motwani, Dr.Frederick C. Harris,Jr., “Eye Detection using Wavelets and ANNâ€,(2002).

      [31] Kawato,S. Ohya,J., “Real-time detection of nodding and head-shaking by directly detecting and trackingâ€,(2003).

      [32] Feng,G.C., Yuen,P.C., “Variance projection function and its application to eye detection for human face recognitionâ€, International Journal of Computer Vision 19,pp.899-906, (1998).

      [33] Jiao, F., and He,G., “Real-Time Eye Detection and Tracking under Various Light Conditionsâ€, Data Science Journal, 6(0),pp.636–640, (2007).

      [34] Junior,O.S.,Silva,A.C., and Abdelouah,Z., “Personal Identification Based on Iris Texture Analysis Using Semivariogram and Correlogram Functionsâ€, International Journal for Computacional Vision and Biomechanics, (2009). 2(1).

      [35] Peters, R. D., Kloeppel, E., & Alicandri, E. “ Effects of partial and total sleep deprivation on driving performanceâ€, US Department of Transportation, Federal Highway Administration (Eds), Publication No. FHWA-RD-94-046 (1999).

      [36] Artaud et.al, Mabbott et.al, Lavergne et.al, Vitabile et.al, Eskandarian.A & R.Sayed in , “Monitoring the response of driversâ€,( 1994),(1999),(1996),2007-08),(2005).

      [37] Martin Gallagher, “Development of a driver alert system for road safetyâ€, in (2006-07).

      [38] Srijayathi,K., Vedachary,M., “Implementation of the Driver Drowsiness Detection Systemâ€, International Journal of Science, Engineering and Technology Research (IJSETR),Volume 2, Issue 9, September (2013).

      [39]

      [40] Akin M., Kurt M., Sezgin N., Bayram M, “Estimating vigilance level by using EEG and EMG signalsâ€, Neural Comput. Applications, 17,pp.227–236,(2008).

      [41] Fu C.L., Li W.K., Chun H.C., Tung P.S., Chin T.L., “Generalized EEG-based drowsiness prediction system by using a self-organizing neural fuzzy systemâ€, IEEE Transaction Circuits. Systems,59, pp.2044–2055,(2012).

      [42] Chin T.L., Che J.C., Bor S.L., Shao H.H., Chih F.C., Wang I.J., “A real-time wireless brain-computer interface system for drowsiness detectionâ€, IEEE Transactions Biomedical Circuits Systems, 4,pp.214–222,(2010).

      [43] Liu J., Zhang C., Zheng C., “EEG-based estimation of mental fatigue by using KPCA-HMM and complexity parametersâ€, Biomedical Signal Processing Controls, 5, pp.124–130,(2010).

      [44] Yang, M.H., Kriegman, D., and Ahuja, N, “Detecting faces in images: A surveyâ€, IEEE Transactions on Pattern Analysis & Machine Intelligenceâ€, Vol.24, No.1, pp.34–58,(2002).

      [45] Lin,C.T., Wu,R.C., Liang,S.F., Chao, W.H., Chen,Y.J., and Jung,T.P., “EEG-based drowsiness estimation for safety driving using independent component analysis,†IEEE Transaction on Circuits and Systems, vol. 52, pp. 2726-2738, (2005).

      [46] Calcagnini,G., Biancalana, G., Giubilei,F., Strano, S. and Cerutti,S., “Spectral analusis of heart rate variability signal during sleep stages,†Proceedings of the 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, vol. 2, pp.1252-1253, (1994).

      [47] Wylie,C., Shultz,T., Miller,J., Mitler,M., Mackie,R., “Commercial Motor Vehicle Driver Fatigue and Alertness Study: Technical Summary,†FHWA-MC-97-001, (1996).

      [48] Otmani,S., Pebayle,T., Roge,J., Muzet,A., “Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers,†Physiological Behaviour, (2005).

      [49] Bertozzi,M., et al., “Knowledge-Based Intelligent Information and Engineering Systems,†B. Appolloi et al., eds., Springer, (2007).

      [50] Sahyadehas,A., Sundaraj,K. and Murugappan,M., “Detecting Driver Drowsiness based on Sensors: A Review,†(2012).

      [51] Ingre,M., ÅKerstedt,T., Peters,B., Anund,A., Kecklund,G., “Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences,†J. Sleep Res., (2006).

      [52] Daimer,A.G., “The Electronic Drawbarâ€, June (2001). [Online].

      [53] Mohammed Saaidia, Sylvie Lelandais, “Face detection by neural network trained with Zernike momentsâ€, Vincent Vigneron Proceedings of the 6th WSEAS International Conference on Signal Processing, Robotics and Automation, Corfu Island, Greece, February 16-19, (2007).

      [54] Zhao,W., Chellappa, R., Rosenfeld, A. and Phillips,P., “Face recognition: A literature surveyâ€, ACM Computing Surveys, pp.399–458, (2003).

      [55] Bruner,J.S. and Tagiuri,R., “The percepton of peopleâ€, Handbook of Social Psycology, 2(17), (1954).

      [56] Yang,M.H., Kriegman, D. J., and Ahuja,N., “Detecting faces in images: A surveyâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(1),pp.34–58, January (2002).

      [57] Vezhnevets,V., Sazonov,V., Andreeva, A., “A survey on pixel-based skin colour detection techniquesâ€, GRAPHICON03, pp. 85–92,(2003).

      [58] Brown, D., Craw,I., Lewthwaite,J., “A SOM based approach to skin detection with application in real time systemsâ€, BMVC01, (2001).

      [59] Greenspan,H., Goldberger,J., Eshet, I., “Mixture model for facecolor modeling and segmentationâ€, Pattern Recognition Lett. 22 (14),pp.1525–1536,(2001).

      [60] Hsu,R.L., Abdel-Mottaleb,M., Jain,A.K., “Face detection in colour imagesâ€, IEEE Transaction Pattern Analysis Machine Intelligence, 24 (5),pp.696–706,(2002).

      [61] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparisonâ€, IEEE Transaction Pattern Analysis Machine Intelligence 27 (1) (2005).

      [62] Yang,M.H., Ahuja,N., “Gaussian Mixture model for human skin colour and its application in image and video databasesâ€, Proceedings of SPIE: Conference on Storage and Retrieval for Image and Video Databases, vol. 3656, pp. 458–466,(1999).

      [63] Brand,J., Mason,J., “A comparative assessment of three approaches to pixel level human skin-detectionâ€, ICPR011,pp.1056–1059, (2000).

      [64] Martinkauppi, B., and Soriano, M. 2001, “Basis functions of the color signals of skin under different illuminantsâ€, 3rd International Conference on Multispectral Colour Science, pp.21–24, (2001).

      [65] Shin, M. C., Chang, K. I., and Tsap, L. V., “Does colourspace transformation make any difference on skin detectionâ€, IEEE Workshop on Applications of Computer Vision, (2002).

      [66] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparisonâ€, IEEE Transaction Pattern Analysis Machine Intelligence, 27 (1) (2005).

      [67] Guoliang Yang, Huan Li, Li Zhang, Yue Cao, “Research on a Skin Colour Detection Algorithm Based on Self Adaptive Skin Colour Model, International Conference on Communications and Intelligence Information Security, 978-0-7695-4260-7/10,(2010).

      [68] Abbas Cheddad, Joan Condell, Kevin Curran and Paul Mc Kevitt, “A New color space for skin detectionâ€, ICIP ,978-1-4244-5654-3/09,(2009).

      [69] Zhang Zhengzhen, Shi Yuexiang, “Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Spaceâ€, 9781-4244-3986-7, (2009).

      [70] Jouglas Alves Tomaschitz, Jacques Facon, “Skin Detection applied to Multi-racial Images†, 978-1-4244-4530-1,(2009).

      [71] Kirby,M., and Sirovich,L., “Application of the karhunen-loeve procedure for the characterization of human facesâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(1),pp.103–108, (1990).

      [72] Pigeon, S., and Vandendrope, L., “The M2VTS multimodal face databaseâ€, In Proceedings First International Conference on Audio- and Video Based Biometric Person Authentication, (1997).

      [73] Jain, A., Duin,R., and Mao,J., “Statistical pattern recognition: A reviewâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1),pp.4–37, January (2000).

      [74] Ji,Q., Yang, S., “Real time visual cues extraction for monitoring driver vigilanceâ€, Proceedings of International Workshop on Computer Vision Systems, Vancouver, Canada, (2001).

      [75] Ji,Q., Zhu,Z., “Eye and gaze tracking for interactive graphic displayâ€, 2nd International Symposium on Smart Graphics, Hawthorne, NY, USA, (2002).

      [76] Bisawa,Y.E., Satoh,S., “Effectiveness of pupil area detection technique using two light sources and image difference methodâ€, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 1268-1269,(1993).

      [77] Ebisawa,Y., “Improved video-based eye-gaze detection methodâ€, IEEE Transcations on Instrumentation and Measurement 47 (2) pp.948-955, (1998).

      [78] Haro,A., Flickner,M., Essa,I., “Detecting and tracking eyes by using their physiological properties, dynamics, and appearanceâ€, Proceedings IEEE CVPR 2000, Hilton Head Island, South Carolina, (2000).

      [79] Zhiwei Zhu, Qiang Ji, “Robust Real-Time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientationsâ€, Preprint submitted to Elsevier Science, 5 July,(2004).

      [80] Nixon,M., “Eye spacing measurement for facial recognitionâ€, Proceedings of the Society of Photo-Optical Instrument Engineers, (1985).

      [81] Deng,J., Lai,F., “Region-Based Template Deformation and Masking for Eye-feature Extraction and Descriptionâ€, Pattern Recognition, 30(3),pp.403–419, (1997).

      [82] A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR'94), Seattle, WA, (1994).

      [83] Reinders,M., Koch,R., Gerbrands,J., “Locating facial features in image sequences using neural networksâ€, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, USA, (1997).

      [84] Zhiwei Zhu, Quing Ji, “Robust real time eye detection and tracking under variable lighting conditions and various face orientationsâ€, Preprint submitted to Elseiver Science , July 5, (2004).

      [85] Feng,G.C., Yuen,P.C., “Multi-cues eye detection on gray intensity imageâ€, Pattern recognition, 34,pp.1033-1046,(2001).

      [86] Brand,J., Mason,J., “A comparative assessment of three approaches to pixel level human skin-detectionâ€, ICPR011,pp.1056–1059, (2000).

      [87] Martinkauppi, B., and Soriano, M. 2001, “Basis functions of the color signals of skin under different illuminantsâ€, 3rd International Conference on Multispectral Colour Science, pp.21–24, (2001).

      [88] Shin, M. C., Chang, K. I., and Tsap, L. V., “Does colourspace transformation make any difference on skin detectionâ€, IEEE Workshop on Applications of Computer Vision, (2002).

      [89] Phung,S.L., Bouzerdoum,A., Chai,D., “Skin segmentation using colour pixel classification: analysis and comparisonâ€, IEEE Transaction Pattern Analysis Machine Intelligence, 27 (1) (2005).

      [90] Guoliang Yang, Huan Li, Li Zhang, Yue Cao, “Research on a Skin Colour Detection Algorithm Based on Self Adaptive Skin Colour Model, International Conference on Communications and Intelligence Information Security, 978-0-7695-4260-7/10,(2010).

      [91] Abbas Cheddad, Joan Condell, Kevin Curran and Paul Mc Kevitt, “A New color space for skin detectionâ€, ICIP ,978-1-4244-5654-3/09,(2009).

      [92] Zhang Zhengzhen, Shi Yuexiang, “Skin Color Detecting Unite YCgCb Color Space with YCgCr Color Spaceâ€, 9781-4244-3986-7, (2009).

      [93] Jouglas Alves Tomaschitz, Jacques Facon, “Skin Detection applied to Multi-racial Images†, 978-1-4244-4530-1,(2009).

      [94] Kirby,M., and Sirovich,L., “Application of the karhunen-loeve procedure for the characterization of human facesâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(1),pp.103–108, (1990).

      [95] Pigeon, S., and Vandendrope, L., “The M2VTS multimodal face databaseâ€, In Proceedings First International Conference on Audio- and Video Based Biometric Person Authentication, (1997).

      [96] Jain, A., Duin,R., and Mao,J., “Statistical pattern recognition: A reviewâ€, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(1),pp.4–37, January (2000).

      [97] Ji,Q., Yang, S., “Real time visual cues extraction for monitoring driver vigilanceâ€, Proceedings of International Workshop on Computer Vision Systems, Vancouver, Canada, (2001).

      [98] Ji,Q., Zhu,Z., “Eye and gaze tracking for interactive graphic displayâ€, 2nd International Symposium on Smart Graphics, Hawthorne, NY, USA, (2002).

      [99] Bisawa,Y.E., Satoh,S., “Effectiveness of pupil area detection technique using two light sources and image difference methodâ€, Proceedings of the 15th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, pp. 1268-1269,(1993).

      [100] Ebisawa,Y., “Improved video-based eye-gaze detection methodâ€, IEEE Transcations on Instrumentation and Measurement 47 (2) pp.948-955, (1998).

      [101] Haro,A., Flickner,M., Essa,I., “Detecting and tracking eyes by using their physiological properties, dynamics, and appearanceâ€, Proceedings IEEE CVPR 2000, Hilton Head Island, South Carolina, (2000).

      [102]

      [103] Zhiwei Zhu, Qiang Ji, “Robust Real-Time Eye Detection and Tracking Under Variable Lighting Conditions and Various Face Orientationsâ€, Preprint submitted to Elsevier Science, 5 July,(2004).

      [104] Nixon,M., “Eye spacing measurement for facial recognitionâ€, Proceedings of the Society of Photo-Optical Instrument Engineers, (1985).

  • Downloads

  • How to Cite

    Biradar, V. (2018). Comparison of Eye Detection Methods using Image Processing. International Journal of Engineering & Technology, 7(4.6), 314-319. https://doi.org/10.14419/ijet.v7i4.6.30916

    Received date: 2020-06-20

    Accepted date: 2020-06-20