Local Directional Threshold based Binary Patterns for Facial Expression Recognition and Analysis
Keywords:LDSM (Local Directional Standard Matrix), LDTBP (Local Dynamic Threshold based Binary Pattern), SVM (Support Vector Machine) Classifier, edge detection, facial expression recognition.
In this paper, proposing a novel method to retrieve the edge and texture information from facial images named local directional standard matrix (LDSM) and local dynamic threshold based binary pattern (LDTBP). LBP and LTP operators are used for texture extraction of an image by finding difference between center and surrounding pixels but they failed to detect edges and large intensity variations. Thus addressed such problems in proposed method firstly, calculated the LDSM matrix with standard deviation of horizontal and vertical pixels of each pixel. Therefore, values are encoded based on the dynamic threshold which is calculated from median of LDSM values of each pixel called LDTBP. In experiments used LFW facial expression dataset so used SVM classifier to classify the images and retrieved relevant images then measured in terms of average precision and average recall.
 M. Kokare, B. N. Chatterji, and P. K. Biswas, â€œA survey on current content based image retrieval methods,â€ IETE J. Res., 48,(3)&(4), 2002, pp. 261â€“271.
 Y. Liu, D. Zhang, G. Lu, and W.-Y.Ma, â€œA survey of content-based image retrieval with high-level semantics,â€ Pattern Recogn., 40,(1), Jan. 2007,pp. 262â€“282.
 Y. Rui and T. S. Huang, â€œImage retrieval: Current techniques, promising directions and open issues,â€ J. Visual Commun. Image Represent.10,(1), Mar. 1999,pp. 39â€“62.
 T. Ojala, M. Pietikainen, and D. Harwood, â€œA comparative study of texture measures with classification based on feature distributions,â€ Pattern Recogn ,29,(1),Jan. 1996,pp. 51â€“59.
 Xiaoyang Tan and Bill Triggs, â€œEnhanced Local Texture Feature Sets for Face Recognition under Difficult Lighting Conditionsâ€, IEEE Transactions on Image Processing, 19, (6), 2010, pp. 1635-1650.
 Z. Lei, S. Liao, M. PietikÃ¤inen, and S. Z. Li, â€œFace recognition by exploring information jointly in space, scale and orientation,â€ IEEE Trans. Image Process., 20, (1), Jan. 2011 pp. 247â€“256.
 Bongjin Jun, Daijin Kim, â€œRobust face detection using local gradient patterns and evidence accumulationâ€, Pattern Recognition,45, 2012,pp.3304â€“3316.
 T. Ojala, M. Pietikainen, and T. Maenpaa, â€œMultiresolution gray-scale and rotation invariant texture classification with local binary patternsâ€, IEEE Trans. Pattern Anal. Mach. Intell., 24,(7), Jul. 2002,pp. 971â€“987.
 Subrahmanyam M, Maheshwari R. P, Balasubramanian R, â€œLocal Maximum Edge Binary Patterns: A New Descriptor for Image Retrieval and Object Trackingâ€, Signal Processing, 2012, pp. 1467â€“1479.
 S. Murala, R. P. Maheshwari, and R. Balasubramanian, â€œLocal tetra patterns: a new feature descriptor for content-based image retrieval,â€ IEEE Transactions on Image Processing, 21, 5, 2012,pp. 2874â€“2886.
 Subrahmanyam Murala Â· R. P. Maheshwari Â· R. Balasubramanian, "Directional local extrema patterns: a new descriptor for content based image retrieval", International Journal of Multimedia Information Retrieval, 1, (3), Mar. 2012pp. 191 - 203.
 Santhosh Kumar Vipparthi, S. K. sagar, " Color Directional Local Quinary Patterns for Content Based Indexing and Retrieval", Human-centric Computing and Information Sciences, May. 2014,pp. 1 â€“ 13.
 Golla Varaprasad, Sachin Bharadwaj Sundra Murthy, â€œDetection of potholes in autonomous vehicleâ€, IET Intelligent Transport Systems, 2013, pp.543 â€“ 549.
 S. Viswanadha Raju, J. Sreedhar, â€œQuery Processing for Content Based Image Retrievalâ€, International Journal of Soft Computing and Engineering, 1,(5), November 2011, pp.122 â€“ 131.
 Shiv Ram Dubey, Satish Kumar Singh, Rajat Kumar Singh, " Multichannel Decoded Local Binary Patterns for Content-Based Image Retrieval", IEEE Transactions on Image Processing, 25, (9), Sep. 2016, pp. 4018 â€“ 4032.
 Md. Mostafijur Rahman*, Shanto Rahman, â€œDTCTH: a discriminative local patterndescriptor for image classificationâ€, EURASIP Journal on Imageand Video Processing,30, 2017.
 Anima Majumder, Laxmidhar Behera, â€œAutomatic Facial Expression Recognition System Using Deep Network-Based Data Fusionâ€,48,(1), 2018, pp. 103 â€“ 114.
 Byungyong Ryu; AdÃn RamÃrez Rivera, â€œ Local DirectionalTernary Pattern for Facial Expression Recognitionâ€, IEEE Transactions on Image Processing,26, (12), 2017, pp. 6006 â€“ 6018.
 Md. Zia Uddin; Weria Khaksar; Jim Torresen, â€œ Facial Expression Recognition Using Salient Features and Convolutional Neural Networkâ€, IEEE Access, Vol.5, 2017, pp. 26146 â€“ 26161.
 Maryam Imani, Hassan Ghassemian, â€œGLCM, Gabor, and morphology profiles fusion for hyperspectral image classificationâ€, Electrical Engineering (ICEE), 2016 24th Proc. Int. Conf. IEEE, Shiraz, Iran, 10-12 May 2016, pp. 1-5.
 Mahamed Hassan, Mohammed Hossny, â€œSkin lesion segmentation using Gray Level Co-occurance Matrixâ€, Systems, Man, and Cybernetics (SMC), 2016 IEEE International Conference on, 9-12 Oct. 2016, Budapest, Hungary, pp. 820-825.
 AnvitaBajpai, Kunal Chadha, â€œReal-time Facial Emotion Detection using Support Vector Machinesâ€, International Journal of Advanced Computer Science and Applications,2010, 1, (2), pp.37 â€“ 40.
 Hongzan Jiao, YanfeiZhong, â€œAn Unsupervised Spectral Matching Classifier Based on Artificial DNA Computing for Hyperspectral Remote Sensing Imageryâ€, IEEE Transactions on Geoscience and Remote Sensing,2014, 52, (8), pp. 4524 â€“ 4538.
 Irene Kotsia and Ioannis Pitas, Senior Member, â€œFacial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machinesâ€, IEEE Transactions on Image Processing, 2007, 16, (1), pp. 172 â€“ 187.