Menu
Publications
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
Editor-in-Chief
Nikiforov
Vladimir O.
D.Sc., Prof.
Partners
doi: 10.17586/2226-1494-2022-22-2-279-286
Methods of local features extraction in person authentication task by face thermographic image
Read the full article ';
Article in Russian
For citation:
Abstract
For citation:
Belov N.I., Ermak M.A., Dubinich E.A., Kuznetsov A.Y. Methods of local features extraction in person authentication task by face thermographic image. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2022, vol. 22, no. 2, pp. 279–286 (in Russian). doi: 10.17586/2226-1494-2022-22-2-279-286
Abstract
The paper presents a methods of image local features extraction research in relation to people authentication problem by face thermogram. As a part of the study, there were formed two datasets for methods training and testing: photographic images and face images in the long-wavelength infrared specter (LWIR) with various factors. The novelty of this study is due to the approach to collecting datasets to verify the accuracy of authentication methods. The dataset was collected with more realistic conditions that affect the quality of authentication, such as changing facial expressions, wearing glasses, medical masks, applying make-up/cosmetics, changing the lighting and temperature conditions of the environment, rotating the head. The methods core is based on the idea of constructing a vector of image features while reducing the dimension and highlighting the boundaries. Likewise, the methods of this group cope well with extracting features task on images and are widely used in the tasks of authentication by 2D face image, as well as in other computer vision tasks. In this paper, four classical methods of local feature extraction are considered: the method of locally binary templates, Gabor wavelets, scale-invariant feature transformation, and Weber’s local descriptor. The classifiers for the feature vectors comparison in this research are SVM and the simplest Perceptron — the basic methods of machine learning. As part of the study, a comparative analysis of each method was carried out in relation to the collected datasets. The methods were trained and tested on a collected face dataset of over 632,000 images of 152 people. As a result of the comparative analysis, it can be concluded that the method of local binary features demonstrates the best result among the considered methods for both types of data: for face thermograms (for SVM — 0,57, for Perceptron — 0,58), for photographic images (for SVM — 0,71, for Perceptron — 0,73). Furthermore, the SIFT method showed similar results: for face thermograms (for SVM — 0,58, for Perceptron — 0,55), for photographic images (for SVM — 0,72, for Perceptron — 0,74). Gabor filters and Weber local descriptor application demonstrate a low accuracy rate in the authentication task by both types of data. The results of the work can be used in access control and management systems to increase the fault tolerance of person authentication. The appliance of the considered methods are effective in the tasks such as processing thermograms for authentication a person by so-called “secondary” signs, for example, by the veins and vessels on face patterns, in cases of facial expressions and appearance changes.
Keywords: computer vision, facial recognition algorithm, locally binary patterns, Gabor filters, scale-invariant features transform, local Weber descriptor, computer vision, edge extraction, face thermographic image authentication
References
References
-
Zhao W., Chellappa R., Phillips P.J., Rosenfeld A. Face recognition: a literature survey. ACM Computing Surveys, 2003, vol. 35, no. 4, pp. 399–458. https://doi.org/10.1145/954339.954342
-
Cutler R. Face recognition using infrared images and eigenfaces, 1999. Available at: https://www.researchgate.net/publication/2375350_Face_Recognition_Using_Infrared_Images_and_Eigenfaces (accessed: 21.12.2021).
-
Krišto M., Ivašić-Kos M. An overview of thermal face recognition methods. Proc. of the 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2018, pp. 1098–1103. https://doi.org/10.23919/MIPRO.2018.8400200
-
Hermosilla G., Ruiz-del-Solar J., Verschae R., Correa M. A comparative study of thermal face recognition methods in unconstrained environments. Pattern Recognition, 2012, vol. 45, no. 7, pp. 2445–2459. https://doi.org/10.1016/j.patcog.2012.01.001
-
Akhloufi M.A., Bendada A. Infrared face recognition using texture descriptors. Proceedings of SPIE, 2010, vol. 7661, pp. 766109. https://doi.org/10.1117/12.849764
-
Méndez H., Martín C.S., Kittler J., Plasencia Y., García-Reyes E. Face recognition with LWIR imagery using local binary patterns. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2009, vol. 5558, pp. 327–336. https://doi.org/10.1007/978-3-642-01793-3_34
-
Simón M.O., Corneanu C., Nasrollahi K., Nikisins O., Escalera S., Escalera S., Sun Y., Li H., Sun Z., Moeslund T.B., Greitans M. Improved RGB-D-T based face recognition. IET Biometrics, 2016, vol. 5, no. 4, pp. 297–303. https://doi.org/10.1049/iet-bmt.2015.0057
-
Bebis G., Gyaourova A., Singh S., Pavlidis I. Face recognition by fusing thermal infrared and visible imagery. Image and Vision Computing, 2006, vol. 24, no. 7, pp. 727–742. https://doi.org/10.1016/j.imavis.2006.01.017
-
Palm R.B. Prediction as a candidate for learning deep hierarchical models of data, 2012. Available at: https://www2.imm.dtu.dk/pubdb/pubs/6284-full.html (accessed: 05.01.2022).
-
Ojala T., Pietikäinen M., Harwood D. A comparative study of texture measures with classification based on feature distributions. Pattern Recognition, 1996, vol. 29, no. 1, pp. 51–59. https://doi.org/10.1016/0031-3203(95)00067-4
-
Okajima K. Two-dimensional Gabor-type receptive field as derived by mutual information maximization. Neural Networks, 1998, vol. 11, no. 3, pp. 441–447. https://doi.org/10.1016/S0893-6080(98)00007-0
-
Kyrki V., Kamarainen J.-K., Kalviainen H. Simple Gabor feature space for invariant object recognition. Pattern Recognition Letters, 2004, vol. 25, no. 3, pp. 311–318. https://doi.org/10.1016/j.patrec.2003.10.008
-
Lee D.D., Seung H.S. Algorithms for non-negative matrix factorization. Advances in Neural Information Processing Systems, 2001, vol. 13, pp. 556–562.
-
Bolme D.S., Beveridge J.R., Teixeira M., Draper B.A. The CSU face identification evaluation system: Its purpose, features, and structure. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2003, vol. 2626, pp. 304–311. https://doi.org/10.1007/3-540-36592-3_29