A. Y. Solomatin, I. A. Zikratov, A. S. Lyubert

Read the full article 
Article in Russian


The paper deals with an approach for a moving person identifying in video surveillance systems. The proposed solution consists of two successive stages. Selecting of a moving human from all other moving objects in a video stream takes place at the first stage. Human identification based on facial image takes place at the second stage. Detection of a human’s movement is performed via representation of the original video stream in a form of time series. Mathematical apparatus of a singular spectrum is applied for that purpose. The presence of motion is determined by analyzing the periodic components of time series constructed from color and brightness data of the original components of initial video stream. Identification of a person based on his facial image is done through representation of a facial image via two-dimensional matrix with the subsequent application of immune computing mathematical apparatus. Then the binding energy is calculated which shows similarity between the input facial image and faces stored in the training set. The proposed solution for a problem of a moving person’s identifying gives the opportunity to work with low quality video stream having a high level of noise or compression artifacts after encoding. The advantage of the method is implementation simplicity. Unlike traditional methods of computer vision, the proposed method does not require significant computational burden due to simple numerical operations. This method does not require pre-filtering of video images, therefore its performance speed is significantly increased.

Keywords: video surveillance, motion detection, time series analysis, periodic components analysis, object classification, face identification, immune computing

 1.     Luk'yanitsa A.A., Shishkin A.G. Tsifrovaya Obrabotka Videoizobrazhenii [Digital Processing of Video Images]. Moscow, ISS-Press, 2009, 512 p.
2.     Golyandina N.E. Metod “Gusenitsa”-SSA: Analiz Vremennykh Ryadov [The "Caterpillar”-SSA method: Analysis of Time Series]. St. Petersburg, SPbSU Publ., 2004, 76 p.
3.     Golyandina N.E. Metod “Gusenitsa”-SSA: Prognoz Vremennykh Ryadov [The "Caterpillar”-SSA method: Forecast of Time Series]. St. Petersburg, SPbSU Publ., 2004, 56 p.
4.     Akcay H. Subspace-based spectrum estimation in frequency-domain by regularized nuclear norm minimization. Signal Processing, 2014, vol. 99, pp. 69–85. doi: 10.1016/j.sigpro.2013.12.028
5.     Araujo I.G., Laier J.E. Operational modal analysis using SVD of power spectral density transmissibility matrices. Mechanical Systems and Signal Processing, 2014, vol. 46, no. 1, pp. 129–145. doi: 10.1016/j.ymssp.2014.01.001
6.     Sokolova S.P., Sokolova L.A. Intellektual'nye Informatsionnye Sistemy na Osnove Immunokomp'yutinga [Intelligent Information Systems Based on Immunocomputing]. St. Petersburg, GUAP Publ., 2009, 159 p.
7.     Dasgupta D. Artificial Immune Systems and their Applications. Berlin, Springer-Verlag, 1999, 306 p.
8.     Dasgupta D., Gonzalez F. Artificial immune systems in intrusion detection. In: Vemuri V.R. Enhancing Computer Security with Smart Technology. Auerbach, 2005, 288 p.
9.     Tarakanov A., Nicosia G. Foundations of immunocomputing. Proc. IEEE Symposium on Foundations of Computational Intelligence, FOCI 2007. Honolulu, Hawaii, USA, 2007, pp. 503–508.
10.  Wiersma J. Human Movement Classification, 2007. Available at: (accessed 01.04.2014).
11.  Kruchinin A.Yu. Raspoznavanie Obrazov s Ispol'zovaniem OpenCV [Pattern recognition using OpenCV], 2011. Available at: (accessed 01.04.2014).
12.  Bradski G.R., Kaehler A. Learning OpenCV. O'Reilly Media Inc., 2008, 571 p.
13.  Tarakanov A.O., Skormin V.A., Sokolova S.P. Immunocomputing. Principles and Applications. NY, Springer-Verlang, 2003, 193 p.
14.  Tarakanov A.O. Mathematical models of intrusion detection by an intelligent immunochip. Communications in Computer and Information Science, 2007, vol. 1, pp. 308–319. doi: 10.1007/978-3-540-73986-9_26
15.  Tsypkin Ya.Z. Informatsionnaya Teoriya Identifikatsii [Information Theory of Identification]. Moscow, Nauka Publ., 1995, 336 p.
Copyright 2001-2017 ©
Scientific and Technical Journal
of Information Technologies, Mechanics and Optics.
All rights reserved.