PEOPLE RETRIEVAL BY MEANS OF COMPOSITE PICTURES: METHODS, SYSTEMS AND PRACTICAL DECISIONS

We discuss the problem of people retrieval by means of composite pictures and methods of its practical realization. Earlier on, the problem was posed in the previous paper by the authors, and this paper deals with its further development. The starting premise here is that for the successful search of people by their sketches it is necessary to transform these sketches into sets of populations of sketches imitating evidence of «group of witnesses» and evidence with incomplete information in verbal portraits. Variants of structures for benchmark «photo-sketch» databases are presented, intended for modeling and practical realization of original photos retrieval by sketches, which new component is a population of sketches. Problems of preprocessing for initial sketches and original photos and its influence on the result of their comparison are discussed. Simple sketch recognition systems (Simple FaRetSys) and a problem of original photos retrieval by the sketches are considered. Shortcomings of such systems are shown and new decisions on extending and development of simple systems (Extended FaRetSys) are presented. Experiments on searching of original photos by sketches in the CUFS database of sketches and similar experiments on widely known FERET and CUFSF facial databases are presented. Three frameworks are offered for retrieval performance improvement. In the first one, original sketches are transformed into populations, and then in these populations the sketch similar to the given sketch (Forensic Sketch) is already defined. The class of the sketch found in a population «by definition» unambiguously corresponds to a class of the original photo. In the second framework, the Forensic Sketch is transformed to a population of sketches, and all original sketches in a benchmarking database are compared to sketches from populations of the Forensic Sketch. The class of matches is determined in the same manner as in the first framework. The third framework includes generation of a population of sketches, both from all original sketches, and from all Forensic Sketches. The further line of research is obvious: retrieval by matching between sketches of these two populations.

1. Chabot P. The photo robot. Its use, its production, its future. International Criminal Police Review, 1959, no. 97.

2. Uhl R.J. Jr., Lobo N.V. A framework for recognizing a facial image from a police sketch. Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, USA, 1996, pp. 586–593. doi: 10.1109/CVPR.1996.517132

3. Wang X., Tang X. Face photo-sketch synthesis and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, vol. 31, no. 11, pp. 1955–1967. doi: 10.1109/TPAMI.2008.222

4. Klare B., Li Z., Jain A.K. Matching forensic sketches to mug shot photos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, vol. 33, no. 3, pp. 639–646. doi: 10.1109/TPAMI.2010.180

5. Han H., Klare B.F., Bonnen K., Jain A.K. Matching composite sketches to face photos: a component-based approach. IEEE Transactions on Information Forensics and Security, 2013, vol. 8, no. 3, pp. 191–204. doi: 10.1109/TIFS.2012.2228856

6. Kukharev G.A., Matveev Yu.N., Shchegoleva N.L. Poisk lyudei po fotorobotam: sostoyanie problemy i tekhnologii [People retrieval by means of composite pictures: problem state-of-the-art and technologies]. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2014, no. 6 (94), pp. 123–136.

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License