Face Sketch Synthesis Based on Local and Nonlocal Similarity Regularization

다국어 초록 (Multilingual Abstract)

Face sketch synthesis plays an important role in public security and digital entertainment. In this paper, wepresent a novel face sketch synthesis method via local similarity and nonlocal similarity regularization terms.
The local similarity can overcome the technological bottlenecks of the patch representation scheme intraditional learning-based methods. It improves the quality of synthesized sketches by penalizing the dissimilartraining patches (thus have very small weights or are discarded). In addition, taking the redundancy of imagepatches into account, a global nonlocal similarity regularization is employed to restrain the generation of thenoise and maintain primitive facial features during the synthesized process. More robust synthesized resultscan be obtained. Extensive experiments on the public databases validate the generality, effectiveness, androbustness of the proposed algorithm.

참고문헌 (Reference)

1 K. Messer, "XM2VTSDB: the extended M2VTS database" 1999

2 P. J. Phillips, "The FERET evaluation methodology for face-recognition algorithms" 22 (22): 1090-1104, 2000

3 A. Martinez, "The AR face database"

4 J. Wright, "Sparse representation for computer vision and pattern recognition" 98 (98): 1031-1044, 2010

5 S. Wang, "Semi-coupled dictionary learning with applications to image superresolution and photo-sketch synthesis" 2216-2223, 2012

6 Y. Song, "Real-time exemplar-based face sketch synthesis" Springer 800-813, 2014

7 N. Wang, "Random sampling for fast face sketch synthesis" 76 : 215-227, 2018

8 C. Ledig, "Photo-realistic single image super-resolution using a generative adversarial network" 4681-4690, 2017

9 S. Tang, "Pansharpening via sparse regression" 56 (56): 2017

10 S. T. Roweis, "Nonlinear dimensionality reduction by locally linear embedding" 290 (290): 2323-2326, 2000

11 D. Liu, "Non-local recurrent network for image restoration" 31 : 1673-1682, 2018

12 C. Peng, "Multiple representations-based face sketch–photo synthesis" 27 (27): 2201-2215, 2016

13 H. Zhou, "Markov weight fields for face sketch synthesis" 1091-1097, 2012

14 W. Zhang, "Lighting and pose robust face sketch synthesis" Springer 420-433, 2010

15 P. Isola, "Image-to-image translation with conditional adversarial networks" 1125-1134, 2017

16 C. Dong, "Image super-resolution using deep convolutional networks" 38 (38): 295-307, 2015

17 Z. Zha, "Group sparsity residual constraint for image denoising with external nonlocal self-similarity prior" 275 : 2294-2306, 2018

18 I. Goodfellow, "Generative adversarial nets" 27 : 2672-2680, 2014

19 A. Dosovitskiy, "Generating images with perceptual similarity metrics based on deep networks" 29 : 658-666, 2016

20 X. Gao, "Face sketch–photo synthesis and retrieval using sparse representation" 22 (22): 1213-1226, 2012

21 L. Chang, "Face sketch synthesis via sparse representation" 2146-2149, 2010

22 X. Gao, "Face sketch synthesis algorithm based on E-HMM and selective ensemble" 18 (18): 487-496, 2008

23 X. Wang, "Face photo-sketch synthesis and recognition" 31 (31): 1955-1967, 2008

24 X. Tang, "Face photo recognition using sketch" 2002

25 Chen Li, "Face Recognition Based on the Combination of Enhanced Local Texture Feature and DBN under Complex Illumination Conditions" 한국정보처리학회 14 (14): 191-204, 2018

26 L. Zhang, "FSIM : a feature similarity index for image quality assessment" 20 (20): 2378-2386, 2011

27 L. Zhang, "End-to-end photo-sketch generation via fully convolutional representation learning" 627-634, 2015

28 Y. LeCun, "Deep learning" 521 (521): 436-444, 2015

29 W. Zhang, "Coupled information-theoretic encoding for face photo-sketch recognition" 513-520, 2011

30 Rui Qi, "Block Sparse Signals Recovery via Block Backtracking- Based Matching Pursuit Method" 한국정보처리학회 13 (13): 360-369, 2017

31 N. Wang, "Back projection : an effective postprocessing method for GAN-based face sketch synthesis" 107 : 59-65, 2018

32 J. Wang, "Automatic image-based pencil sketch rendering" 17 (17): 347-355, 2002

33 N. Wang, "Anchored neighborhood index for face sketch synthesis" 28 (28): 2154-2163, 2017

34 X. Li, "A simple framework for face photo-sketch synthesis" 2012 : 2012

35 Q. Liu, "A nonlinear approach for face sketch synthesis and recognition" 1005-1010, 2005

36 A. Buades, "A non-local algorithm for image denoising" 60-65, 2005

37 R. G. Uhl, "A framework for recognizing a facial image from a police sketch" 586-593, 1996