用户名: 密码: 验证码:
个性化的人脸漫画与动画合成方法研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
目前,国家和地方政府都大力发展创意文化产业,人脸漫画与动画是深受人们喜爱的创意文化内容之一。本文对基于照片的自动漫画人脸生成及其动画合成问题进行了研究,与传统基于规则法的思想不同,本文侧重采用机器学习方法从艺术家的作品中学习漫画知识,然后应用于个性化的漫画人脸生成。同时,学习获得人脸参数控制的形变与褶皱生成模型,以驱动人脸合成个性化人脸动画。本文工作具体包括以下几个部分:
     1.提出了一种基于人脸形状子空间的个性化漫画人脸生成方法。基于真实人脸和漫画人脸二者的形状数据集采用主成份分析(PCA:Principal Component Analysis)建立形状特征子空间,可以表征人脸的多特征基元。基于多特征基元,对一批真实人脸及其相应的漫画人脸采用ELM(Extreme Learning Machine)学习二者之间的映射模型。最后用该模型对输入的真实人脸预测其漫画人脸形状。
     2.提出了一种人脸几何参数控制的个性化人脸动画方法。传统单纯的人脸几何控制图像变形可以高效表现人脸形变,但是无法表现褶皱细节,例如额头皱纹、酒窝。本文首先定义弹塑表情比率图(Flexible Expression Ratio Image, FERI),并用主成分分析(Principal Component Analysis, PCA)将其压缩成Eigen FERI,以准确量化人脸的褶皱。然后基于训练库学习获得人脸形变机制和起皱机制。形变机制利用几何控制图像变形来驱动人脸形变,起皱机制则利用支持向量机(Support Vector Machine, SVM)来驱动褶皱,最后二者结果进行合并可以生成具有褶皱纹理的个性化人脸动画。
     3.进行了集成应用研究。对主动形状模型ASM (Active Shape Model)进行了应用研究,能够有效应用于人脸照片的特征提取,从照片中发现人脸,并提取特征点。使得本文系统自动化程度提高;对基于图切分(Graphcut)理论的图像分割进行了研究,能够有效用于人脸照片背景的去除。通过ASM检测到人脸区域后,即获得了有用的前景信息,代替传统Graphcut中的交互操作,实现了人脸背景去除的自动化。
     4.开发了基于人脸照片的漫画生成系统。本文基于Windows XP操作系统,采用Visual C++为开发工具,对前述模块进行集成和封装,能够全自动对人脸照片进行处理,变形生成漫画人脸。
     本文主要贡献在于:1)能够采用机器学习方法解决个性化漫画人脸的模式学习问题。基于子空间的映射学习方法可同步发现人脸的多项特征,并实现整体协调变形。对本文方法生成的漫画人脸与常用的规则法产生的变形人脸进行了实验比较,并采用平均满意度的方法对实验结果进行评测,表明本文生成的漫画人脸在夸张性和艺术性方面均比规则法有较大提高。2)采用机器学习方法解决个性化人脸动画过程中褶皱纹理生成的问题。可以由人脸形变参数预测人脸的褶皱纹理,产生个性化动画效果。
Nowadays, creative culture industry is developing dramatically in all the cities of our country. Caricature and cartoon are such favorite content of all kinds of people. This paper conducts the studies of automatic generating caricatures based on facial photographs. Different from the traditional methods based on regularities, it focuses on leaning knowledge from the manual works of artists and applying the knowledge for automatic generating caricatures. There are some aspects that in studied in this paper.
     1. This paper presents an approach for caricature synthesis from facial photograph. It takes the mixed samples of true faces and cartoon faces as training set to build low dimensional linear subspace. Based on the subspace, it obtains two series of projecting vectors for some sample pairs of true and cartoon faces. The ELM is employed then to learn the mapping function for those series of data.
     2. Geometry-controlled image warping performs well in exhibiting shape variations but bad in exhibiting wrinkle such as fossette. In this paper, it firstly defines FERI(Flexible Expression Ratio Image) and compress it as Eigen FERI to exactly quantize wrinkle independent of facial shape variation. Then, it builds a geometry-mapped photorealistic facial animation synthesis mechanism consisting of shape-varying mechanism and wrinkling mechanism. Given the geometric motion parameter FAP(Facial Animation Parameter), the former drives facial shape variation by geometry-controlled image warping and the latter drives wrinkle by SVM (Support Vector Machine).
     4. The system of caricature generation is implemented in the environment of Windows with the developing package of MS Visual C++6.0. It can provide the users the function of processing the facial photographs and output the caricature results.
     The experiments show that mapping learning in the subspace can discovery the multiple features of the input face and realize harmonious warping successfully. Finally the result is evaluated by the metric of subjective average satisfied degree. It shows approach can generate caricature with higher performance than the regularity method in aspects of exaggeration and artistry.
引文
1. S. Brennan. Caricature generator [D]. Cambridge:Massachusettes Institute of Technology,1982.
    2. Koshimizu H, Tominaga M, Fujiwara T,et al. On Kansei facial processing for computerized facial caricaturing system Picasso, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, 1999:294-299.
    3. E. Akleman:Making caricature with morphing. Visual Proceedings of ACM SIGGRAPH'97 (Siggraph Sketch), Los Angeles, California,1997.
    4. H. Chen, Y. Xu, H. Shum, S. Zhu, and N. Zheng. Example based facial sketch generation with non-parametric sampling. Proceedings of international conference of computer vision (ICCV),433-438,2001.
    5. CHEN Hong, ZHENG Nan-Ning, LIANG Lin, XU Ying-Qing, SHUM Heung-Yeung. Example-Based Automatic Portraiture. Journal of Computer, 2003,26 (2):147-152.
    6. CHEN Hong, ZHENG Nan-Ning, XU Ying-Qing, SHUM Heung-Yeung. An Example-Based Facial Sketch Generation System, Journal of Software,2003,14(2):202-208.
    7. Lin Liang, Hong Chen, Ying-Qing Xu, Heung-Yeung Shum:Example-based Caricature Generation with Exaggeration, IEEE Proceedings of the 10th Pacific Conference on Computer Graphics and Applications,2002.
    8. GuangZhe Xu, Masahide Kaneko and Akira Kurematsu:" Synthesis of facial caricature using eigenspaces, " IEICE Trans. D-Ⅱ, 2001, J84-D-II(7):1279-1288.
    9. Pei-Ying Chiang, Wen-Hung Liao, Tsai-Yen Li:Automatic Caricature Generation by Analyzing Facial Features,2004 Asian Conference on Computer Vision, Jeju Island, Korea,2004.
    10. Rein-Lien Hsu, Anil K. Jain, Generating Discriminating Cartoon Faces Using Interacting Snakes. IEEE Trans. Pattern Anal. Mach. Intell.2003, 25(11):1388-1398.
    11. Gooch B., Reinhard E., Gooch A.:Human facial illustrations:Creation and psychophysical evaluation. ACM Trans. Graph.2004,23(1):27-44.
    12. T. Beier and S. Neely. Feature-based image metamorphosis. In Computer Graphics, pages 35-42. Siggraph, July 1992.
    13. P. Litwinowicz and L. Williams, "Animating Images with Drawings, " Computer Graphics, pp.235-242, Aug.1990.
    14. G. Wolberg. Digital Image Warping. IEEE Computer Society Press,1990.
    15. Moiza. G, Tal. A, Shimshoni. I, Barnett. D, Moses. Y. Reconstruction of movies of facial expressions. IEEE ICCV 2001, Page(s):8-15,2001
    16. F. Pighin, J. Hecker, D. Lischinski, R. Szeliski, D. H. Salesin. Synthesizing Realistic Facial Expressions from Photographs. SIGGRAPH 1998, pp.75-84,1998.
    17. Qingshan Zhang, Liu Z., Gaining Quo, Terzopoulos D., Heung-Yeung Shum. Geometry-driven photorealistic facial expression synthesis. Visualization and Computer Graphics, IEEE Transactions on Volume 12, Issue 1, Jan.-Feb.2006 Page(s):48-60.
    18. Terzopoulos D, Waters K. Physically-Based Facial Modeling, Analysis, and Animation. Journal of Visualization and Computer Animation, Vol. 1, pp.73-80,1990.
    19. Goudeaux, K., Tsuhan Chen, Shyue-Wu Wang, Jen-Duo Liu. Principal component analysis for facial animation. Proc. ICASSP'01. Page (s):1501-1504 vol.3.2001.
    20.杜杨洲,林学訚.基于形状外观关联映射的动态脸部纹理生成(英文).Journal of Software,2004,15(2):308-316.
    21. Liu Z, Shan Y, Zhang Z. Expressive expression mapping with ratio images. In Proc. SIGGRAPH'01, Los Angeles, CA, USA,2001, pp.271-276.
    22. J. Y. Noh and U. Neumann, "Expression Cloning, " Proc. ACM SIGGRAPH Conf., pp.277-288,2001.
    23. H. Pyun, Y. Kim, W. Chae, H. W. Kang, and S. Y. Shin, "An Example-Based Approach for Facial Expression Cloning" Proc.2003 ACM SIGGRAPH/Eurographics Symp. Computer Animation, pp.167-176,2003.
    24. T. F. Cootes, C.J.Taylor, D. H. Cooper, J.Haslam, Training Models of Shape from Sets of Examples[C]. British Machine Vision Conference. Springer-Verlag,1992:9-18
    25. T. F. Cootes, C. J. taylor. Active shape models—"smart snakes" [C]. Proceeding of the British Vision Conference, Leeds, UK, September 1992, Lodon, Springer-verlag,1992:266-275
    26. T. F. Cootes, C.J.Taylor, A. Lanitis. Multi-Resolution Search with Active Shape Models[C]. Proc. ICPR 1994.
    27. T. F. Cootes, C.J.Taylor, D. Cooper, J. Graham. Active shape models—their training and application [J]. Computer vision and image understanding,61(1),1995:38-59
    28. T. F. Cootes, G. J. Edwards, C. J. Taylor. Active Appearance Models [J]. Proc. European Conf. Computer Vision,1998,2:484-498
    29. Y. Boykov, and M.-P. Jolly, "Interactive Graph cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images. " In IEEE International Conference on Computer Vision, pp.2001.105-112.
    30. Michael T. Orchard, and Charles BOUMAN. Color Quantization of Images.
    IEEE Transactions on Signal Processing.1991, Vol39, N012:2677-2690.
    31. C. Rother, V. Kolmogorov and A. Blake, "Grabcut-Interactive Foreground Extraction Using Iterated Graph cuts. " In ACM SIGGRAPH 2004, pp.2004.309-314.
    32.何晓群,多元统计分析,人民大学出版社,2004,北京。
    33. M. Turk and A. Pentland, "Eigenfaces for Recognition", J. Cognitive Neuroscience, vol.3, no.1, pp.71-86,1991.
    34. SMITHE, D. B.1990. A two-pass mesh warping algorithm for object transformation and image interpolation. Technical memo #1030, Industrial Light and Magic.
    35. BOOKSTEIN, F. L. Principal Warps:Thin-plates splines and decomposition of deformations, IEEE Trans. Pattern Analysis and Machine Intelligence (1989), vol 11(6), pp.567-585.
    36. BEIER, T AND NEELY, S. Feature-based Image Metamorphosis[C]//In: Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, New York,1992:35-42.
    37. Lee S, Chawa K-Y, Shin SY, Wolberg G. Image metamorphosis using snakes and free-form deformations. (Proceedings of SIGGRAPH'95)Computer Graph, pp439-448,1995.
    38.蒋宗礼,人工神经网络导论,高等教育出版社,2002年12月,北京。
    39. G.-B. Huang, Q.-Y. Zhu and C.-K. Siew. Extreme Learning Machine:Theory and Applications. Neurocomputing.2006,70:489-501.
    40. Y. Li, J. Sun, C. Tang and H. Shum, "Lazy Snapping. " In ACM SIGGRAPH 2004, pp.2004.303-308.
    41. Boykov Y, Kolmogorov V. An experimental comparison of mincut/max-f low algorithms for energy minimization in vision[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(9):1124~1137.
    42. RK. Sahoo, S. Soltani, A. K. C. Wang, an dY C. Chen, A Surveyof Thresholding Techniques. Computer Vision, Graphics and Image Processing, V41, pp 233-260.1988
    43. A. Hummel, R epresentations based on zero-crossings in scale-space, Proc. IEEE Computer Vision and Pattern Recognition Conf.,19 86,pp.204-209
    44. LawrenceH.Staib, andJ amesS.Duncan, B oundary Finding with Paramctrically Deformable Models, IEEE Trans On Patern Analysis and Machine Intelligence,1992, Vol.14, No.11, pp.1061-1075.
    45. Tim McInerney and DemetriT erzopoulos. Deformable Models in Medical Image Analysis:A Survey, in Medical Image Analysis,1(2),1996
    46. Curvature Depende 川Speed:Algorithms Based on Hamilton-Jacobi Formulation-Journalof Computational Physics 79:12-49.
    47. JeanB abaud, Andrew P. WitkinM ichelB audin, and Richard Duda, Uniqueness of the Gausian Kernel for Scale-Space Filtering, IEEE Trans On Pattern Analysis and Machine Intelligence,1986, Val.8, No.1, pp. 26-33.
    48. Narendra Ahuja, A Transform for Multiscale Image Segmentation by Integrated Edge and Region Detection, IEEE Trans On Pattern Analysis and Machine Intelligence,1996, Vol.18, No.12, pp.1211-1234.
    49. M. Buster, J. Comel is, and A. Rosenfeld, A criticalview of pyramid Segmentation algorithms, Patern Recognition Leters,1990, Vol. Ⅱ, No.0, pp.605-617
    50. YJ. Zhang, A survey on Evaluation methods for image segmentation, Patern Recognition,1996, Voh29, No.8, pp.1335-1346.
    51. Perez, P., Gangnet, M., and Blake, A.2003. Poisson image editing. ACM Trans. Graph.22,3 (Jul.2003),313-318.
    52. NikhilR. Pala nd SankarK.Pal, A Review on Image Segmentation Techniques, Pattern Recognition,1993,26(9):1277-1294.
    53. Bao-Cai Yin, Cheng-Zhang Wang, Qin Shi, Yan-Feng Sun. MPEG-4 Compatible 3D Facial Animation Based on Morphable Model. Proc. Machine Learning and Cybernetics 2005, Page(s):4936-4941,2005.
    54. Stan Z. Li, Ying Zheng, Zhen Lei, ZengFu Wang. Shape and Texture Based Deformable Models for Image Analysis. In Deformable Models-Theory & Biomaterial Applications, Suri, Jasjit S.& Farag, Aly (Eds.). Springer. ISBN:0-387-31204-8. May 2006
    55. C. Hu, R. Feris, and M. Turk. Active wavelet networks for face alignment. In British Machine Vision Conference, East Eaglia, Norwich, UK,2003.
    56. Xiangsheng Huang, Stan Z. Li, Yangsheng Wang:Evaluation of Face Alignment Solutions Using Statistical Learning. FGR 2004:213-218
    57. Jiang Dalong, Wang Zhaoqi,Gao Wen. The Realization of 3-D Facial-Animation Based on MPEG-4. Journal of System Simulation. Vol.13 Suppl, pp.493-496, Nov.2001.
    58. B. Lucas and T. Kanade. An iterative image registration technique with an application to stereo vision. IJCAI'81, pages 674-679,1981.
    59. V. Vapnik. Statistical Learning Theory. Wiley, New York, NY,1998.
    60.贾云涛,胡事民。基于图切分的交互式图像染色算法。计算机学报,2006,第29卷,第3期:508。
    61.刘则毅,徐高奎,丁雅斌。一种新的图像合成方法。中国图像图形学报,2007,第12卷,第3期:432。
    62.章毓晋.过渡区和图像分割.电子学报,1996,2“1):12-17。
    63.罗希平,田捷,诸葛婴等,图像分割方法综述,模式识别与人工智能,1999,12(3):300-312
    64.周仁琴,周经野,陈益强,刘军发,基于特征发现的卡通人脸肖像生成,计算机辅助设计与图形学学报,2006,18(9):1362-1366.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700