用户名: 密码: 验证码:
人脸图像变形动画技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
人脸图像变形动画技术是计算机动画研究的一个重要分支。无论是电影电视、游戏娱乐、远程通信还是虚拟环境,人脸动画技术都被应用其中,为人们的交流、文化和娱乐带来极大的便利和乐趣,因此,这一研究领域越来越受到人们的关注。它涉及到人体生理学、心理学、艺术、计算机图形学和视觉等等多个学科。在此领域,无数的研究者奉献了自己的心力,为我们带来更好更有表现力的人脸动画技术。
     本文研究的是二维人脸图像的变形动画技术。文章概括了几种常见的人脸特征提取方法,系统的介绍了各种图像变形技术和人脸动画技术,总结了图像变形的基本原理、现状研究和存在的问题。在人脸图像特征区域提取方面,通过对不同提取方法适用范围的对比,针对人脸图像结构特征和局部变形动画实现的需要,采用了积分投影与数据分析的特征区域的提取方法。在源图像到目标图像间的变形方面,提出了改进的基于特征线段的图像变形方法。这种方法先要从源图像和目标图像提取出的特征中,找出对应的特征线对,建立起两幅图像之间的映射关系。再对源图像和目标图像按一定比例进行插值,由此生成一组渐变的人脸变形图像。针对改进前的方法存在着计算量较大、运行等待时间较长的问题,本文改进后的算法运行速度有了明显提高。人脸局部变形方面,本文提出了一种基于像素点位移的变形方法,即通过一定的映射关系使图像中的像素点的像素值的位移发生改变,从而生成新的变形图像。本文以人脸局部变形中变化最明显的嘴巴和眼睛为例,研究和分析了它们的变形算法思想,提出了具体的算法。该算法生成的人脸局部变形动画连续性好、可参数化交互实现多种变形效果。
     本文主要就人脸图像变形动画技术的两大核心环节——人脸特征提取、图像变形展开说明,从实践的角度,论述了相关技术的实现过程。研究的方法和实验数据具备一定的实用参考价值。
Human face image morphing animation technology is an important branch of the computer animation research. Facial animation technology has been applied in film and television, video games, remote communication, and virtual environment, which brings great convenience and fun in the exchange of people, cultural and entertainment. Therefore, this field of research attracts more and more attention. It involves human physiology, psychology, art, computer graphics,vision and so on. In this field, many researchers devote their effort to bring us better and more expressive human face animation technology.
     This article discusses morphing animation technology of 2D human face image.This article generalizes some common human face feature extraction method, introduces systematically a variety of image morphing technology and facial expression animation technology, summarizes the basic principle of image morphing, research actuality and existent problem.In the facial image feature extraction, through the comparison of application range of different extraction methods, in allusion to the configuration character of human face images and need of local animation warping actualized used in the article experiment,this article use the integral projection of extraction methods and get the feature area. In the respect of morphing between original images and target images, the article use image morphing method based on feature line after arithmetic improved. Firstly find the corresponding feature lines and establish a mapping between two images from feature points from original images and target images. Then interpolate original images and target images by a certain percentage, and this will generate a gradual morphing facial image. However, as this method before arithmetic improved costs a large amount of calculation, longer waiting time of running, the speed of method after arithmetic improved is quickly. In the respect of part facial morphing, the paper presents a morphing method based on pixel displacement, which is, through some mapping the image, pixels displacement change and generate a new image. This article takes mouth and eyes which changes the most obviously on the face as examples, and research and analyze the thought of morphing algorithm. This algorithm creat good continuity, and can preferences produce manifold morphing effort.
     This paper explains facial feature extraction and image morphingthe facial image morphing which are two core areas of the human face image morphing animation technology, and discusses the implementation process of related technologies.The studied method and experiment date are provided with a practical value.
引文
[1]Gao P, Sederberg TW. A work minimization approach to image morphing. The Visual Computer,1998,14:345-350.
    [2]D Beymer and T Poggio. Image representation for visual learning. Scienee,1996, 272:1905-1909.
    [3]C S Choi, T Okazald, H Harashima, and T Takebe. A systemo analyzing and synthesizing facial images. In Proe IEE Int Symposium of Circuit and Syatems(ISCAS91),1991:2665-2668.
    [4]A Lanitis, C J Taylor, and T F Cootes. Automatic interpretation and coding of face images using flexible models. IEEE Transaetions on Pattern Analysis and Machine Intelligenee,1997,19(7):743-756.
    [5]F Pighin, J Heeker, D Lisehinske, Szeliski R, and D Salesin. Synthesizing realistic facial expressings from photographs. In Computer Graphics Proeeedings SIGGRAPH'98,1998:75-84.
    [6]Rupreeht D, Muller H. Deformed cross-dissovles for interpolation in scientific visualization. J Visualization Comput Anim,1995:167-181.
    [7], Biehsel M. Automatic interpolation and recognition of face images by morphing. The 2nd International on Face and Gesture Recognition, Killington, Vermont, IEEE Computer Soeiety Press, LosAlamitos, CA,1996:128-135.
    [8]Coven M. Eigen-points:control-point loeation using principal component analysis. The 2nd International on Automatic face and gesture recognition, Killington, Vermont, IEEE Computer Society Press,1996:122-127.
    [9]Bregler C, Co vell M, Slaney M. Video rewrite:driving visual speech with audio. Proceedings of SIGGRAPH'97, Comput Graph,1997:353-360.
    [10]Ezzat T, Poggio T. Facial analysis and synthesis using image-based models. The 2nd International on Automatic Face and Gesture Reeognition, Killington, Vermont, IEEE Computer Soeiety Press, Los Alamitos, CA,1996:116-121.
    [11]L Sirovieh and M Kirby. Low-dimensional procedure for the characterizat-ion of human faces. Journal of the Optical Soeiety of America,1987:519-554.
    [12]T Vetter and T Poggio. Linear object classes and image synthesis from aSingle example image. IEEE Transaetions on Pattern Analysis and Machine Intelligence, 1997,19(7):733-742.
    [13]Smythe D B. A two-pass mesh warping algorithm for object gransformati-on and image interpolation. Technical report 1030, ILM Computer Graphi-cs Department, Lucasfilm, San, Rafael, Calif,1989:244-251.
    [14]Igarashi T, Moseovieh T and Hughes J F. As Rigid-as-possible Shape Manipulation. ACM Transaction on Graphics,2005,24(3):1134-1141.
    [15]Gibson S F, Mirtieh B. A Survey of Deformable Modeling in Computer Graphics. Mitsubishi Eleetric Researeh Laboratories,1997:201-209.
    [16]Celniker G, Gossard D. Deformable Curve and Surface Finite-elements for Free-form Shape Design. Proeeedings of SIGGRAPH Conference, Las Vegas, USA,1991:257-266.
    [17]James D L, Pai D K. Artdefo:Aeeurate real time deformable objects. In SIGGRAPH 1999 conference Proeeedings, Los Angeles, USA 1999:65-72.
    [18]Alexa M, Cohen D, Levin D. As-rigid-as-possible Shape Interpolation. In SIGGRAPH 2000 Conference Proceedings, New Orleans, USA,2000:157-164.
    [19]Yu Y, Zhou K, Xu D et al. Mesh Editing with Poisson-based Gradient Field Manipulation. ACM Transaction on Graphics,2004,23(3):644-651.
    [20]Sorkine O, Lipman Y, Alexa M et al. Laplacian Surface Editing. In Symposium on Geometr Proeeedings,2004:179-188.
    [21]Lipman Y, Sorkine O, Levin D et al. Linear Rotation-invariant Coordinates for Meshes. ACM Transaction on Graphies,2005,24(3):479-487.
    [22]Zhou K, Huang J, Snyder J et al. Large Mesh Deformation Using the Volumetric Graph Laplaeian. ACM Transaction on Graphies,2005,24(3):496-503.
    [23]Seott S, Travis M, Joe W. Image Deformation Using Moving Least Squares. In Proeeeding of SIGGRAPH, Boston, USA,2006,25(3):533-540.
    [24]Yanlin W, Wei wei X, Yanchen W et al.2D Shape Deformation Using Nonlinear Least Squares optimization. The Visual Computer:International Journal of Computer GraPhics,2006,22(9):600-653.
    [25]Bledsoe W. Man-machine facial recognition[M]. Palo Alto, CA:Panoramic Research Inc,1966:434-462.
    [26]Berto R, Poggio T. Face recognition:Feature versus templates [J]. IEEE Trans on PAMI,1993,15(10):1042-1052.
    [27]Lam K M, Yan H. An analytic-to-holistic approach for face recognition based on a single frontal view[J]. IEEE Trans on PAMI,1998,20(7):673-687.
    [28]Lanitis A, Taylor C J, Cootes T F. Automatic interpretation and coding of face images using flexible models J. IEEE Trans on PAMI,1997,19(7):743-756.
    [29]杜杨洲,林学訚.基于形状外观关联映射的动态脸部纹理生成[J].软件学报,2004,15(2):308-316.
    [30]Huang C L, Chen C W. Human facial feature extraction for face interpretation and recognition[J]. Pattern Recognition.1992,25(12):1435-1444.
    [31]Nakamura O, Mathur S, Minami T. Identification of human face based on isodensity maps J. Pattern Reco gnition,1991,24(3):263-272.
    [32]Lades M, Vorbuggen J, Buhmann J et al. Distortion invariant object recognition the dynamic link architecture[J]. IEEE Trans on Computers,1991,42(3): 300-311.
    [33]Samaria F, Young S. HMM-based architecture for face identification[J]. Image and Vision Computing,1994,12(8):537.
    [34]刘向东,陈兆乾.人脸识别技术的研究[J].计算机研究与发展,2004,41(7):1074-1080.
    [35]李小红.基于积分投影的人脸图像的特征提取[J].计算机仿真,2004,21(12):189-191.
    [36]赖剑煌,阮邦志,冯国灿.一种基于小波变换和Fourier变换的人像识别新方法[J].中国图象图形学报,1999,4(10):811-817.
    [37]杨洁,冯力刚,蒋加伏.基于小波变换的频谱特性及人工免疫的人脸识别[J].计算机仿真,2004,21[12]:176-178.
    [38]Hong Ziquan. Algebraic feature extraction of image for recognition[J]. Pattern Recognition1991,24(3):211-219.
    [39]Wolberg G. Digital Image Warping[M]. Los Alamitos:IEEE Computer Society Press,1990.
    [40]张静波,张桂林.基于特征网格的面部图像变形算法[J].中国图像图形学报[A],2002,7(3):56-260.
    [41]朱桂斌,张邦礼,吴乐华等.基于Delaunay三角剖分的图像变形技术研究[J].中国图像图形学报[A],2003,8(6):641-646.
    [42]Beier T, Neely S. Feature-Based Image Metamor-phosis[J]. Computer Graphics, 1992,26(2):35-42.
    [43]Reisfeld D, Arad N, Dyn N et al. Image Warping by Radial Basis Functions: Application to Facial Expressions[J]. CVGIP:Graphical Models and Image Processing,1994,56(2):161-172.
    [44]Arad N, Reisfeld D. Image Warping Using Few Anchor Points and Radial Functions [J]. Computer Graphics Forum,1995,14(1):35-46.
    [45]翁妙凤,吴翰声,盛蔚.人像变换的图像处理方法研究[J].计算机研究与发展,1996,33(9):677-682.
    [46]李旭东,张振跃.非对称径向基函数与稳定边界图像变形算法[J].计算机辅助设计与图形学学报,2004,16(6):747-752.
    [47]Lee S, Chwa K Y, Hahn J, et al. Image Morphing Using Deformable Surfaces[C]. Computer A nimation'94, Geneva, Switzerland,1994.
    [48]Litwinowicz P, Williams L. Animating Images with Drawings[M]. New York: ACM Press,1994.
    [49]Lee S, Chwa K Y, Hahn J et al. Image Morphing Using Deformation Techniques[J]. Journal of Visualization and Computer Animation,1996,7(1): 3-23.
    [50]Beier T, Neely S. Feature-based image metamorphosis. SIGGRAPH'92 Conference Proeeedings, Chieago, Illinois, U. S.1992,26:34-42.
    [51]付昀.人脸图像渐变算法研究.中国图像图形学报,2003,Vo1.8(A):174-182.
    [52]John Holland. Adaption in Natural and Artificial System[M]. Unit of Michigan press, Ann Arbor,1976.
    [53]David E Goldberg. Genetic algorithems in Search, Optimization, and Machine Learning[M]. Reding, MA:Addison Wesley,1989.
    [54]Ravise C, Sebag M. Advanced Evolution Should not repeat its pas errors[C]. In: Saitta L ed. Proceedings of the 13th international conference on Machine Learning,1996:400-408.
    [55]Sebag M, Schoenauer N. A society of LliLL-Climbers[C]. In:proceedings of 1997, IEEE international conference on Evolutionary Computation, Indianapolis, 1997:319-324.
    [56]Baluja S, Caruans R. Emoting the Genetic from the standard Genetic Algorithms[C]. In:Prieditis A, Russel S eds. Proceedings of international conference on Machine Learning,1995:38-46.
    [57]Srinivas M, Patnaik L M. Adaptive probabilities of crossover and mutation in genetic algorithems[J]. IEEE Trans on Systems, Man and Cybernetics,1994: 24(4):656-667.
    [58]Hesser J, Manner R, Towards an optimal mutation probabilities for genetic algorithems[C]. In:Schwefel H P, Manner R P eds. Proc of the first international workshop on Parallel Problem Solving from Nature. Heideberg, Berlin: Springer-Varlag,1990:23-32.
    [59]Back T, Fogel D B, Michalewicz Z. Handbook of Evolutionary Compution[M]. New York:University Oxford Press,1997:217-220.
    [60]Waters K, Levergood T. An Automatic Lip Synchronization Algorithm for Synthetic Faces[J]. ACM,1994:149-156.
    [61]H Sera, S Morishma, D Terzopoulos. Physics-based Musele Model for Moth Shape Control[J]. IEEE International Workshop on Robot and Human Connnunieation,1996:207-212.
    [62]Cohen M, Massara D, Modeling Co-articulation in Synthetic Visual Speech. In Magnenat-Thalmann and Model and Technique in Computer Animation[J][S.l.]. Visualization and Computer Animation, March,1990,1(4):73-80.
    [63]Terzopoulos D, Fleischar K. Deformable Model. [S.l.]:The Visual Computer, 1998,4(6):306-331.
    [64]B Lucas and T Kanade. An iterative image registration technique with an application to stereo vision[M]. In Proceedings of the International Joint Conference on Artificial Intelligence,1981.
    [65]S M Platt, N Badler. Animating facial expression[J]. Computer GraPhies,1981, 15(3):245-252.
    [66]Keith Waters. A Musele Model for Animating Three-Dimensional Facial Expression[J]. Computer GraPhies,1987,21(4):17-24.
    [67]Yueneheng Lee, Demetri Terzopoulos, Keith Waters. Realistic Modeling for Facial Animation[A]. In:Computer Graphics Proeeedings, Annual Conference Series[C].1995.55-62.
    [68]张汗灵.基于图像的绘制关键技术研究[D].西安:西北工业大学,2003.
    [69]David T Chen, Andrei State, David Banks. Interaetive Shape Metamorphosis. In: Symposium on Interaetive 3D Graphics[C].1995.43~44.
    [70]Frederic Pighin, Joel Auslander, Dani Lisehinski, David H. Salesin, Riehard Szeliski. Realistic Facial Animation Using Image-Based 3D Morphing, UW-CSE-97-01-03,1997.
    [71]Frederic Pighin, Jamie Hecker, Dani Lisehinski, Richard Szeliski, David H Salesin. Synthesizing Realistie Facial Expressions from Photographs [A]. In: Computer Graphics Proceedings, Annual Conferenc Series[C].1998.75-84.
    [72]M Oka, K Tsutsui, A ohba, Y Jurauehi, T Tago. Real-time Manipulation of texture-mapped surface[A]. In:Computer Graphics Proceedings, Annual Conference Series[C].1987.181-188.
    [73]Edge J and Maddoek, S. (2001)Expressive visual speech using geometric music functions. Proc. Eurographivs UK 2001.
    [74]晏洁,高文.基于一般人脸模型修改的特定人脸合成技术.计算机辅助设计与图形学学报,1999.
    [75]晏洁,高文,尹宝才.具有真实感的三维虚拟特定人脸图象生成方法.计算机学报,1999.
    [76]Williams L. Performance-driven facial animation. Proceedings of ACM SIGGRAPH'90,1990,24,235-242.
    [77]Sturman D J. Computer puppetry, IEEE Computer Graphics and Applications, 1998,18(1),38-45.
    [78]Patterson E C, Litwinowiez P C, Facial animation by spatial mapping, Proceedings of Computer Animation'91, N. Magnenat-Thalmatm and D. Thalmann, eds,1991.
    [79]Cosatto E, Ostermann J, Lifelike talking faces for interaetive services, Proceedings of IEEE,2003,91(9),1406-1428.
    [80]AshishV L. Venkata S. Animation expressive faces across languages. IEEE Transactions on Multimedia,2004,6(6),791-800.
    [81]Lei X, Zhi Qiang L. Realistic mouth-synching for speech driven talking face using articulatory modeling. IEEE Transactions on Multimedia,2007,9(3),500-510.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700