Hierarchical facial data modeling for visual expression synthesis

Journal of Visualization - Tập 6 - Trang 313-320 - 2003
Y. Zhang1, E. C. Prakash2, E. Sung2
1Division of Control & Instrumentation Engineering, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore
2Center for Graphics and Imaging Technology, Division of Computer Science, School of Computer Engineering, Nanyang Technological University, Singapore

Tóm tắt

This paper presents a new method for modeling of a personalized 3D face model that has a hierarchical structure of the skin, muscle, and skull for realistic expression synthesis. We start from an accurate facial mesh reconstructed from the individual face measurements. The deformable skin model has a multi-layer structure to approximate different types of soft tissue and takes into account the nonlinear stress-strain relationship and incompressibility of the real skin. The 3D face model incorporates the skull structure which extends the scope of facial motion and facilitates interactive facial muscle insertion. Under the muscular force, the deformation of the facial skin is evaluated by the numerical integration of the governing Lagrangian dynamics. The resulting animation system enables realistic facial expressions to be dynamically synthesized.

Tài liệu tham khảo

Choi, C. S., Aizawa, K., Harashima, H. and Takebe, T., Analysis and Synthesis of Facial Image Sequences in Model-based Image Coding, IEEE Trans. Circuits and Systems for Video Technology, 4-3 (1994), 257–275. DiPaola, S., Extending the Range of Facial Types, Journal of Visualization and Computer Animation, 2–4 (1991), 129–131. Ekman, P. and Friesen, W. V., Facial Action Coding System, (1978), Consulting Psychologists Press Inc., 577 College Avenue, Palo Alto, California. Hashimoto, S., Sato Y. and Oda, H., Modification of Facial Expression Using Spring Frame Model, Proceedings of IASTED, (1996), 9–15. Kalra, P., Mangili, A., Thalmann, N. M. and Thalmann D., Simulation of Facial Muscle Actions Based on Rational Free Form Deformations, Proceedings of Eurographics’92, (1992), 59–69. Parke, F. I., Computer Generated Animation of Faces, (1972), Master’s Thesis, University of Utah, Salt Lake City. Parke, F. I., Parameterized Models for Facial Animation, IEEE Computer Graphics and Application, 2–9 (1982), 61–68. Schroeder, W. J., Zarge, J. A. and Lorensen, W. E., Decimation of Triangle Meshes, Proceedings of SIGGRAPH’92, (1992), 65–70. Sera, H., Morishima, S. and Terzopoulos, D., Physics-based Muscle Model for Mouth Shape Control, Proceedings of IEEE Interantional Workshop on Robot and Human Communication, (1996), 207–212. Su, M. S., Ko, M. T. and Cheng, K. Y., Feature-point-driven Facial Animation using A Hypothetical Face, Computer Graphics Forum, 20-4 (2001), 179–188. Terzopoulus, D. and Waters, K., Physically-based Facial Modeling, Analysis and Animation, Journal of Visualization and Computer Animation, 1 (1990), 73–80. Van Gelder, A., Approximate Simulation of Elastic Membranes by Triangulated Spring Meshes, Journal of Graphics Tools, 3-2 (1998), 21–41. Williams, L., Performance-driven Facial Animation, Proceedings of SIGGRAPH’90, (1990), 235–242. Wu, Y., Kalra, P., Moccozet, L. and Thalmann, N. M., Simulating Wrinkles and Skin Aging, The Visual Computer, 15-4 (1999), 183–198. Zhang, Y., Prakash, E. C. and Sung, E., A Physically-based Model with Adaptive Refinement for Facial Animation, Proceedings of IEEE Computer Animation 2001, (2001), 28–39.