CVHTML

JING XIAO

1166 Sunnyvale Saratoga Road,
Unit# 7,
Sunnyvale, CA 94087, USA

jing.xiaoj@gmail.com

EDUCATION

Ph.D., September 1999 - May 2005
Robotics Institute, School of Computer Science, Carnegie Mellon University

Dissertation Title: "Reconstruction, Registration, and Modeling of Deformable Object Shapes"
Advisor(s): Professor Takeo Kanade, Professor Jeffrey Cohn

M.S., September 1996 - July 1999
National Laboratory of Pattern Recognition, Institute of Automation , Chinese Academy of Sciences

Thesis Title: "Image Enhancement, Segmentation, and Feature Grouping"
Advisor(s): Professor Songde Ma

B.S., Septembet 1991 - July 1996
Automation Department, University of Science and Technology of China

Thesis Title: "Automatic Road Extraction from Satellite Images"
Advisor(s): Professor Songde Ma

RESEARCH EXPERIENCE

Senior Member of Technical Staff - Research Scientist June 2005 - Present
Epson Palo Alto Lab, Epson Research and Development, Inc., , Palo Alto , CA, USA

Conduct research on computer vision, pattern recognition, computer animation, and related areas. Specific topics include digital document analysis, multi-language OCR from scanned document images, feature selection, real-time 2D/3D visual tracking and modeling, face and facial expression recognition, and projector-camera systems.

Research Assistant September 1999 - May 2005
Robotics Institute, School of Computer Science, Carnegie Mellon University, Pittsburgh , PA, USA

Conduct research on computer vision, pattern recognition, computer animation, and related areas. Specific topics include non-rigid object shape and motion recovery from video, deformable shape registration and modeling, 3D shape reconstruction and modeling of human faces, real-time 2D/3D visual tracking, facial expression recognition, and facial animation.

Research Intern May 2004 - August 2004
Siemens Corporate Research, Inc., Princeton, NJ, USA

Developed algorithms and programs for automatically registering, tracking, and modeling 3D deformations of the myocardial wall from 3D ultrasound images. This work led to two invention disclosures filed with Siemens Corporate Research, Inc.

Research Intern May 2001 - August 2001
Automated Cell, Inc., Pittsburgh, PA, USA

Worked as part of an interdisciplinary team to develop a system for automatic segmentation, classification, and quantification of living cells in microscopic images. The system was used to investigate the performance of antibodies in inhibiting the growth of cancer cells and identify functional antibody candidates and targets. My role focused on image stabilization of microscopic images, cell segmentation, and quantification.

Research Assistant December 1995 - July 1999
National Laboratory of Pattern Recognition, Institute of Automation , Chinese Academy of Sciences, Beijing, P.R. China

Conducted research on computer vision, image processing, pattern recognition, and related areas. Specific topics included far-infrared image enhancement, image segmentation, feature extraction and grouping, and automatic detection and extraction of roads and bridges from satellite images and of blood vessels from medical images.

Research Assistant February 1994 - December 1995
Advanced Process Control Lab, Automation Department, University of Science and Technology of China, Hefei, Anhui, P.R. China

Conducted research on automatic control. Was member of a team developing a distributed control system for controlling the ambient environment in a spacecraft cabin and monitoring the health of the astronauts.

MEDIA AND DEMOS

Please see http://www.cs.cmu.edu/~jxiao/research.html.

PUBLICATIONS

Journal Papers

Deformable Object Tracking, Reconstruction, and Modeling

J. Xiao, J. Chai, T. Kanade, "A Linear Closed-Form Solution to Non-rigid Shape and Motion Recovery," International Journal of Computer Vision (IJCV), Feb. 2006.
I. Matthews, J. Xiao, and S. Baker, "On the Dimensionality of Deformable Face Models," under review, available as tech. report CMU-RI-TR-06-12, Robotics Institute, Carnegie Mellon University, March, 2006.

2D/3D Motion Analysis and Facial Expression Recognition

T. Moriyama, J. Xiao, J. Cohn, T. Kanade, "Meticulously Detailed Eye Region Model and Its Application to Analysis of Facial Images," IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (PAMI), May 2006.
J. Xiao, T. Moriyama, T. Kanade, J. Cohn, "Robust Full Motion Recovery of Head for Facial Expression Analysis," International Journal of Imaging Systems and Technology , vol. 13, pp. 85-94, September 2003. (pdf)
J. Cohn, J. Xiao, T. Moriyama, Z. Ambadar, T. Kanade, "Automatic Recognition of Eye Blinking in Spontaneously Occurring Behavior," Behavior Research Methods, Instruments, and Computers, vol. 35, pp. 420-428, 2003. (pdf)

Visual Synthesis and Computer Animation

J. Chai, J. Xiao, J. Hodgins, "Vision-based Control of 3D Facial Animation," in preparation.

Image Enhancement and Segmentation

M. Tang, S. Ma, J. Xiao, "Model-based Adaptive Enhancement of Far Infrared Image sequences," Pattern Recognition Letters, vol. 21, no. 9, pp. 827-835, 2000.
M. Tang, J. Xiao, S. Ma, "Model-Based Adaptive Enhancement of Infrared Images and Its Applications," Chinese Journal of Computer Science, vol. 23, no. 8, pp. 893-896, 2000. (in Chinese)

Feature Grouping and Object Detection

Z. Yang, J. Xiao, S. Ma, "Visual Position and Orientation Orders," Chinese Journal of Image and Graphics, vol. 3, no. 5, 1998. (in Chinese)

Conference Papers

Deformable Object Tracking, Reconstruction, and Modeling

J. Xiao, B. Georgescu, X. Zhou, D. Comaniciu, T. Kanade, "Simultaneous Registration and Modeling of Deformable Shapes," IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2006. (pdf)
J. Liebelt, J. Xiao, J. Yang, "Robust AAM Fitting by Fusion of Images and Disparity Data," IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2006. (pdf)
J. Xiao, T. Kanade, "Uncalibrated Perspective Reconstruction of Deformable Structures," International Conference on Computer Vision (ICCV), 2005. (pdf)
S.C. Koterba, S. Baker, I. Matthews, C. Hu, J. Xiao, J. Cohn, and T. Kanade, "Multi-View AAM Fitting and Camera Calibration," International Conference on Computer Vision (ICCV), 2005. (pdf)
J. Xiao, T. Kanade, "Non-Rigid Shape and Motion Recovery: Degenerate Deformations," IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 668-675, 2004. (pdf)
J. Xiao, S. Baker, I. Matthews, T. Kanade, "Real-Time Combined 2D+3D Active Appearance Models," IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), pp. 535-542, 2004. (pdf)
J. Xiao, J. Chai, T. Kanade, "A Closed-Form Solution to Non-rigid Shape and Motion Recovery," The 8th European Conference on Computer Vision (ECCV), pp. 573-587, 2004. (pdf) (ORAL)
C. Hu, J. Xiao, I. Matthews, S. Baker, J. Cohn, T. Kanade, "Fitting a Single Active Appearance Model Simultaneously to Multiple Images," British Machine Vision Conference (BMVC), pp. 437-446, 2004. (pdf) (ORAL)
S. Baker, I. Matthews, J. Xiao, R. Gross, T. Ishikawa, T. Kanade, "Real-Time Non-Rigid Driver Head Tracking for Driver Mental State Estimation," The 11th World Congress on Intelligent Transportation Systems, 2004. (pdf) (ORAL)

2D/3D Motion Analysis and Facial Expression Recognition

J. Xiao, T. Kanade, J. Cohn, "Robust Full Motion Recovery of Head by Dynamic Templates and Re-registration Techniques," The 5th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 156-162, 2002. (pdf)
T. Moriyama, J. Xiao, J. Cohn, T. Kanade, "A Meticulously Detailed Eye Model," IEEE International Conference on Systems, Man and Cybernetics, pp. 629-634, 2004. (pdf) (ORAL)
J. Cohn, L. Reed, T. Moriyama, J. Xiao, K. Schmidt, Z. Ambadar, "Multimodal coordination of facial action, head rotation, and eye motion during spontaneous smiles," The 6th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 129-135, 2004. (pdf) (ORAL)
J. Cohn, L. Reed, Z. Ambadar, J. Xiao, T. Moriyama, "Automatic Recognition of Facial Actions in the Brow Region and Consideration of their Timing," IEEE International Conference on Systems, Man and Cybernetics, pp. 210-216, 2004. (pdf) (ORAL)
J. Cohn, J. Xiao, T. Moriyama, J. Gao, Z. Ambadar, T. Kanade, "Action unit recognition in spontaneous facial behavior," International Conference on Methods and Techniques in Behavioral Research, pp. 48-50, 2002. (INVITED)
T. Moriyama, T. Kanade, J. Cohn, J. Xiao, Z. Ambadar, J. Gao, M. Imanura, "Automatic recognition of eye blinking in spontaneously occurring behavior," The 16th International Conference on Pattern Recognition (ICPR), pp. 78-81, 2002. (pdf) (ORAL)

Visual Synthesis and Computer Animation

J. Chai, J. Xiao, J. Hodgins, "Vision-based Control of 3D Facial Animation," ACM Symposium on Computer Animation (SCA), pp. 193 - 206, 2003. (pdf) (ORAL)
J. Yang, J. Xiao, M. Ritter, "Automatic Selection of Visemes for Image-Based Visual Speech Synthesis," IEEE International Conference on Multimedia and Expo, pp. 1081-1084, 2000. (pdf) (ORAL)

Image Enhancement and Segmentation

M. Tang, J. Xiao, S. Ma, "Semantically Homogeneous Segmentation with Nonparametric Region Competition," The 15th International Conference on Pattern Recognition (ICPR), pp. 648-651, 2000. (pdf)
M. Tang, J. Xiao, S. Ma, "Two-Step Classification Based on Scale Space," The 15th International Conference on Pattern Recognition (ICPR), pp. 899-902, 2000. (pdf)
M. Tang, J. Xiao, S. Ma, "Model-Based Adaptive Enhancement of the Infrared Image Sequence," IEEE 4th Joint Conference on Information Sciences (JCIS), 1998. (pdf)

Feature Grouping and Object Detection

J. Xiao, Z. Yang, S. Ma, "Some General Grouping Principles: Line Perception From Points As An Example," The 14th International Conference on Pattern Recognition (ICPR), pp. 1825-1827, 1998. (pdf) (ORAL)
J. Xiao, Z. Yang, Q. Ke, S. Ma, "Linear Feature Extraction Using Local and Global Grouping Factors," IEEE 4th Joint Conference on Information Sciences (JCIS), 1998. (pdf)
Z. Yang, J. Xiao, "Scaling Laws in Image Gradient Fields and Texture Retrieval," The 14th International Conference on Pattern Recognition (ICPR), pp. 1062-1064, 1998. (pdf)
Z. Yang, J. Xiao, S. Ma, "How Line Perception Emerges From Points," IEEE International Conference on Intelligent Processing Systems (ICIPS), pp.1460-1464, 1997.
Z. Yang, S. Ma, J. Xiao, "A Similarity Measurement of Deformable Shapes," IEEE International Conference on Intelligent Processing Systems (ICIPS), pp.1455-1459, 1997.
Q. Ke, J. Xiao, Z. Yang, S. Ma, "An Energy-based Method for Road Extraction from Satellite Images," IAPR Workshop on Machine Vision Applications (MVA), pp. 337-340, 1996.

Technical Reports

J. Xiao, J. Chai, T. Kanade, "A Linear Closed-Form Solution to Non-rigid Shape and Motion Recovery," Technical Report CMU-RI-TR-03-16, Robotics Institute, CMU, 2003. (pdf)
S. Baker, I. Matthews, J. Xiao, R. Gross, T. Ishikawa, T. Kanade, "Real-Time Non-Rigid Driver Head Tracking for Driver Mental State Estimation," Technical report CMU-RI-TR-04-10, Robotics Institute, CMU, 2004. (pdf)
J. Cohn, T. Kanade, T. Moriyama, Z. Ambadar, J. Xiao, J. Gao, H. Imamura, "A Comparative Study of Alternative FACS Coding Algorithms," Technical Report CMU-RI-TR-02-06, Robotics Institute, CMU, 2001. (pdf)

Other Talks

"Reconstruction, Registration, and Modeling of Deformable Object Shapes," Dept. of Computer and Information Sciences, University of Delaware, May 2006.
"Reconstruction, Registration, and Modeling of Deformable Object Shapes," Thesis defense talk, Robotics Institute, CMU, May 2005.
"Reconstruction, Registration, and Modeling of Deformable Object Shapes," Siemens Corporate Research, Feb. 2005.
"Reconstruction, Registration, and Modeling of Deformable Object Shapes," Epson Palo Alto Lab, Feb. 2005.
"Non-Rigid Object Shape and Motion Recovery from Video," Thesis proposal talk, Robotics Institute, CMU, November 2003.
"A Linear Closed-Form Solution to Non-rigid Shape and Motion Recovery," Annual retreat seminar of the Vision and Autonomous Systems Center (VASC), Robotics Institute, CMU, August 2003.
"Real-Time Model-Based 3D Head Motion Recovery," Human Identification at a Distance (HID) Seminar, Robotics Institute, CMU, May 2002.

INVENTION DISCLOSURES

Robust Generative Features, Epson Research and Development, Inc., Palo Alto, CA 94304.
Color-based Methods for Accelerating Projector-Camera Geometric Calibration, Epson Research and Development, Inc., Palo Alto, CA 94304.
Precise Identification of Text Pixels from Scanned Document Images, Epson Research and Development, Inc., Palo Alto, CA 94304.
Efficient Dual Photography, Epson Research and Development, Inc., Palo Alto, CA 94304.
Modeling Light Transport in Complex Display Systems, Epson Research and Development, Inc., Palo Alto, CA 94304.
The View Projection Matrix, Epson Research and Development, Inc., Palo Alto, CA 94304. (Provisional Patent)
Automatic 3D Motion Recovery of Myocardium in 3D Echocardiography, Siemens Corporate Research, Inc., Princeton, NJ 08540.
Automatic Registration and Modeling of 3D Deformable Myocardium Shapes, Siemens Corporate Research, Inc., Princeton, NJ 08540.

TEACHING EXPERIENCE

Teaching Assistant January 2003 - May 2003
Undergraduate course CS15381: "Artificial Intelligence: Problem Solving, Representation, and Learning," School of Computer Science, Carnegie Mellon University.

Designed and graded assignments, exams, and final projects; led recitation sections; supervised groups of students on their final projects; met with students during office hours; and provided online assistance using the class bulletin board.

ACTIVITIES

Reviewers for IEEE transactions such as PAMI, IJCV, IJIST, and VCG.
Reviewers for IEEE international conferences such as CVPR, ACCV, FG, etc.
Member of IEEE.
Member of ACM.

HONORS AND AWARDS

Travel Grant Award, IEEE International Conference on Computer Vision and Pattern Recognition, 2004.
Research Fellowship, Carnegie Mellon University, 1999-present.
Academia Sinica President Scholarship, Chinese Academy of Science, 1999 (The most prestigious scholarship).
Academia Sinica Huawei Scholarship, Chinese Academy of Science, 1998.
Best Student Scholarship, Institute of Automation, Chinese Academy of Science, 1998.
Academia Sinica Elite Scholarship, Chinese Academy of Science, 1997.
Excellent Student Scholarship, University of Science and Technology of China, 1995.
Legend Scholarship, University of Science and Technology of China, 1994.
Excellent Student Scholarship, University of Science and Technology of China, 1993.

SKILLS AND INTERESTS

Languages:
Computer skills:
Hobbies and Interests:

REFERENCES

Available upon request.