Takaaki Shiratori

Researcher
Visual Computing Group
Microsoft Research Asia

Building 2, No. 5 Dan Ling Street, Haidian District
Beijing, 100080, China
Email: takaakis (AT) microsoft.com


This page will not be updated anymore. Please visit my new web page.


I am a Researcher of the Visual Computing Group at Microsoft Research Asia. I received my PhD from The University of Tokyo in 2007 under the supervision of Prof. Katsushi Ikeuchi. After the graduation, I worked at the Computer Graphics Lab of Carnegie Mellon University as a Postdoctoral Fellow and a Project Scientist, and then worked at Disney Research Pittsburgh as a Postdoctoral Associate, with Prof. Jessica Hodgins.

My research is in the fields of computer graphics, computer vision, and human-computer interaction, with particular interests in User Interfaces for Character Animation and Character Interaction.

NEWS! Our motion capture project is featured by Inside Science Television!


Selected Projects

Motion Capture from Body-Mounted Cameras

ACM TOG (SIGGRAPH 2011)
[Project page] [Paper] [Video]
A Puppet Interface for Retrieval of Motion Capture Data

Symposium on Computer Animation 2011
[Project page] [Paper] [Video]
MotionBeam: A Metaphor for Character Interaction with
Handheld Projectors

ACM CHI 2011 (full paper)
[Project page] [Paper] [Video]
3D Reconstruction of a Moving Point from a Series of
2D Projections

ECCV 2010 (oral)
[Project page] [Paper] [Video] [Youtube]
Temporal Scaling of Leg Motion for Music Feedback System of
a Dancing Humanoid Robot

IEEE/RSJ IROS 2010
[Paper] [Video] [Youtube]
Simulating Balance Recovery Responses to Trips Based on
Biomechanical Principles

Symposium on Computer Animation 2009
[Project page] [Paper] [Video] [Youtube]
Accelerometer-based User Interfaces for the Control of
a Physically Simulated Character

ACM TOG (SIGGRAPH Asia 2008)
[Project page] [Paper] [Video] [Youtube]
Temporal Scaling of Upper Body Motion for
Sound-Feedback System of a Dancing Humanoid Robot

IEEE/RSJ IROS 2007
[Project page] [Paper] [Video] [Youtube]
Summary: [pdf] [poster]
Dancing-to-Music Character Animation

Computer Graphics Forum (Eurographics 2006)
[Project page] [Paper] [Youtube]
Summary: [pdf] [poster]
Video Completion by Motion Field Transfer

IEEE CVPR 2006
[Project page] [Paper]
Detecting Dance Motion Structure Using
Motion Capture and Musical Information

IEEE FGR 2004
[Paper]
Summary: [pdf] [poster]

Publication List

Journal Papers

  • Takaaki Shiratori, Hyun Soo Park, Leonid Sigal, Yaser Sheikh, Jessica K. Hodgins
    "Motion Capture from Body-Mounted Cameras"
    ACM Transactions on Graphics (Proc. SIGGRAPH 2011), July 2011
    [Project page] [Paper]
  • Takaaki Shiratori, Jessica K. Hodgins
    "Accelerometer-based User Interfaces for the Control of a Physically Simulated Character"
    ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2008), December 2008
    [Project page] [Paper]
  • Takaaki Shiratori, Katsushi Ikeuchi
    "Synthesis of Dance Performance Based on Analyses of Human Motion and Music"
    IPSJ Transactions on Computer Vision and Image Media, Vol. 1, No. 1, pp. 34-47, June 2008
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Dancing-to-Music Character Animation"
    Computer Graphics Forum, Vol. 25, No. 3 (Proc. Eurographics 2006), pp. 449-458, Sep. 2006
    [Project page] [Paper]
  • Katsushi Ikeuchi, Takaaki Shiratori, Shunsuke Kudoh, Hirohisa Hirukawa, Shin'ichiro Nakaoka, Fumio Kanehiro
    "Robots that Learn to Dance from Observation"
    IEEE Intelligent Systems, Vol. 23, No. 2, pp. 74-76, March/April 2008
    [IEEE]
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Task Recognition and Person Identification in Cyclic Dance Sequences with Multi Factor Tensor Analysis"
    IEICE Trans. on Information and Systems, May 2008
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Motions using Motion Capture"
    The Journal of Three Dimensional Images, Vol. 17, No. 4, pp. 77-84, December 2003

Conference Papers

  • Naoki Numaguchi, Atsushi Nakazawa, Takaaki Shiratori, Jessica K. Hodgins
    "A Puppet Interface for Retrieval of Motion Capture Data"
    In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2011), August 2011
    [Project page] [Paper]
  • Karl D.D. Willis, Ivan Poupyrev, Takaaki Shiratori
    "MotionBeam: A Metaphor for Character Interaction with Handheld Projectors"
    In Proc. ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2011), May 2011
    [Project page] [Paper]
  • Takahiro Okamoto, Takaaki Shiratori, Shunsuke Kudoh, Katsushi Ikeuchi
    "Temporal Scaling of Leg Motion for Music Feedback System of a Dancing Humanoid Robot"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010), October 2010
    [Paper]
  • Bjoern Rennhak, Takaaki Shiratori, Shunsuke Kudoh, Phongtharin Vinayavekhin, Katsushi Ikeuchi
    "Detecting Dance Motion Structure Using Body Components and Turning Motions"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2010), October 2010
  • Hyun Soo Park, Takaaki Shiratori, Iain Matthews, Yaser Sheikh
    "3D Reconstruction of a Moving Point from a Series of 2D Projections"
    In Proc. European Conference on Computer Vision (ECCV 2010), September 2010 (oral)
    [Project page] [Paper]
  • Takaaki Shiratori, Brooke Coley, Rakié Cham, Jessica K. Hodgins
    "Simulating Balance Recovery Responses to Trips Based on Biomechanical Principles"
    In Proc. ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2009), August 2009
    [Project page] [Paper]
  • Takaaki Shiratori, Brooke Coley, Rakié Cham, Jessica K. Hodgins
    "Modeling and Simulation of Balance Recovery Responses to Tripping"
    In Proc. Annual Meeting for the American Society of Biomechanics, August 2009 (conference abstract)
  • Takaaki Shiratori, Atsushi Nakazawa, Shin'ichiro Nakaoka, Shunsuke Kudoh, Katsushi Ikeuchi
    "Task Models of Upper Body Motion for a Dancing Humanoid Robot Based on Motion and Music Features"
    In Proc. International Workshop on Art and Robots in conjunction with IROS 2008, September 2008
  • Takaaki Shiratori, Shunsuke Kudoh, Shin'ichiro Nakaoka, Katsushi Ikeuchi
    "Temporal Scaling of Upper Body Motion for Sound Feedback System of a Dancing Humanoid Robot"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
    [Project page] [Paper]
  • Miti Ruchanurucks, Shunsuke Kudoh, Koichi Ogawara, Takaaki Shiratori, Katsushi Ikeuchi
    "Humanoid Robot Painter: From Object to Trajectory"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Multilinear Analysis for Task Recognition and Person Identification"
    In Proc. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2007), October 2007
  • Jun Takamatsu, Takaaki Shiratori, Shin'ichiro Nakaoka, Shunsuke Kudoh, Atsushi Nakazawa, Fumio Kanehiro, Katsushi Ikeuchi
    "Entertainment Robot: Learning from Observation Paradigm for Humanoid Robot Dancing"
    In Proc. International Workshop on Art and Robots in conjunction with IROS 2007, October 2007
  • Miti Ruchanurucks, Shunsuke Kudoh, Koichi Ogawara, Takaaki Shiratori, Katsushi Ikeuchi
    "Humanoid Robot Painter: Visual Perception and High-Level Planning"
    In Proc. IEEE International Conference on Robotics and Automation (ICRA 2007), April 2007
  • Daisuke Miyazaki, Mawo Kamakura, Tomoaki Higo, Yasuhide Okamoto, Rei Kawakami, Takaaki Shiratori, Akifumi Ikari, Shintaro Ono, Yoshihiro Sato, Mina Oya, Masayuki Tanaka, Katsushi Ikeuchi, Masanori Aoyagi
    "3D Digital Archive of the Burghers of Calais,"
    In Proc. International Conference on Virtual Systems and Multimedia (VSMM 2006), Lecture Notes in Computer Science (LNCS), October 2006
  • Manoj Perera, Takaaki Shiratori, Shunsuke Kudoh, Atsushi Nakazawa, Katsushi Ikeuchi
    "Task Recognition and Style Analysis in Dance Sequences"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2006), September 2006
  • Takaaki Shiratori, Yasuyuki Matsushita, Sing Bing Kang, Xiaoou Tang
    "Video Completion by Motion Field Transfer"
    In Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2006), June 2006
    [Project page] [Paper] [Poster]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Synthesizing Dance Performance Using Musical and Motion Features"
    In Proc. IEEE International Conference on Robotics and Automation (ICRA 2006), May 2006
    [Project page] [Paper]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Structure Detection of Dance Sequence using Motion Capture and Musical Information"
    In Proc. International Symposium on CREST Digital Archiving Project, March 2005
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Detecting Dance Motion Structure using Motion Capture and Musical Information"
    In Proc. International Conference on Virtual Systems and Multimedia (VSMM 2004), November 2004
    [Paper]
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Detecting Dance Motion Structure through Music Analysis"
    In Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2004), May 2004
    [Paper]
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Motions using Motion Capture"
    In Proc. International Conference on Humans and Computers (HC 2003), August 2003
  • Takaaki Shiratori, Atsushi Nakazawa, Katsushi Ikeuchi
    "Rhythmic Motion Analysis using Motion Capture and Musical Information"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2003), July 2003
  • Atsushi Nakazawa, Shinichiro Nakaoka, Takaaki Shiratori, Katsushi Ikeuchi
    "Analysis and Synthesis of Human Dance Motions"
    In Proc. IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI 2003), July 2003

Ph.D. Dissertation

  • Takaaki Shiratori, "Synthesis of Dance Performance Based on Analyses of Human Motion and Music", Ph.D. Dissertation, The University of Tokyo, March 2007

Misc