Jean Oh is an Associate Research Professor at the Robotics Institute at Carnegie Mellon University. Jean is passionate about creating persistent robots that can co-exist and collaborate with humans in shared environments, continuously learning to improve themselves over time through training, exploration, and interactions. Toward this general goal, her current research is focused on the topics at the intersection among vision, language, and planning in robotics. Jean has been leading several robot intelligence tasks in government, defense, and commercial projects in various problem domains including human-robot teaming, self-driving cars, disaster response, eldercare, and arts.
Jean heads an interdisciplinary research group, roBot Intelligence Group (BIG), that includes postdoctoral researchers, PhD, MS, and undergraduate students from the Robotics Institute, Language Technologies Institute, Computer Science Department, Machine Learning Department, School of Information Science, and Mechanical Engineering Department.
Jean's team has won several Best Paper Awards or Finalists at IEEE International Conference on Robotics and Automation (ICRA), IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE-RAS 22nd International Conference on Humanoid Robots (Humanoids). Notably, FRIDA robot painting and AI Pilot have been featured in various media around the world including New York Times, The Telegraph, Petit Quotidien, Australian Broadcasting Corporation, Aviation Today, Maeil Business Newspaper, and Korean Broadcasting Systems.
Jean received her Ph.D. in Language and Information Technologies at Carnegie Mellon University, M.S. in Computer Science at Columbia University, and B.S. in Biotechnology at Yonsei University in South Korea.
Summer 2019. Xinjie Yao, a senior student from the Hong Kong University of Science and Technology, worked with Ji Zhang and me on social navigation. Below is the video showing her demo at the Robotics Institute Summer Scholars (RISS) final presentation session. Xinjie's work will also be presented at International Conference on Intelligent Robots and Systems (IROS) at the Late Breaking Results poster session in Macau in October, 2019.
Summer 2018. Brandon Trabucco from UC Berkeley, co-mentored by Ralph Hollis and myself, presented his work on detailed image captioning at the Robotics Institute Summer Scholars (RISS) poster session. Brandon is definitely a student with many talents; he also performed "My Way" at the program's final ceremony. (photo: with another summer student, Kai-Chi Huang from UT Austin, and an RI PhD student, Roberto Shu.)
Summer 2017. A Robotics Institute Summer Scholars (RISS) student, Matthew Wilson from University of Utah, co-mentored by Ralph Hollis and myself, worked on the "Go, Look, and Tell" project where he developed a speech interface to command a Shmoo (ballbot) to navigate autonomously, recognize semantic objects, and report what it has seen back to the user.
May 2018.A. Vemula, K. Muelling, J. Oh. Social Attention: Modeling Attention in Human Crowds. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Brisbane, Australia, 2018. (Best Paper Award in Cognitive Robotics) [ArXiv].
May 2015. A. Boularias, F. Duvallet, J. Oh, and A. Stentz. Learning to ground spatial relations for outdoor robot navigation. In Proc. of IEEE Conference on Robotics and Automation (ICRA), Seattle, WA, 2015. (Best Paper Award in Cognitive Robotics). [pdf].
