Publications

Ingrid Navarro & Jean Oh. Social-PatteRNN: Socially-Aware Trajectory Prediction Guided by Motion Patterns. In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022 (to appear)

Xinjie Yao, Ji Zhang & Jean Oh. RCA: Ride Comfort-Aware Visual Navigation via Self-Supervised Learning. In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022 (to appear)

Fan Yang, Chao Cao, Hongbiao Zhu, Jean Oh & Ji Zhang. FAR Planner: Fast, Attemptable Route Planner using Dynamic Visibility Update. In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022 (to appear)

P. Schaldenbrand, Z. Liu, and J. Oh.  StyleCLIPDraw: Coupling content and style in text-to-drawing translation. In proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI'22) (to appear). [Code repo][Demo]

Shankar T, Lin Y, Rajeswaran A, Kumar V, Anderson S, and Oh J. Translating Robot Skills: Learning Unsupervised Skill Correspondences Across Robots. International Conference on Machine Learning (ICML'22) (to appear).

Jay Patrikar, Brady Moon, Jean Oh, Sebastian Scherer. Predicting Like A Pilot: Dataset and Method to Predict Socially-Aware Aircraft Trajectories in Non-Towered Terminal Airspace. IEEE International Conference on Robotics and Automation (ICRA), 2022. [ Arxiv:2109.15158]

H. Yu and J. Oh, "Anytime 3D Object Reconstruction Using Multi-Modal Variational Autoencoder," In: IEEE Robotics and Automation Letters, vol. 7, no. 2, pp. 2162-2169, April 2022, doi: 10.1109/LRA.2022.3142439. (to be presented at ICRA'22)

Chao Cao, Hongbiao Zhu, Fan Yang, Yukun Xia, Howie Choset, Jean Oh, Ji Zhang. Autonomous Exploration Development Environment and the Planning Algorithms. In: IEEE International Conference on Robotics and Automation (ICRA), 2022. [Arxiv]

Jonathan Francis, Nariaki Kitamura, Felix Labelle, Xiaopeng Lu, Ingrid Navarro,and Jean Oh. Core Challenges in Embodied Vision-Language Planning, Journal of Artificial Intelligence Research (JAIR) 2022. [PDF]

T. M. Howard, E. Stump, J. Fink, J. Arkin, R. Paul, D. Park, S. Roy, D. Barber, R. Bendell, K. Schmeckpeper, J. Tian, J. Oh, M. Wigness, L. Quang, B. Rothrock, J. Nash, M. R. Walter, D. Patel, F. Jentsch, and N. Roy. "An Intelligence Architecture for Grounded Language Com- munication with Field Robots". In: Journal of Field Robotics (JFR), Special Edition on Human- Robot Teaming (2021).

H.-G. Jeon, S. Im, B.-U. Lee, D.-G. Choi, J. Oh, I. S. Kweon, and M. Hebert. "A Large-sacle Virtual Dataset and Egocentric Localization for Disaster Responses." In: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) (2021).

M. R. Walter, S. Patki, E. Fahnestock, F. Duvallet, S. Hemachandra, N. Roy, T. M. Howard, and J. Oh. "Language Understanding for Field and Service Robots in a Priori Unknown Environments." In: Journal of Field Robotics (JFR), Special Edition on Human-Robot Teaming (2021).

M. Wigness, J. Rogers, C. Mertz, L. Navarro-Serment, and J. Oh. "Using Perception Cues for Context-Aware Navigation in Dynamic Outdoor Environments." In: Journal of Field Robotics (JFR), Special Edition on Human-Robot Teaming (2021).

C. Mavrogiannis, P. Trautman, A. Steinfeld, D. Zhao, A. Wang, F. Baldini, and J. Oh.  Core Challenges of Social Navigation: A Survey, 2021. [ Arxiv:2103.05668]

H. Yu and J. Oh.  Anchor Distance for 3D Multi-Object Distance Estimation from 2D Single Shot, IEEE Robotics and Automation Letters (RA-L), 2021 (to be presented at the IEEE Conference on Robotics and Automation (ICRA'21)). [Arxiv]

H. Yu and J. Oh.  A Missing Data Imputation Method for 3D Object Reconstruction using Multi-modal Variational Autoencoder, 2021. [Arxiv]

P. Schaldenbrand and J. Oh.  Content Masked Loss: Human-Like Brush Stroke Planning in a Reinforcement Learning Painting Agent. In: Proc. of AAAI Conference on Artificial Intelligence (AAAI). 2021. [Arxiv]

D. Zhao and J. Oh. Noticing Motion Patterns: Temporal CNN with a Novel Convolution Operator for Human Trajectory Prediction. In: IEEE Robotics and Automation Letters (RA-L), Special Issue on Long-Term Human Motion Prediction (2020). [Arxiv]

A. Bidgoli, M. L. De Guevara, C. Hsiung, J. Oh, and E. Kang.  Artistic Style in Robotic Painting; a Machine Learning Approach to Learning Brushstroke from Human Artists. In: The 29th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN). 2020. [Arxiv]

T.-E. Tsai and J. Oh  A Generative Approach for Socially Compliant Navigation, In: IEEE Conference on Robotics and Automation (ICRA). 2020. [Arxiv]

H.-G. Jeon, S. Im, J. Oh, and M. Hebert  Learning Shape-based Representation for Visual Localization in Extremely Changing Conditions, In: IEEE Conference on Robotics and Automation (ICRA). 2020. [ pdf]

B.-U. Lee, K. Lee, J. Oh, and I. Kweon  CNN-based Simultaneous Dehazing and Depth Estimation, In: IEEE Conference on Robotics and Automation (ICRA). 2020. [pdf ]

F. Labelle, X. Lu, N. Kitamura, and J. Oh.  Modular Pretraining for Vision Language Navigation. In: Embodied Vision, Actions & Language (EVAL) Workshop at European Conference on Computer Vision (ECCV). 2020.

J. Oh, M. Hebert, H.-G. Jeon, X. Perez, C. Dai, Y. Song Explainable Semantic Mapping for First Responders, Artificial Intelligence for Humanitarian Assistance and Disaster Response Workshop at NeurIPS 2019. [ArXiv]

X. Yao, J. Zhang, and J. Oh  Autonomous Human-Aware Navigation in Dense Crowds, In: Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (Late breaking results). 2019.

X. Yao, J. Zhang, and J. Oh  Following Social Groups: Socially-Compliant Autonomous Navigation in Dense Crowds, In: Cognitive Vehicles Workshop at IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2019.

J. Tian and J. Oh  Image Captioning with Compositional Neural Module Networks, International Joint Conference on Artificial Intelligence (IJCAI) 2019 [pdf].

K. E. Schaefer, J. Oh, D. Aksaray, and D. Barber.   Integrating Context into Artificial Intelligence: Research from the Robotics Collaborative Technology Alliance. AI Magazine, Volume 30 Number 3, Fall 2019. [aaa.org][pdf]

T.-H. Lin, T. Bui, D. S. Kim, and J. Oh.  A Multimodal Dialogue System for Conversational Image Editing. In The Second Workshop on Conversational AI at the Thirty-second Conference on Neural Information Processing Systems (NeurIPS), 2018.

A. Vemula, K. Muelling, J. Oh. Social Attention: Modeling Attention in Human Crowds. In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2018 [ArXiv].  *Best Paper Award in Cognitive Robotics*

S.-R. Shiang, A. Gershman and J. Oh.   A Generalized Model for Multimodal Perception. AAAI Fall Symposium, November 2017 [pdf].

J. Hu, D. Fan, S. Yao and J. Oh.   Answer-Aware Attention on Grounded Question Answering in Images. AAAI Fall Symposium, November 2017 [pdf].

A. Vemula, K. Muelling, J. Oh. Modeling cooperative navigation in dense human crowds. In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2017 [pdf].

M. Oh-Park and J. Oh.  Assistive technology for geriatric population. Chapter 16, Geriatric Rehabilitation. Elsevier, 2017.

S. Shiang, S. Rosenthal, A. Gershman, J. Carbonell, J. Oh. Vision-Language Fusion for Object Recognition.  In Proc. of AAAI Conference on Artificial Intelligence (AAAI), 2017. [pdf]

J. Hu, J. Oh, A. Gershman. Learning Lexical Entries for Robotic Commands using Crowdsourcing. In Proc. of AAAI Conference on Human Computation (HCOMP), 2016 (short paper).[pdf]

A. Vemula, K. Muelling, J. Oh. Path Planning in Dynamic Environments with Adaptive Dimensionality. In Proc. of International Symposium on Combinatorial Search (SoCS) 2016. [pdf]

J. Oh, M. Zhu, S. Park, T.M. Howard, M.R. Walter, D. Barber, O. Romero, A. Suppe, L. Navarro-Serment, F. Duvallet, A. Boularias, J. Vinokurov, T. Keegan, R. Dean, C. Lennon, B. Bodt, M. Childers, J. Shi, K. Daniilidis, N. Roy, C. Lebiere, M. Hebert, and A. Stentz. Integrated intelligence for human-robot teams. In Proc. of International Symposium on Experimental Robotics (ISER) 2016 [pdf].

A. Boularias, F. Duvallet, J. Oh, and A. Stentz. Learning Qualitative Spatial Relations for Robotic Navigation. in  Proc. of International Joint Conference on Artificial Intelligence (IJCAI), 2016 [pdf].

J. Oh, L. Navarro-Serment, A. Suppe, A. Stentz, M. Hebert, Inferring door locations from a teammate's trajectory in stealth human-robot team operations. In Proc. of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2015 [pdf].

J. Oh, A. Suppe, F. Duvallet, A. Boularias, J. Vinokurov, L. Navarro-Serment, O. Romero, R. Dean, C. Lebiere, M. Hebert, and A. Stentz. Toward mobile robots reasoning like humans. In Proc. of AAAI Conference on Artificial Intelligence (AAAI), 2015. [pdf]

A. Boularias, F. Duvallet, J. Oh, and A. Stentz. Learning to ground spatial relations for outdoor robot navigation. In Proc. of IEEE Conference on Robotics and Automation (ICRA), 2015. [pdf]  *Best Paper Award in Cognitive Robotics*

J. Oh, F. Meneguzzi, and K. Sycara. Chapter 11: Probabilistic Plan Recognition for Proactive Assistant Agents. In: Plan, Activity, and Intent Recognition: Theory and Practice, 1st Edition, Ed. G. Sukthankar, R. P. Goldman, C. Geib, D. V. Pynadath, H. Bui, Elsevier, 2014. [Elsevier] 

A. Oltramari, Y. Vinokurov, J. Oh C. Lebiere, and A. Stentz. Ontology-based cognitive system for contextual reasoning in robot architectures. In Proc. of AAAI Spring Symposium on Knowledge Representation and Reasoning in Robotics, 2014.

F. Duvallet, M.R. Walter, T. Howard, S. Hemachandra, J. Oh, S. Teller, N. Roy, and A. Stentz. Inferring maps and behaviors from natural language instructions. In Proc. of International Symposium on Experimental Robotics (ISER), 2014. [pdf]

A. Oltramari, Y. Vinokurov, C. Lebiere, J. Oh, and A. Stentz. A hybrid cognitive system for spatial reasoning in a robotics framework. In Proc. of the Second Annual Conference on Advances in Cognitive Systems, 2013.

J. Oh, A. Suppe, A. Stentz, and M. Hebert. Enhancing robot perception using human teammates. In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 1147-1148, 2013. [pdf]

J. Oh, F. Meneguzzi, K. P. Sycara, and T. J. Norman. Prognostic normative reasoning. Engineering Applications of Artificial Intelligence, 26(2):863-872, 2013. [pdf]

S. Ososky, D. Schuster, F. Jentsch, S. Fiore, R. Shumaker, C. Lebiere, U. Kurup, J. Oh, and A. Stentz. The importance of shared mental models and shared situation awareness for transforming robots from tools to teammates. In SPIE Defense, Security, and Sensing, 2012.

F. Meneguzzi, J. Oh, N. Chakraborty, K. P. Sycara, S. Mehrotra, J. Tittle, and M. Lewis. A cognitive architecture for emergency response. In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 1161-1162, 2012. [pdf]

J. Oh, F. Meneguzzi, K. P. Sycara, and T. J. Norman. Prognostic normative reasoning in coalition planning. In Proc. of International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 1233-1234, 2011. [pdf] (A version appeared in Advanced Agent Technology, Lecture Note in Computer Science, Volume 7068, Springer, 2012. [Springer])

J. Oh, F. Meneguzzi, K. P. Sycara, and T. J. Norman. Introduction to prognostic normative reasoning. In Proc. of AAMAS Workshops, pages 503-504, 2011.

J. Oh, F. Meneguzzi, K. Sycara, and T. Norman. An agent architecture for prognostic reasoning assistance. In Proc. of International Joint Conference on Artificial Intelligence (IJCAI), pages 2513-2518, 2011. [pdf]

J. Oh, F. Meneguzzi, and K. Sycara. Probabilistic plan recognition for intelligent information agents. In Proc. of the Third International Conference on Agents and Artificial Intelligence, pages 281-287, 2011. [pdf]

R. Azevedo, G. Biswas, D. Bohus, T. Carmichael, M. A. Finlayson, M. Hadzikadic, C. Havasi, E. Horvitz, T. Kanda, O. Koyejo, W. F. Lawless, D. B. Lenat, F. Meneguzzi, B. Mutlu, J. Oh, R. Pirrone, A. Raux, D. A. Sofge, G. Sukthankar, and B. Van Durme. Reports of the aaai 2010 fall symposia. AI Magazine, 32(1):93-100, 2011.

M. Sensoy, D. Masato, T. J. Norman, M. J. Kollingbaum, C. Burnett, K. Sycara, and J. Oh. Agent support for policy-driven mission planning under constraints. In AAAI Fall Symposium: Proactive Assistant Agents, 2010.

J. Oh, F. Meneguzzi, K. Sycara, and T. J. Norman. An agent architecture for intelligent information assistance. In Proc. of the Fourth Conference of the International Technology Alliance, 2010. (a version appeared in Proc. of the Nineteenth European Conference on Artificial Intelligence (ECAI), 2010).

F. Meneguzzi, J. Oh, and K. Sycara. Intelligent information assistance for coalition operations. In Proc. of the Sixth International Conference on Knowledge Systems for Coalition Operations, 2010.

J. Oh. Multiagent social learning in large repeated games. Thesis, Language Technologies Institute, School of Computer Science, Carnegie Mellon University, 2009. [pdf]

J. Oh and S. F. Smith. A few good agents: Multi-agent social learning. In Proc. of the Seventh International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS), pages 339-346, 2008. [pdf]

J. Oh, J.E. Hwang, S. F. Smith, and K. Koile. Learning from Main Streets: A machine learning approach identifying neighborhood commercial districts, pages 325-340. Springer Netherlands, 2006. [pdf]

J. Oh, J.E.Hwang, and S. F. Smith. Agent technologies for post-disaster urban planning. In AAMAS Workshop on Agent Technology for Disaster Management, 2006.

E. Fink, P. M. Jennings, U. Bardak, J. Oh, S. F. Smith, and J. G. Carbonell. Scheduling with uncertain resources: Search for a near-optimal solution. In Proc. of the IEEE International Conference on Systems, Man, and Cybernetics, pages 137-144, 2006.

J. Oh and S. F. Smith. Learning user preferences in distributed calendar scheduling. In Practice and Theory of Automated Timetabling V, volume 3616 of Lecture Notes in Computer Science, pages 3-16. Springer, 2005. (A version appeared in Proc. of the Fifth International Conference for the Practice and Theory of Automated Timetabling, 2004.). [pdf]

J. Oh and S. F. Smith. Calendar assistants that learn preferences. In Persistent Assistants: Living and Working with AI, AAAI Spring Symposium, 2005.

P. J. Modi, M. Veloso, S. F. Smith, and J. Oh. Cmradar: A personal assistant agent for calendar management. In Proc. of the Nineteenth National Conference on Artificial Intelligence (AAAI), pages 1020-1021, 2005.  [pdf]

P. J. Modi, M. Veloso, S. F. Smith, and J. Oh. Cmradar: A personal assistant agent for calendar management. In Agent Oriented Information Systems II, Lecture Notes in Computer Science, pages 169-181. Springer, 2005. [pdf]

H. Chalupsky, Y. Gil, C. A. Knoblock, K. Lerman, J. Oh, D. V. Pynadath, T. A. Russ, and M. Tambe. Electric elves: Agent technology for supporting human organizations. AI Magazine, 23(2):11-24, Summer 2002.  [pdf]  (A version appeared in the Proc. of the International Conference of Innovative Application of Artificial Intelligence, 2001. [pdf]). 

J. L. Ambite, G. Barish, C. A. Knoblock, S. Minton, M. Muslea, and J. Oh. Getting from here to there: Interactive planning and agent execution for optimizing travel. In Proc. of the international Conference of Innovative Application of Artificial Intelligence (IAAI), pages 862-869, 2002. [pdf]

C. A. Knoblock, S. Minton, J. L. Ambite, M. Muslea, J. Oh, and M. Frank. Mixed-initiative, multi-source information assistants. In Proc. of the Tenth International World Wide Web (WWW) Conference, pages 697-707, 2001. [pdf]

C. A. Knoblock, J. L. Ambite, S. Minton, C. Shahabi, M. Kolahdouzan, M. Muslea, J. Oh, and S. Thakkar. Integrating the world: The worldinfo assistant. In Proc. of the International Conference on Artificial Intelligence (IC-AI), 2001. [pdf]

M. Frank, M. Muslea, J. Oh, S. Minton, and C. Knoblock. An intelligent user interface for mixed-initiative multi-source travel planning. In Proc. of the ACM International Conference on Intelligent User Interfaces (IUI), pages 85-86, 2001.