Want to schedule a meeting? Please check my calendar first to suggest an appropriate time.
Hi there! I am an Assistant Professor with the Robotics Institute and Computer Science Department in the School of Computer Science at Carnegie Mellon University. My research interests span many topics across computer graphics and computer vision, but I'm particularly interested in computational imaging: a field that combines optics, electronics, and computational processing to capture or display new forms of visual information.
Prior to joining CMU, I was a Banting Postdoctoral Scholar with the Department of Electrical Engineering at Stanford University, and received my Ph.D. in Computer Science at the University of Toronto. My thesis titled "Optical Linear Algebra for Computational Light Transport" received the ACM SIGGRAPH Outstanding Thesis Honourable Mention award in 2017.
I'm also the recipient of an NSF CAREER award, best paper awards at SIGGRAPH 2023, CVPR 2022, CVPR 2014, and ICCV 2007, and best demo awards at ICCP 2023, CVPR 2015, and ICCP 2015.
Light-Efficient Holographic Illumination for Continuous-Wave Time-of-Flight Imaging
Dorian Chan, Matthew O'Toole. ACM SIGGRAPH Asia, 2023. Paper
Neural Fields for Structured Lighting
Aarrushi Shandilya, Benjamin Attal, Christian Richardt, James Tompkin, Matthew O'Toole. Proc. of IEEE International Conference on Computer Vision (ICCV), 2023. Project page
SpinCam: High-Speed Imaging via a Rotating Point-Spread Function
Dorian Chan, Mark Sheinin, Matthew O'Toole. Proc. of IEEE International Conference on Computer Vision (ICCV), 2023. Project page
Split-Lohmann Multifocal Displays
Yingsi Qin, Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan. ACM SIGGRAPH, 2023. Project page(Awarded "Best Paper" at SIGGRAPH, and "Best Demo" at ICCP 2023)
ST-MVDNet++: Improve Vehicle Detection with Lidar-Radar Geometrical Augmentation via Self-Training
Yu-Jhe Li, Matthew O'Toole, Kris Kitani. ICASSP, 2023. Paper
Enhancing speckle statistics for imaging inside scattering tissue
Wei-yu Chen, Matthew O'Toole, Aswin Sankaranarayanan, Anat Levin. Optica, 2022. Paper
Azimuth Super-Resolution for FMCW Radar in Autonomous Driving
Yu-Jhe Li, Shawn Hunt, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2023. Paper
Analyzing Physical Impacts using Transient Surface Wave Imaging
Tianyuan Zhang, Mark Sheinin, Dorian Chan, Mark Rau, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2023. Project page
Implicit Neural Head Synthesis via Controllable Local Deformation Fields
Chuhan Chen, Matthew O'Toole, Gaurav Bharaj, Pablo Garrido. CVPR, 2023. Project page
HyperReel: High-fidelity 6-DoF video with ray-conditioned sampling
Benjamin Attal, Jia-Bin Huang, Christian Richardt, Michael Zollhoefer, Johannes Kopf, Matthew O'Toole, Changil Kim. CVPR, 2023. (Highlight) Project page
Adjoint Nonlinear Ray Tracing
Arjun Teh, Matthew O'Toole, Ioannis Gkioulekas. ACM SIGGRAPH, 2022. Project page
Time-multiplexed Neural Holography: A flexible framework for holographic near-eye displays with fast heavily-quantized spatial light modulators
Suyeon Choi*, Manu Gopakumar*, Yifan (Evan) Peng, Jonghyun Kim, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2022. Project page
Towards Mixed-State Coded Diffraction Imaging
Benjamin Attal, Matthew O'Toole. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022.
Project page
Holocurtains: Programming Light Curtains via Binary Holography
Dorian Chan, Srinivas Narasimhan, Matthew O'Toole. Computer Vision and Pattern Recognition (CVPR), 2022. Project page
Dual-Shutter Optical Vibration Sensing
Mark Sheinin, Dorian Chan, Matthew O'Toole, Srinivas Narasimhan. Computer Vision and Pattern Recognition (CVPR), 2022. (Oral)(Awarded "Best Paper Honourable Mention") Project page
Modality-Agnostic Learning for Radar-Lidar Fusion in Vehicle Detection
Yu-Jhe Li, Jinhyung Park, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2022. Paper
TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
Benjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim, Christian Richardt, James Tompkin, Matthew O'Toole. Advances in Neural Information Processing Systems (NeurIPS), 2021. Project page
Multi-Echo LiDAR for 3D Object Detection
Yunze Man, Xinshuo Weng, Prasanna Sivakumar, Matthew O'Toole, Kris Kitani. Internal Conference on Computer Vision (ICCV), 2021. Paper
Deconvolving Diffraction for Fast
Imaging of Sparse Scenes
Mark Sheinin, Matthew O'Toole, Srinivasa Narasimhan. International Conference on Computational Photography (ICCP), 2021. Project page
Reference Wave Design for Wavefront Sensing
Wei-Yu Chen, Anat Levin, Matthew O'Toole, Aswin C. Sankaranarayanan. International Conference on Computational Photography (ICCP), 2021. Paper
All-In-One Drive: A Comprehensive Perception Dataset with High-Density Long-Range Point Clouds
Xinshuo Weng, Yunze Man, Jinhyung Park, Ye Yuan, Matthew O'Toole, Kris Kitani. arXiv, 2020. Project page
Diffraction Line Imaging
Mark Sheinin, Dinesh Reddy, Matthew O'Toole,
Srinivasa Narasimhan. European Conference on Computer Vision (ECCV), 2020. (Oral) Project page
Efficient Non-Line-of-Sight Imaging from Transient Sinograms
Mariko Isogawa, Dorian Chan, Ye Yuan, Kris Kitani, Matthew O'Toole. European Conference on Computer Vision (ECCV), 2020. Project page
Efficient Non-Line-of-Sight Imaging with Computational Single-Photon Imaging
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. SPIE, 2020. (Invited paper) Paper
An Extensible Multi-Sensor Fusion Framework for 3D Imaging
Talha Ahmad Siddiqui, Rishi Madhok, Matthew O'Toole. CVPR Workshop on Autonomous Driving, 2020. Paper
Optical Non-Line-of-Sight Physics-based 3D Human Pose Estimation
Mariko Isogawa, Ye Yuan, Matthew O'Toole, Kris Kitani. Computer Vision and Pattern Recognition (CVPR), 2020. Project page
Wave-based Non-Line-of-Sight Imaging using Fast f-k Migration
David B. Lindell, Gordon Wetzstein, Matthew O'Toole. ACM SIGGRAPH, 2019. Project page
Non-Line-of-Sight Imaging with Partial Occluders and Surface Normals
Felix Heide, Matthew O'Toole, Kai Zang, David B. Lindell, Steven Diamond, Gordon Wetzstein. ACM Trans. on Graphics, 2019. Project page
Single-Photon 3D Imaging with Deep Sensor Fusion
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. ACM SIGGRAPH, 2018. Project page
Tracking Multiple Objects Outside the Line of Sight using Speckle Imaging
Brandon M. Smith, Matthew O'Toole, Mohit Gupta. Computer Vision and Pattern Recognition (CVPR), 2018. (Spotlight) Project page
Towards Transient Imaging at Interactive Rates with Single-Photon Sensors
David B. Lindell, Matthew O'Toole, Gordon Wetzstein. International Conference on Computational Photography (ICCP), 2018. Project page
Confocal Non-Line-of-Sight Imaging Based on the Light Cone Transform
Matthew O'Toole, David B. Lindell, Gordon Wetzstein. Nature, 2018. Project page
Reconstructing Transient Images from Single-Photon Sensors
Matthew O'Toole, Felix Heide, David B. Lindell, Kai Zang, Steven Diamond, Gordon Wetzstein. Computer Vision and Pattern Recognition (CVPR), 2017. (Spotlight) Project page
Primal-Dual-Coding CMOS Image Sensor Architecture
Navid Sarhangnejad, Hyunjoong Lee, Nikola Katic, Matthew O'Toole, Kiriakos N. Kutulakos, Roman Genov. International Image Sensor Workshop (IISW), 2017. Paper
Ph.D. Thesis: Optical Linear Algebra for Computational Light Transport
Matthew O'Toole. University of Toronto, 2016. (Awarded "ACM SIGGRAPH Outstanding Thesis, Honourable Mention") Thesis (35.4 MB)
3D Shape and Indirect Appearance by Structured Light Transport
Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2016. Paper
Homogeneous Codes for Energy-Efficient Illumination and Imaging
Matthew O'Toole, Supreeth Achar, Srinivasa G. Narasimhan, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2015. (Awarded "Best Demo" at ICCP 2015 and CVPR 2015) Project page Episcan3D
Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
Lei Xiao, Felix Heide, Matthew O'Toole, Andreas Kolb, Matthias B. Hullin, Kiriakos N. Kutulakos, Wolfgang Heidrich. Computer Vision and Pattern Recognition (CVPR), 2015. Project page
Transport-aware imaging
Kiriakos N. Kutulakos and Matthew O'Toole. SPIE OPTO, 2015. (Invited paper) Paper
Temporal Frequency Probing for 5D Transient Analysis of Global Light Transport
Matthew O'Toole, Felix Heide, Lei Xiao, Matthias B. Hullin, Wolfgang Heidrich, Kiriakos N. Kutulakos. ACM SIGGRAPH, 2014. Project page
Course: Computational Cameras and Displays
Matthew O'Toole and Gordon Wetzstein. ACM SIGGRAPH Course, 2014. Course page
3D Shape and Indirect Appearance by Structured Light Transport
Matthew O'Toole, John Mather, Kiriakos N. Kutulakos. Computer Vision and Pattern Recognition (CVPR), 2014. (Oral)(Awarded "Best Paper Honourable Mention") Project page
Decomposing Global Light Transport using Time of Flight Imaging
Di Wu, Andreas Velten, Matthew O'Toole, Belen Masia, Amit Agrawal, Qionghai Dai, Ramesh Raskar.
International Journal of Computer Vision (IJCV), 2013. Paper
Frequency Analysis of Transient Light Transport with Applications in Bare Sensor Imaging
Di Wu, Gordon Wetzstein, Christopher Barsi, Thomas Willwacher, Matthew O'Toole, Nikhil Naik, Qionghai Dai, Kiriakos N. Kutulakos, Ramesh Raskar.
European Conference on Computer Vision (ECCV), 2012. Project page
Primal-Dual Coding to Probe Light Transport
Matthew O'Toole, Ramesh Raskar, and Kiriakos N. Kutulakos.
ACM SIGGRAPH, 2012. Project page
Decomposing Global Light Transport using Time of Flight Imaging
Di Wu, Matthew O'Toole, Andreas Velten, Amit Agrawal, and Ramesh Raskar.
Computer Vision and Pattern Recognition (CVPR), 2012. (Oral) Paper
Optical Computing for Fast Light Transport Analysis
Matthew O'Toole and Kiriakos N. Kutulakos.
ACM SIGGRAPH Asia, 2010. Project page
A Basis Illumination Approach to BRDF Measurement
Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole.
International Journal of Computer Vision (IJCV), 2010. Paper
M.Sc. Report: Light Transport Analysis by Krylov Subspace Illumination
Matthew O'Toole. University of Toronto, 2009. (Uploaded on September 2018.) Report
BRDF Acquisition with Basis Illumination
Abhijeet Ghosh, Shruthi Achutha, Wolfgang Heidrich, and Matthew O'Toole.
Proc. of IEEE International Conference on Computer Vision (ICCV), 2007. (Oral)(Awarded "Marr Prize Honourable Mention") Project page
Undergraduate Honours Thesis: Real-time Rendering of Acquired BRDF Data Sets
Matthew O'Toole. University of British Columbia, 2007. Paper
