Researcher

Matthew Johnson-Roberson

Matthew Johnson-Roberson is a roboticist who works on perception for autonomous underwater vehicles and self-driving cars, and he is the inaugural dean of Vanderbilt University's College of Connected Computing. As a Carnegie Mellon undergraduate, he got involved in the DARPA Grand Challenge driverless races, and he earned a robotics doctorate at the University of Sydney in 2010 while working on robots that inspected deep water and coral reefs. He co-directed the UM Ford Center for Autonomous Vehicles at the University of Michigan and co-founded the delivery-robot company Refraction AI. His 2017 paper "Driving in the Matrix" showed that a vehicle detector trained only on annotated images from a photo-realistic simulation engine outperformed the same architecture trained on human-annotated real-world data. He directed Carnegie Mellon's Robotics Institute from 2022 to 2025 and moved to Vanderbilt in May 2025.

Works
181
Citations
4,893
h-index
34

Publication numbers from OpenAlex, as of 22 October 2026.

Timeline

  1. 2004–2005

    DARPA races and a CMU degree

    As a computer science undergraduate at Carnegie Mellon, he gets involved in the DARPA Grand Challenges, desert races for driverless vehicles, and he works on autonomous vehicles from the first race in 2004. He earns his bachelor's degree in computer science in 2005.

  2. 2010–2013

    Reef robots and a Sydney PhD

    He earns a doctorate in robotics at the University of Sydney in 2010, working on robots that inspect deep water and coral reefs, including Ningaloo Reef and the Great Barrier Reef. Postdoctoral appointments follow at Sydney's Australian Centre for Field Robotics and at the Centre for Autonomous Systems of KTH Royal Institute of Technology in Stockholm.

  3. 2013–2015

    Michigan faculty and the DROP Lab

    He joins the University of Michigan College of Engineering in 2013 in the Naval Architecture and Marine Engineering department, with a joint appointment in Computer Science and Engineering. There he founds the DROP (Deep Robot Optical Perception) Lab for 3D reconstruction, segmentation, data mining and visualization, and in 2015 he receives an NSF CAREER award for 3D reconstruction in underwater environments with autonomous underwater vehicles.

  4. 2016

    The Ford Center for Autonomous Vehicles

    In September 2016, Ford and the University of Michigan name him and Ram Vasudevan leaders of a new autonomous vehicle research team; he is an assistant professor of naval architecture and marine engineering at the time. With Vasudevan, he co-directs the UM Ford Center for Autonomous Vehicles, a $25 million partnership that leads to a new facility on the Michigan campus.

  5. 2017

    The Driving in the Matrix paper

    He and five coauthors, including Ram Vasudevan, publish "Driving in the Matrix" in the proceedings of ICRA 2017. The paper trains a state-of-the-art vehicle detector only on annotated images from a photo-realistic simulation engine, and the detector outperforms the identical architecture trained on human-annotated real-world data on the KITTI data set.

  6. 2019–2021

    Co-founding Refraction AI

    He co-founds Refraction AI, a last-mile delivery robotics company, and serves as its CTO. Its four-foot-tall robots deliver food and other goods to customers in Ann Arbor, Michigan, from 2019 and expand to Austin, Texas, in 2021.

  7. 2022–2025

    Director of CMU's Robotics Institute

    In November 2021, Carnegie Mellon names him the sixth director of its Robotics Institute, succeeding interim director Srinivasa Narasimhan. He leads the institute from January 2022 to April 2025, and in 2024 he runs a department with a budget of more than $100 million and oversees a $45 million Richard King Mellon Foundation grant to build CMU's new Robotics Innovation Center.

  8. Since May 2025

    Inaugural dean at Vanderbilt

    He becomes the inaugural dean of Vanderbilt University's College of Connected Computing, the university's first new college in more than 40 years, in May 2025, and a University Distinguished Professor with appointments in the college and the School of Engineering. In February 2026, the college launches the Amplify Generative AI Innovation Center for generative and agentic AI in research, teaching and campus operations.

Career

  1. Since 2025Vanderbilt UniversityInaugural dean; University Distinguished Professor
  2. 2022–2025Carnegie Mellon UniversityDirector
  3. 2019–2021Refraction AICTO
  4. 2013–2022University of MichiganAssistant professor, Founder
  5. 2010–2013University of SydneyPostdoctoral researcher
  6. 2010–2013KTH Royal Institute of TechnologyPostdoctoral researcher

Education

  1. 2010University of SydneyDoctorate in robotics
  2. 2005Carnegie Mellon UniversityBachelor's degree in computer science

Most-cited works

  1. Driving in the Matrix: Can virtual worlds replace human-generated annotations for real world tasks?2017 · IEEE International Conference on Robotics and Automation · 648 citations
  2. Generation and visualization of large‐scale three‐dimensional reconstructions from underwater robotic surveys2009 · Journal of Field Robotics · 261 citations
  3. BiTraP: Bi-Directional Pedestrian Trajectory Prediction With Multi-Modal Goal Estimation2021 · IEEE Robotics and Automation Letters · 204 citations
  4. Monitoring of Benthic Reference Sites: Using an Autonomous Underwater Vehicle2012 · IEEE Robotics & Automation Magazine · 202 citations
  5. Efficient View-Based SLAM Using Visual Loop Closures2008 · IEEE Transactions on Robotics · 184 citations

Sources and credits

Photo: We have no published photo of Matthew Johnson-Roberson yet. Send us a free-licensed photo.

  1. Matthew Johnson-Roberson - Wikipedia en.wikipedia.org. Checked 20 October 2026.
  2. Q&A: Matthew Johnson-Roberson, recently appointed inaugural dean of College of Connected Computing vanderbilthustler.com. Checked 20 October 2026.
  3. Ford Researchers Being Embedded At University Of Michigan For Autonomous Driving Research, 1st Ever Such Arrangement cleantechnica.com. Checked 20 October 2026.
  4. Matthew Johnson-Roberson — DROP Lab droplab.ri.cmu.edu. Checked 20 October 2026.
  5. Vanderbilt names technology visionary Matthew Johnson-Roberson as its first dean of the College of Connected Computing news.vanderbilt.edu. Checked 20 October 2026.
  6. Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks? arxiv.org. Checked 20 October 2026.
  7. New CMU Robotics director says diversity is key to the institute's future wesa.fm. Checked 20 October 2026.
  8. CMU's new Robotics Institute director on the future of robot research techcrunch.com. Checked 20 October 2026.
  9. Vanderbilt launches Amplify Generative AI Innovation Center within College of Connected Computing news.vanderbilt.edu. Checked 20 October 2026.