PeopleofSuperintelligence

Researcher

Rainer Stiefelhagen

Rainer Stiefelhagen is a computer scientist at the Karlsruhe Institute of Technology whose group builds computer vision for human-computer interaction and for people with visual impairments. He earned a computer science diploma in 1996 and a doctorate in 2002 at the Universität Karlsruhe (TH), the year he published a system that tracked the focus of attention of meeting participants with neural networks. In 2011 he took over KIT's professorship in computer science systems for visually impaired students, and in 2013 his group won a US$83,000 Google Faculty Research Award for a smartphone mobility aid. His coauthored work includes the Holistic Video Understanding dataset in 2020 and the CMX segmentation framework in 2022. At KIT he is a professor of human-computer interaction and head of ACCESS@KIT, where a project with Fraunhofer IOSB develops XR glasses with AI for visually impaired professionals.

Timeline

  1. 1996–2002

    Karlsruhe doctorate on meeting attention

    He earns his diploma in computer science in 1996 and his Dr.-Ing. in 2002, both at the Universität Karlsruhe (TH). In October 2002, he publishes the paper Tracking Focus of Attention in Meetings for ICMI 2002 in Pittsburgh. It describes a system that uses an omni-directional camera to track the faces of meeting participants and neural networks to estimate their head poses, and an experiment in which head orientation indicates the focus target 89% of the time.

  2. 2007–2008

    The CLEAR 2007 evaluation

    The CLEAR evaluation on the Classification of Events, Activities, and Relationships takes place in early 2007 and ends with a two-day workshop in May 2007. In 2008, he is first author of the paper that summarizes it, written with Keni Bernardin and four other authors.

  3. 2009–2011

    Habilitation and a KIT professorship

    He completes his habilitation in 2009. In 2011, he takes over KIT's professorship in computer science systems for visually impaired students, unique in Germany, and heads the Study Center for the Visually Impaired. His research applies machine vision, in particular video-based recording of people, to interactive systems such as perceiving robots and environments.

  4. 2013

    A Google Faculty Research Award

    In 2013, his research group at KIT wins a US$83,000 Google Faculty Research Award for a smartphone system that helps visually impaired people find their way in unknown environments. The system is to recognize obstacles through a camera and pass the information to the user by speech, warning signals or vibration.

  5. 2016

    The KIT Accessibility Lab

    In 2016, KIT opens the Accessibility Lab of its Study Centre for the Visually Impaired, funded by a donation from entrepreneur Stefan Quandt, with him as director of the center. The lab combines research, teaching and support on assistive technologies, and he also directs the Computer Vision for Human-Computer Interaction Lab at the Institute for Anthropomatics and Robotics.

  6. 2020–2022

    A video dataset and CMX

    In 2020, he coauthors Large Scale Holistic Video Understanding at the European Conference on Computer Vision, which introduces the HVU dataset of about 572,000 videos with 9 million annotations. In 2022, he coauthors CMX, a unified fusion framework for RGB-X semantic segmentation with transformers, accepted to IEEE Transactions on Intelligent Transportation Systems.

  7. March 2022

    The center becomes ACCESS@KIT

    In March 2022, the Study Center for Visually Impaired Students he has headed since 2011 is renamed ACCESS@KIT, the Center for Digital Accessibility and Assistive Technologies. Together with his Computer Vision for Human-Computer Interaction group, the center develops assistive technologies such as AI-based methods for semi-automatic transfer of teaching materials and mobility support systems.

  8. As of October 2026

    Head of ACCESS@KIT

    As of October 2026, he is a computer science professor for human-computer interaction and head of ACCESS@KIT. In August 2026, KIT announces AssistiveXR4Work, in which ACCESS@KIT and Fraunhofer IOSB develop an assistance system for visually impaired professionals that pairs XR glasses and a high-resolution camera with AI that recognizes objects and text.

Career

  1. Since 2011Karlsruhe Institute of TechnologyProfessor of Human-Computer Interaction, Director

Education

  1. 2002University of Karlsruhe (TH)Dr.-Ing.
  2. 1996University of Karlsruhe (TH)Diploma in Computer Science

From the biography.

  1. More people shaping AI studied at Massachusetts Institute of Technology than at any other institutionIncludes Karlsruhe Institute of Technology. We estimate where the people shaping AI studied and where their careers led. Massachusetts Institute of Technology leads with 467 former students, including 291 recorded doctorates.
  2. The company share of AI researchers’ top papers was 31% in 2020–2024 and 8% in 1970–1974Includes Karlsruhe Institute of Technology. We estimate where the people shaping AI worked when their most-cited papers appeared: the company share was 31% in 2020–2024 and 8% in 1970–1974, and Google led all organizations in 2020–2024.
  3. Google has the highest combined h-index among AI organizationsIncludes Karlsruhe Institute of Technology. We estimate that Google holds the highest combined h-index at 8,016, while universities account for 73% of the deduplicated total across AI organizations.
  4. The Massachusetts Institute of Technology trained or employed 44 of the 187 AI major-prize winners, more than any other universityIncludes Karlsruhe Institute of Technology. The Massachusetts Institute of Technology trained or employed 44 of the 187 AI major-prize winners, more than any other university. We compare doctorate and 5+ year employment links, career timing and current workplaces for 187 major-prize and 1,111 best-paper winners.

Colleagues

People with dated positions at the same organization in the same years.

Sources and credits

Photo: We have no published photo of Rainer Stiefelhagen yet. Send us a free-licensed photo.

  1. Prof. Dr. Rainer Stiefelhagen | Team | Smart Age smart-age.psychologie.uni-heidelberg.de. Checked 22 October 2026.
  2. Tracking Focus of Attention in Meetings - Robotics Institute Carnegie Mellon University ri.cmu.edu. Checked 22 October 2026.
  3. Publications - Tracking Focus Of Attention In Meetings isl.iar.kit.edu. Checked 22 October 2026.
  4. The CLEAR 2007 Evaluation | NIST nist.gov. Checked 22 October 2026.
  5. Rainer Stiefelhagen | ZKM zkm.de. Checked 22 October 2026.
  6. KIT - ACCESS@KIT - History access.kit.edu. Checked 22 October 2026.
  7. KIT - Press Release 111/2013 - Safe Navigation for Visually Impaired Persons kit.edu. Checked 22 October 2026.
  8. KIT - Press Release 085/2016 - Test Lab for Barrier-Free Access To Information kit.edu. Checked 22 October 2026.
  9. Large Scale Holistic Video Understanding arxiv.org. Checked 22 October 2026.
  10. CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers arxiv.org. Checked 22 October 2026.
  11. KIT – Department of Informatics – New name, same goals informatik.kit.edu. Checked 22 October 2026.
  12. KIT – Fakultät für Informatik – XR hilft Menschen mit Sehbehinderung im Beruf informatik.kit.edu. Checked 22 October 2026.