08.2019: Our paper featuring the novel Drive&Act dataset for fine-grained driver activity recognition was accepted at ICCV!

06.2019: Four papers accepted at IV, ICDAR and CVPR Workshop! One paper on forseeing future car maneuvers through driver observation is accepted at Intelligent Vehicles Symposium and one paper with a comprehensive analysis of different strategies for multimodal fusion will be published at the CVPR Workshop on Modelling of Faces and Gestures. Our paper featuring a new dataset for slide segmentation from live fotos taken during lectures, and our fourth paper on mathematical expression recognition are accepted at is accepted at ICDAR and ICDAR GREC Workshop.

03.2019: Our paper about Visual Reasoning using Graph Neural Networks was accepted at CVPR!

10.2018: Our interdisciplinary paper on pupil-based assesment of human cognitive load using Bayesian methods was presented at the ACM ICMI Modeling Cognitive Processes from Multimodal Data Workshop (ICMI-MCPMD).

08.2018:   Two papers accepted at BMVC and ECCV Workshop! One paper about identifying previously unseen classes for action recognition in open-set scenario is accepted at the BMVC and one paper on assessing the performance of zero-shot action recognition algorithms when using external datasets was accepted at the ECCV Workshop on Shortcomings in Vision and Language.

07.2018:   I participated in the International Computer Vision Summer School and presented our poster "Human Activity Recognition in Autonomous Vehicles"

My main research focus is deep learning-based recognition of human activities and interactions from video streams. I am especially interested in open-set, zero- and few-shot recognition as well as applying the developed models for driver monitoring in intelligent vehicles.

I am involved in the BMBF Project PAKoS (Personalisierte, adaptive kooperative Systeme für automatisierte Fahrzeuge), working on scene understanding inside autonomous cars. The goal of CV:HCI is real-time activity recognition under realistic driving conditions (e.g. varying or low illumination).

Bachelor/Master Thesis

If you are passionate about one of {machine learning, deep learning, computer vision} and want to apply what you have learned in the area of activity recognition / video comprehension in your thesis - please send me an email with a few sentences about yourself.

Supervised Theses

• Chaoxiang Ma, "Reliability of Deep Convolutional Neural Networks for Activity Recognition", Bachelor Thesis, 01.2019
• Patrick Gebert, "Vehicle Maneuver Prediction with 3D Convolutional Neural Networks Based on Driver Observation", Master Thesis, 07.2018
• Tim Pollert, "Fusion Methods for Multimodal Gesture Recognition with Convolutional Neural Networks", Master Thesis, 06.2018

• Research Assistant/PhD Student at Computer Vision for Human-Computer Interaction Lab, Karlsruhe Institute of Technology, since April 2017
• Consultant at MHP - A Porsche Company, Big Data & Analytics, 2016 - 2017
• M.Sc. in Computer Science at Technical University Munich, 2013 - 2015
• Erasmus studies at Chalmers University of Technology, Gothenburg, Sweden, 2012 - 2013
• B.Sc. in Computer Science at Technical University Munich, 2009 - 2012

• Drive&Act: A Multi-modal Dataset for Fine-grained Driver Behavior Recognition in Autonomous Vehicles. Manuel Martin*, Alina Roitberg*, Monica Haurilet, Matthias Horne, Simon Reiß, Michael Voit, Rainer Stiefelhagen. In International Conference on Computer Vision (ICCV), IEEE, Seoul, South Korea, Oct. 2019 [pdf] [bib] (* denotes equal contribution)
• WiSe - Slide Segmentation in the Wild. Monica Haurilet, Alina Roitberg, Manuel Martinez and Rainer Stiefelhagen. In International Conference for Document Analysis and Recognition, (ICDAR), IEEE, Sydney, Australia, Sep. 2019 [pdf]
• Learning Fine-Grained Image Representations for Mathematical Expression Recognition. Sidney Bender*, Monica Haurilet*, Alina Roitberg, Rainer Stiefelhagen, ICDAR Workshop on Graphics Recognition, Sydney, Australia, Sep. 2019 [pdf] (* denotes equal contribution)
• End-to-end Prediction of Driver Intention using 3D Convolutional Neural Networks. Patrick Gebert*, Alina Roitberg*, Monica Haurilet and Rainer Stiefelhagen. In Intelligent Vehicles Symposium (IV), IEEE, Paris, France, June 2019 (* denotes equal contribution)
• It’s not about the Journey; It’s about the Destination: Following Soft Paths under Question-Guidance for Visual Reasoning. Monica Haurilet, Alina Roitberg, Rainer Stiefelhagen.  In Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Long Beach, USA, June 2019 [pdf] (25.2% acceptance rate)
• Analysis of Deep Fusion Strategies for Multi-modal Gesture Recognition. Alina Roitberg*, Tim Pollert*, Monica Haurilet, Manuel Martin, Rainer Stiefelhagen. CVPR Workshop on Analysis and Modeling of Faces and Gestures (AMFG), IEEE, Long Beach, USA, June 2019 [pdf][bib](* denotes equal contribution)
• Informed Democracy: Voting-based Novelty Detection for Action Recognition. Alina Roitberg, Ziad Al-Halah, Rainer Stiefelhagen.  In British Machine Vision Conference (BMVC), Newcastle upon Tyne, UK, 2018 [pdf][poster][bib] (29.5% acceptance rate)
• Towards a Fair Evaluation of Zero-Shot Action Recognition using External Data. Alina Roitberg, Manuel Martinez, Monica Haurilet, Rainer Stiefelhagen.  In ECCV Workshop on Shortcomings in Vision and Language (SiVL), Springer, Munich, Germany, 2018 [pdf][poster][bib] (spotlight presentation)
• Estimating Mental Load in Passive and Active Tasks from Pupil and Gaze Changes using Bayesian Surprise. Elena Wolf, Manuel Martinez, Alina Roitberg, Rainer Stiefelhagen and Barbara Deml. In ACM ICMI Modeling Cognitive Processes from Multimodal Data Workshop (ICMI-MCPMD), Boulder, Colorado, USA, 2018
• Using Technology Developed for Autonomous Cars to Help Navigate Blind People. Manuel Martinez, Alina Roitberg, Daniel Koester, Boris Schauerte, Rainer Stiefelhagen. ICCV Workshop on Assistive Computer Vision and Robotics (ACVR), 2017
• Connecting Artificial Brains to Robots in a Comprehensive Simulation Framework: The Neurorobotics Platform. Egidio Falotico, Lorenzo Vannucci, Alessandro Ambrosano, Ugo Albanese, Stefan Ulbrich, Juan Camilo Vasquez Tieck, Georg Hinkel, Jacques Kaiser, Igor Peric, Oliver Denninger, Nino Cauli, Murat Kirtay, Arne Roennau, Gudrun Klinker, Axel Von Arnim, Luc Guyot, Daniel Peppicelli, Pablo Martínez-Cañada, Eduardo Ros, Patrick Maier, Sandro Weber, Manuel Huber, David Plecher, Florian Röhrbein, Stefan Deser, Alina Roitberg, Patrick van der Smagt, Rüdiger Dillman, Paul Levi, Cecilia Laschi, Alois C Knoll, Marc-Oliver Gewaltig, Frontiers in neurorobotics 11, 2017
• Improved skeleton estimation by means of depth data fusion from multiple depth cameras. Marco Carraro, Matteo Munaro, Alina Roitberg, Emanuele Menegatti. In International Conference on Intelligent Autonomous Systems, Springer, 2016
• Multimodal human activity recognition for industrial manufacturing processes in robotic workcells. Alina Roitberg, Nikhil Somani, Alexander Perzylo, Markus Rickert, and Alois Knoll. In ACM International Conference on Multimodal Interaction (ICMI), Seattle, USA, 2015
• Human Activity Recognition in the Context of Industrial Human-Robot Interaction. Alina Roitberg, Alexander Perzylo, Nikhil Somani, Manuel Giuliani, Markus Rickert, and Alois Knoll. In Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2014), IEEE, Siem Reap, Cambodia, 2014