TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Traffic Control Gesture Recognition for Autonomous Vehicles

Traffic Control Gesture Recognition for Autonomous Vehicles

Julian Wiederer, Arij Bouazizi, Ulrich Kressel, Vasileios Belagiannis

2020-07-31Autonomous VehiclesSkeleton Based Action RecognitionAutonomous DrivingGesture Recognition
PaperPDFCode(official)

Abstract

A car driver knows how to react on the gestures of the traffic officers. Clearly, this is not the case for the autonomous vehicle, unless it has road traffic control gesture recognition functionalities. In this work, we address the limitation of the existing autonomous driving datasets to provide learning data for traffic control gesture recognition. We introduce a dataset that is based on 3D body skeleton input to perform traffic control gesture classification on every time step. Our dataset consists of 250 sequences from several actors, ranging from 16 to 90 seconds per sequence. To evaluate our dataset, we propose eight sequential processing models based on deep neural networks such as recurrent networks, attention mechanism, temporal convolutional networks and graph convolutional networks. We present an extensive evaluation and analysis of all approaches for our dataset, as well as real-world quantitative evaluation. The code and dataset is publicly available.

Results

TaskDatasetMetricValueModel
VideoTCG-datasetAcc87.24Bidirectional LSTM
VideoTCG-datasetF1-Score78.48Bidirectional LSTM
VideoTCG-datasetJaccard Index67Bidirectional LSTM
Temporal Action LocalizationTCG-datasetAcc87.24Bidirectional LSTM
Temporal Action LocalizationTCG-datasetF1-Score78.48Bidirectional LSTM
Temporal Action LocalizationTCG-datasetJaccard Index67Bidirectional LSTM
Zero-Shot LearningTCG-datasetAcc87.24Bidirectional LSTM
Zero-Shot LearningTCG-datasetF1-Score78.48Bidirectional LSTM
Zero-Shot LearningTCG-datasetJaccard Index67Bidirectional LSTM
Activity RecognitionTCG-datasetAcc87.24Bidirectional LSTM
Activity RecognitionTCG-datasetF1-Score78.48Bidirectional LSTM
Activity RecognitionTCG-datasetJaccard Index67Bidirectional LSTM
Action LocalizationTCG-datasetAcc87.24Bidirectional LSTM
Action LocalizationTCG-datasetF1-Score78.48Bidirectional LSTM
Action LocalizationTCG-datasetJaccard Index67Bidirectional LSTM
Action DetectionTCG-datasetAcc87.24Bidirectional LSTM
Action DetectionTCG-datasetF1-Score78.48Bidirectional LSTM
Action DetectionTCG-datasetJaccard Index67Bidirectional LSTM
3D Action RecognitionTCG-datasetAcc87.24Bidirectional LSTM
3D Action RecognitionTCG-datasetF1-Score78.48Bidirectional LSTM
3D Action RecognitionTCG-datasetJaccard Index67Bidirectional LSTM
Action RecognitionTCG-datasetAcc87.24Bidirectional LSTM
Action RecognitionTCG-datasetF1-Score78.48Bidirectional LSTM
Action RecognitionTCG-datasetJaccard Index67Bidirectional LSTM

Related Papers

Efficient Deployment of Spiking Neural Networks on SpiNNaker2 for DVS Gesture Recognition Using Neuromorphic Intermediate Representation2025-09-04GEMINUS: Dual-aware Global and Scene-Adaptive Mixture-of-Experts for End-to-End Autonomous Driving2025-07-19AGENTS-LLM: Augmentative GENeration of Challenging Traffic Scenarios with an Agentic LLM Framework2025-07-18World Model-Based End-to-End Scene Generation for Accident Anticipation in Autonomous Driving2025-07-17Orbis: Overcoming Challenges of Long-Horizon Prediction in Driving World Models2025-07-17Channel-wise Motion Features for Efficient Motion Segmentation2025-07-17LaViPlan : Language-Guided Visual Path Planning with RLVR2025-07-17Vision-based Perception for Autonomous Vehicles in Obstacle Avoidance Scenarios2025-07-16