SAD-Instruct

The Situational Awareness Database for Instruct-Tuning (SAD-Instruct) is a dataset for dynamic task guidance. It contains situationally aware instructions for performing everyday tasks or completing scenarios in 3D environments. The dataset provides step-by-step instructions for these scenarios grounded in the situation's context. This context is defined through a scenario-specific scene graph that captures the objects, attributes, and environmental relations. The dataset is designed to enable research in grounded language learning, instruction following, and situated dialogue.