Sonicverse

Sonicverse is a multisensory simulation platform with integrated audio-visual simulation for training household agents that can both see and hear. Sonicverse models realistic continuous audio rendering in 3D environments in real-time. Together with a new audio-Visual VR interface that allows humans to interact with agents with audio, Sonicverse enables a series of embodied AI tasks that need audio-visual perception.

Source: Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear

Image Source: Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear