Hands in Action
The Hands in action dataset (HIC) dataset has RGB-D sequences of hands interacting with objects.
Source: Learning joint reconstruction of hands and manipulated objects Image Source: http://files.is.tue.mpg.de/dtzionas/Hand-Object-Capture/