COCO-Tasks

Comprises about 40,000 images where the most suitable objects for 14 tasks have been annotated.

Source: What Object Should I Use? - Task Driven Object Detection