imSitu is a dataset supporting situation recognition, the problem
of producing a concise summary of the situation an image
depicts including: (1) the main activity, (2)
the participating actors, objects, substances, and locations
and most importantly (3) the roles these participants play in the activity.
The role set used by imSitu is derived from the linguistic resource FrameNet
and the entities are derived from ImageNet. The data in imSitu can be used to create robust algorithms for situation recongntion.
Situations
Click image
imSitu Dataset
| verbs | 504 |
| images | 126,102 |
| situations per image | 3 |
| total annotations | 1,481,851 |
| unique entity types (>3) | 11,538 (6,794) |
| unique roles (role types) | 1,788 (190) |
| images per verb (range) | 250.2 (200 - 400) |
| unique situations (>3) | 205,095 (21,505) |
