Finding Group Interactions in Social Clutter

DSpace/Manakin Repository

Finding Group Interactions in Social Clutter

Citable link to this page


Title: Finding Group Interactions in Social Clutter
Author: Li, Ruonan; Porfilio, Parker; Zickler, Todd

Note: Order does not necessarily reflect citation order of authors.

Citation: Li, Ruonan, Parker Porfilio, and Todd Zickler. Finding Group Interactions in Social Clutter. Harvard Computer Science Group Technical Report TR-01-13.
Full Text & Related Files:
Abstract: We consider the problem of finding distinctive social interactions involving groups of agents embedded in larger social gatherings. Given a pre-defined gallery of short exemplar interaction videos, and a long input video of a large gathering (with approximately-tracked agents), we identify within the gathering small sub-groups of agents exhibiting social interactions that resemble those in the exemplars. The participants of each detected group interaction are localized in space; the extent of their interaction is localized in time; and when the gallery of exemplars is annotated with group-interaction categories, each detected interaction is classified into one of the pre-defined categories. Our approach represents group behaviors by dichotomous collections of descriptors for (a) individual actions, and (b) pair-wise interactions; and it includes efficient algorithms for optimally distinguishing participants from by-standers in every temporal unit and for temporally localizing the extent of the group interaction. Most importantly, the method is generic and can be applied whenever numerous interacting agents can be approximately tracked over time. We evaluate the approach using three different video collections, two that involve humans and one that involves mice.
Terms of Use: This article is made available under the terms and conditions applicable to Other Posted Material, as set forth at
Citable link to this page:
Downloads of this work:

Show full Dublin Core record

This item appears in the following Collection(s)


Search DASH

Advanced Search