Event structure system and controlling method and medium for the same

A method for controlling an event structure system, the method comprising:

• recognizing multiple-person interaction primitives from an image, which is displayed on a display screen;
• composing an event by inference based on temporal relations using the multiple-person interaction primitive;
• and
• determining a final event by either eliminating an unnecessary event from the composed event, or adding a new event in the composed event,
• wherein the recognizing of multiple-person interaction primitives comprises:
• transforming an image plane including multiple persons into relative trajectory coordinates of a reference object corresponding to any single person of multiple persons in the image plane;
• performing trajectory clustering in the relative trajectory coordinates;
• and
• recognizing the multiple-person interaction primitives by each trajectory cluster obtained by performing the trajectory clustering.

A method for controlling an event structure system, the method comprising:

• recognizing multiple-person interaction primitives from an image, which is displayed on a display screen;
• composing an event by inference based on temporal relations using the multiple-person interaction primitive;
• and
• determining a final event by either eliminating an unnecessary event from the composed event, or adding a new event in the composed event,
• wherein the determining of the final event comprises:
• eliminating an unnecessary event by Multi-Thread Parsing (MTP);
• computing a start point distance and an end point distance between two events to thereby infer temporal relations;
• re-generating an event disregarded due to errors;
• and
• adding the re-generated event in the composed event.

A system for controlling an event structure, the system comprising:

• a multiple-person interaction primitives recognizing unit to recognize multiple-person interaction primitives from an image, which is displayed on a display screen;
• and
• a multi-thread parser to compose an event by inference based on temporal relations using the multiple-person interaction primitives, and to determine a final event by either eliminating an unnecessary event from the composed event or adding a new event in the composed event,
• wherein the multiple-person interaction primitives recognizing unit comprises:
• a relative trajectory coordinates transforming unit to transform an image plane including the multiple persons into relative trajectory coordinates of a reference object corresponding to any single person of the multiple persons;
• a trajectory clustering unit to perform trajectory clustering in the relative trajectory coordinates;
• and
• a recognizing unit to recognize the multiple-person interaction primitives by each trajectory cluster obtained by performing the trajectory clustering via the trajectory clustering unit.

A system for controlling an event structure, the system comprising:

• a multiple-person interaction primitives recognizing unit to recognize multiple-person interaction primitives from an image, which is displayed on a display screen;
• and
• a multi-thread parser to compose an event by inference based on temporal relations using the multiple-person interaction primitives, and to determine a final event by either eliminating an unnecessary event from the composed event or adding a new event in the composed event,
• wherein the multi-thread parser comprises:
• a constraint fulfillment determining unit to eliminate an unnecessary event by multi-thread parsing;
• a temporal relations inferring unit to compute a start point distance and an end point distance between two events to thereby infer temporal relations;
• and
• an error prediction generating unit to re-generate an event disregarded due to errors, and to add the re-generated event in the composed event.