Behavioral measurements in a video stream focalized on keywords
AssigneeRicoh Company, Ltd.
InventorsRamya Narasimha, Hector H. Gonzalez-Banos
Life of this patent
Estimating the term…
Abstract
A system and method for analyzing behavior in a video is described. The method includes extracting a plurality of salient fragments of a video; associating a time anchor with an utterance of a first keyword in an audio track associated with the video; generating a focalized visualization, based on the time anchor, from one or more of the plurality of salient fragments of the video; tagging a human subject in the focalized visualization with a unique identifier; and analyzing behavior of the human subject, using the focalized visualization, to generate a behavior score associated with the unique identifier and the first keyword.
Claims20
A computer-implemented method comprising:
- extracting a plurality of salient fragments from a video, a salient fragment being a video sequence tracking a salient object through a subset of a series of frames in the video;
- associating a time anchor with an utterance of a first keyword in an audio track associated with the video;
- generating a video segment focalized on the time anchor associated with the utterance of the first keyword from one or more of the plurality of salient fragments of the video;
- tagging a human subject in the video segment with a unique identifier;
- and
- analyzing behavior of the human subject, using the video segment, to generate a behavior score associated with the unique identifier and the first keyword.
A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program when executed on a computer causes the computer to:
- extract a plurality of salient fragments from a video, a salient fragment being a video sequence tracking a salient object through a subset of a series of frames in the video;
- associate a time anchor with an utterance of a first keyword in an audio track associated with the video;
- generate a video segment focalized on the time anchor associated with the utterance of the first keyword from one or more of the plurality of salient fragments of the video;
- tag a human subject in the video segment with a unique identifier;
- and
- analyze behavior of the human subject, using the video segment, to generate a behavior score associated with the unique identifier and the first keyword.
A system comprising:
- one or more processors;
- and
- a memory, the memory storing instructions which when executed cause the one or more processors to:
- extract a plurality of salient fragments from a video, a salient fragment being a video sequence tracking a salient object through a subset of a series of frames in the video;
- associate a time anchor with an utterance of a first keyword in an audio track associated with the video;
- generate a video segment focalized on the time anchor associated with the utterance of the first keyword from one or more of the plurality of salient fragments of the video;
- tag a human subject in the video segment with a unique identifier;
- and
- analyze behavior of the human subject, using the video segment, to generate a behavior score associated with the unique identifier and the first keyword.
Dependencies are inferred from the claim text.