Back to results
US 10,853,951 B2Granted
Methods and apparatus to generate temporal representations for action recognition systems
AssigneeIntel Corporation
InventorsSherine Abdelhak, Neelay Pandit
Life of this patent
Estimating the term…
Abstract
Methods, apparatus, systems and articles of manufacture to generate temporal representations for action recognition systems are disclosed. An example apparatus includes an optical flow computer to compute a first optical flow based on first and second video frames separated by a first amount of time and compute a second optical flow based on third and fourth video frames separated by a second amount of time, the second amount of time different than the first amount of time, and an aggregator to combine the first optical flow and the second optical flow to form an image representing action in a video.
Claims21
An apparatus comprising:
- an optical flow computer to:
- compute a first optical flow based on first and second video frames separated by a first amount of time, the first amount of time to illustrate a small amount of difference between the first and second video frames, the small amount of difference corresponding to a low level of motion in a video;
- and
- compute a second optical flow based on third and fourth video frames separated by a second amount of time greater than the first amount of time, the second amount of time to illustrate a higher amount of difference between the third and fourth video frames relative to the small amount of difference, the higher amount of difference corresponding to a high level of motion in the video;
- and
- an aggregator to combine the first optical flow and the second optical flow to form an image representing action in the video, the image to include a scaled level of motion based on the low and high levels of motion for identifying the action in the video.
3 more elements
A method comprising:
- computing a first optical flow based on first and second video frames separated by a first amount of time, the first amount of time to illustrate a small amount of difference between the first and second video frames, the small amount of difference corresponding to a low level of motion in a video;
- computing a second optical flow based on third and fourth video frames separated by a second amount of time, the second amount of time greater than the first amount of time, the second amount of time to illustrate a higher amount of difference between the third and fourth video frames relative to the small amount of difference, the higher amount of difference corresponding to a high level of motion in the video;
- combining the first optical flow and the second optical flow to form an image representing action in the video, the image to include a scaled level of motion based on the low and high levels of motion for identifying the action in the video.
A non-transitory computer-readable storage medium comprising instructions that, when executed, cause a machine to:
- compute a first optical flow based on first and second video frames separated by a first amount of time, the first amount of time to illustrate a small amount of difference between the first and second video frames, the small amount of difference corresponding to a low level of motion in a video;
- compute a second optical flow based on third and fourth video frames separated by a second amount of time, the second amount of time greater than the first amount of time, the second amount of time to illustrate a higher amount of difference between the third and fourth video frames relative to the small amount of difference, the higher amount of difference corresponding to a high level of motion in the video;
- and
- combine the first optical flow and the second optical flow to form an image representing action in the video, the image to include a scaled level of motion based on the low and high levels of motion for identifying the action in the video.
1 more element
An apparatus comprising:
- a first optical flow computer to:
- compute a first optical flow based on first and second video frames separated by a first amount of time, and
- compute a second optical flow based on third and fourth video frames separated by a second amount of time, the second amount of time different than the first amount of time;
- an aggregator to combine the first optical flow and the second optical flow to form an image representing action in a video;
- a second optical flow computer to:
- compute a third optical flow based on fifth and sixth video frames separated by a third amount of time, and
- compute a fourth optical flow based on seventh and eighth video frames separated by the third amount of time;
- a first convolutional neural network to identify a first action in the video based on the image representing action in the video;
- a second convolutional neural network to identify a second action in the video based on the third and fourth optical flows;
- and
- a fuser to identify a third action in the video based on the first action and the second action.
8 more elements
Dependencies are inferred from the claim text.