Video processing using a spectral decomposition layer
AssigneeQUALCOMM Technologies, Inc.
InventorsTom Frederik Hugo Runia, Cornelis Gerardus Maria Snoek, Arnold Wilhelmus Maria Smeulders
Life of this patent
Estimating the term…
Abstract
A method is presented. The method includes receiving a first sequence of frames depicting a dynamic element. The method also includes decomposing each spatial position from multiple spatial positions in the first sequence of frames to a frequency domain. The method further includes determining a distribution of spectral power density over a range of frequencies of the multiple spatial positions. The method still further includes generating a first set of feature maps based on the determined distribution of spectral power density over the range of frequencies. The method still further includes estimating a first physical property of the dynamic element.
Claims18
A computer-implemented method, comprising:
- receiving a first sequence of frames depicting a dynamic element;
- decomposing each spatial position from a plurality of spatial positions in the first sequence of frames to a frequency domain;
- determining a distribution of spectral power density over a range of frequencies of the plurality of spatial positions;
- generating a first set of feature maps based on the determined distribution of spectral power density over the range of frequencies;
- and
- estimating a first physical property of the dynamic element.
An apparatus, comprising:
- a memory unit;
- and
- at least one processor coupled to the memory unit, the at least one processor configured:
- to receive a first sequence of frames depicting a dynamic element;
- to decompose each spatial position from a plurality of spatial positions in the first sequence of frames to a frequency domain;
- to determine a distribution of spectral power density over a range of frequencies of the plurality of spatial positions;
- to generate a first set of feature maps based on the determined distribution of spectral power density over the range of frequencies;
- and
- to estimate a first physical property of the dynamic element.
A non-transitory computer-readable medium having program code recorded thereon, the program code executed by a processor and comprising:
- program code to receive a first sequence of frames depicting a dynamic element;
- program code to decompose each spatial position from a plurality of spatial positions in the first sequence of frames to a frequency domain;
- program code to determine a distribution of spectral power density over a range of frequencies of the plurality of spatial positions;
- program code to generate a first set of feature maps based on the determined distribution of spectral power density over the range of frequencies;
- program code to estimate a first physical property of the dynamic element.
Dependencies are inferred from the claim text.