Hierarchical encoding of time-series data features
AssigneeGoogle Inc.
InventorsDouglas Eck, Jay Yagnik
Life of this patent
Estimating the term…
Abstract
A computing device identifies a first codeword in a first codebook to represent short-timescale information of frames in a time-based data item segmented at intervals and identifies a second codeword in a second codebook to represent long-timescale information of the frames. The computing device generates a third codebook based on the first codeword and the second codeword for the frames to add long-timescale information context to the short-timescale information of the frames.
Claims23
A method comprising:
- identifying, by a computing device, a first codeword in a first codebook to represent short-timescale information of frames in a time-based data item segmented at intervals;
- identifying a second codeword in a second codebook to represent long-timescale information of the frames;
- and
- generating a third codebook based on the first codeword and the second codeword for the frames to add long-timescale information context to the short-timescale information of the frames.
A non-transitory computer readable storage medium encoding instructions thereon that, in response to execution by a computer device, cause the computing device to perform operations comprising:
- identifying, by the computing device, a first codeword in a first level codebook to represent short-timescale information of frames in a time-based data item segmented at intervals;
- identifying a second codeword in a second level codebook to represent long-timescale information of the frames;
- determining, for each frame, a tensor product of the first codeword and the second codeword of the corresponding frame;
- and
- generating a third codebook based on the tensor products to add long-timescale information context to the short-timescale information of the frames.
A computing device comprising:
- a memory;
- and
- a processor coupled to the memory, wherein the processor is configured to:
- identify a first codeword in a first codebook to represent short-timescale information of frames in a time-based data item segmented at intervals;
- identify a second codeword in a second codebook to represent long-timescale information of the frames;
- and
- generate a third codebook based on the first codeword and the second codeword for the frames to add long-timescale information context to the short-timescale information of the frames.
A method comprising:
- computing, by a computing device, a short-timescale vectorial representation for frames in a time-based data item segmented at intervals;
- creating at least one long-timescale vectorial representation for the frames in the time-based data item;
- and
- identifying, for the frames in the time-based data item, codewords in a codebook using the short-timescale vectorial representation and the at least one long-timescale vectorial representation for a corresponding frame;
- and
- generating a contextual representation of the time-based data item using the codewords for the frames to represent structure of the short-timescale information of the time-based data item in context of the long-timescale information of the time-based data item.
Dependencies are inferred from the claim text.