Hold back and real time ranking of results in a streaming matching system
AssigneeGoogle Inc.
InventorsDominik Roblek, Matthew Sharifi
Life of this patent
Estimating the term…
Abstract
A matching system receives probe audio samples for comparison to references of a data store. Comparisons are generated between a first segment of a probe audio sample and corresponding time segments of a plurality of reference audio samples to identify a plurality of sufficiently matching reference audio samples based upon a first set of consistency scores. Matching references are retained, unless they meet a score threshold. Comparisons are continually generated with a second segment of the probe audio sample and corresponding time segments of the sufficiently matching reference audio samples to generate a second set of consistency scores. The retained results are outputted based on the first and second set of consistency scores.
Claims22
A method, comprising:
- using a processor to execute computer executable instructions stored on a non-transitory computer readable medium to perform operations comprising:
- receiving, from an audio streaming system, a probe audio sample;
- comparing a first time segment of the probe audio sample to corresponding time segments of a plurality of reference audio samples to identify a plurality of sufficiently matching reference audio samples based upon a first set of consistency scores generated between one or more feature vectors of the first time segment of the probe audio sample and corresponding feature vectors of the first time segment of each of the reference audio samples;
- determining that the sufficiently matching reference audio samples do not meet a predetermined score threshold;
- retaining the sufficiently matching reference audio samples;
- comparing a second time segment of the probe audio sample to corresponding time segments of the sufficiently matching reference audio samples to identify a plurality of additional matching reference audio samples based upon a second set of consistency scores generated between one or more features vectors of the second time segment of the probe audio sample and corresponding feature vectors of the second time segment of each of the sufficiently matching reference audio samples;
- and
- outputting at least one of the reference audio samples based on the first and second set of consistency scores.
A system, comprising:
- a non-transitory memory that stores computer executable components;
- and
- a microprocessor that executes the following computer executable components stored in the memory, the computer executable components comprising:
- a receiving component that receives, from an audio streaming service, a probe audio sample;
- a comparing component that compares a first time segment of the probe audio sample to corresponding time segments of a plurality of reference audio samples;
- a matching component that identifies a plurality of sufficiently matching reference audio samples based upon a first set of consistency scores generated between one or more feature vectors of the first time segment of the probe audio sample and corresponding feature vectors of the first time segment of each of the reference audio samples;
- a retaining component that determines that the sufficiently matching reference audio samples do not meet a predetermined score threshold and retains the sufficiently matching reference audio samples;
- and
- wherein the comparing component is further configured to compare a second time segment of the probe audio sample to corresponding time segments of the sufficiently matching reference audio samples to identify a plurality of additional matching reference audio samples based upon a second set of consistency scores generated between one or more feature vectors of the second time segment of the probe audio sample and corresponding feature vectors of the second time segment of each of the sufficiently matching reference audio samples;
- and
- a scoring component configured to output at least one of the reference audio samples based on the first and second set of consistency scores.
A non-transitory computer readable storage medium comprising computer executable instructions that, in response to execution, cause a computing system comprising a processor to perform operations, comprising:
- receiving, from an audio streaming service, a probe audio sample;
- comparing a first time segment of the probe audio sample to corresponding time segments of a plurality of reference audio samples to identify a plurality of sufficiently matching reference audio samples based upon a first set of consistency scores generated between one or more feature vectors of the first time segment of the probe audio sample and corresponding feature vectors of the first time segment of each of the reference audio samples;
- determining that the sufficiently matching reference audio samples do not meet a predetermined score threshold;
- retaining the sufficiently matching reference audio samples;
- comparing a second time segment of the probe audio sample to corresponding time segments of the sufficiently matching reference audio samples to identify a plurality of additional matching reference audio samples based upon a second set of consistency scores generated between one or more feature vectors of the second time segment of the second time segment of the probe audio sample and corresponding feature vectors of the second time segment of each of the sufficiently matching reference audio samples;
- and
- outputting at least one of the reference audio samples based on the first and second set of consistency scores.
Dependencies are inferred from the claim text.