Speech recognition from concurrent visual and audible inputs
AssigneeSony Corporation
InventorsTetsujiro Kondo, Norifumi Yoshiwara
Life of this patent
Estimating the term…
Abstract
With respect to each of codes corresponding to code vectors in a code book stored in a code book storage section, an expectation degree storage section stores an expectation degree at which observation is expected when an integrated parameter with respect to a word as a recognition target is inputted. A vector quantization section vector-quantizes the integrated parameter and outputs a series of codes of a code vector which has a shortest distance to the integrated parameter.
Claims14
A recognition apparatus for recognizing whether or not a time series of input data pieces comprising image data and noise data corresponds to at least one recognition target, comprising:
- code book storage means which stores a plurality of code vectors and identifiers respectively indicating the code vectors;
- model storage means which stores a distance transition model corresponding to at least one recognition target and expressing transition of a distance between a standard series and each code vector of the code book;
- vector quantization means for vector-quantizing the time series of input data pieces, with use of the code book and for outputting a series of the identifiers;
- and
- recognition means for recognizing whether or not the time series of input data pieces corresponds to at least one recognition target, based on the distance transition model and the series of identifiers with respect to the time series of input data pieces.
A recognition method for recognizing whether or not a time series of input data pieces corresponds to at least one recognition target, comprising the steps of:
- vector-quantizing the time series of input data pieces, comprising image data and noise data, with use of a code book including a plurality of code vectors and identifiers respectively indicating the code vectors, and for outputting a series of the identifiers;
- and
- recognizing whether or not the time series of input data pieces corresponds to at least one recognition target, based on a distance transition model expressing a distance between a standard series and the code vectors and the series of identifiers with respect to the time series of input data pieces.
A recording medium which records a program for making a computer execute processing for recognizing whether or not a time series of input data pieces comprising image data and noise data corresponds to at least one recognition target, wherein the program comprises:
- a vector-quantization step of vector-quantizing the time series of input data pieces, with use of a code book including a plurality of code vectors and identifiers respectively indicating the code vectors, and for outputting a series of the identifiers;
- and
- a recognition step of recognizing whether or not the time series of input data pieces corresponds to at least one recognition target, based on a distance transition model expressing a distance between a standard series and the code vectors and the series of identifiers with respect to the time series of input data pieces.
A learning apparatus for performing learning for obtaining a normalization coefficient used for normalization of a characteristic parameter expressing each of a plurality of input data pieces comprising image data and noise data, comprising:
- characteristic parameter normalization means for normalizing each of a plurality of characteristic parameters, based on the normalization coefficient;
- distance calculation means for calculating a distance to a standard parameter, with respect to each of the plurality of characteristic parameters normalized;
- and
- change means for changing the normalization coefficient such that a distance with respect to an arbitrary one of the plurality of characteristic parameters and a distance with respect to another arbitrary one of the plurality of characteristic parameters are equal to each other.
A learning method for performing learning for obtaining a normalization coefficient used for normalization of a characteristic parameter expressing each of a plurality of input data pieces comprising image data and noise data, comprising the steps of:
- normalizing each of a plurality of characteristic parameters, based on the normalization coefficient;
- calculating a distance to a standard parameter, with respect to each of the plurality of characteristic parameters normalized;
- and
- changing the normalization coefficient such that a distance with respect to an arbitrary one of the plurality of characteristic parameters and a distance with respect to another arbitrary one of the plurality of characteristic parameters are equal to each other.
A recording medium which records a program for making a computer execute learning for obtaining a normalization coefficient used for normalization of a characteristic parameter expressing each of a plurality of input data pieces comprising image data and noise data, comprising:
- a characteristic parameter normalization step of normalizing each of a plurality of characteristic parameters, based on the normalization coefficient;
- a distance calculation step of calculating a distance to a standard parameter, with respect to each of the plurality of characteristic parameters normalized;
- and
- a change step of changing the normalization coefficient such that a distance with respect to an arbitrary one of the plurality of characteristic parameters and a distance with respect to another arbitrary one of the plurality of characteristic parameters are equal to each other.
Dependencies are inferred from the claim text.