Sound synthesizing method and apparatus, and sound band expanding method and apparatus
AssigneeSony Corporation
InventorsShiro Omori, Masayuki Nishiguchi
Life of this patent
Estimating the term…
Abstract
A method and apparatus for sound synthesizing and sound band expanding of a narrow band input signal uses wide-band voiced and unvoiced sound code books and also uses narrow-band voiced and unvoiced sound code books. Coded input sound parameters are decoded and quantized using the narrow-band voiced and unvoiced sound code books and are then de-quantized using the wide-band voiced and unvoiced sound code books. The sound is synthesized based on the de-quantized data and a so-called innovation-related parameter formed by a zero-filling circuit filing zeros between samples of the framed input signal, so that the result is an upsampled aliased wide-band signal used with the de-quantized data to synthesize the sound.
Claims38
A sound synthesizing method for synthesizing a sound from a plurality of coded parameters using a wide-band voiced sound code book and a wide-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters, respectively, extracted from wide-band voiced and unvoiced sounds separated at every predetermined time unit, and using a narrow-band voiced sound code book and a narrow-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters extracted from a narrow-band sound obtained by limiting a frequency band of the separated wide-band voiced and unvoiced sounds, the sound synthesizing method comprising the steps of:
- decoding the plurality of coded parameters to form a plurality of decoded parameters;
- forming an innovation-related parameter from a first one of the plurality of decoded parameters;
- converting a second one of the plurality of decoded parameters to a sound synthesis characteristic parameter;
- discriminating between the voiced and unvoiced sounds discriminable with reference to a third one of the plurality of decoded parameters;
- quantizing the sound synthesis characteristic parameter based on a result of the step of discriminating by using the narrow-band voiced and unvoiced sound code books to form narrow-band voiced and unvoiced sound data;
- dequantizing, by using the wide-band voiced and unvoiced sound code books, the narrow-band voiced and unvoiced sound data having been quantized using the narrow-band voiced and unvoiced sound code books and producing dequantized sound data;
- and
- synthesizing a sound based on the dequantized sound data and the innovation-related parameter.
A sound synthesizing apparatus for synthesizing a sound from a plurality of coded parameters, uses a wide-band voiced sound code book and wide-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters, respectively, extracted from wide-band voiced and unvoiced sounds separated at every predetermined time unit, and uses a narrow-band voiced sound code book and a narrow-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters extracted from a narrow-band sound obtained by limiting a frequency band of the separated wide-band voiced and unvoiced sounds, the apparatus comprising:
- decoding means for decoding the plurality of coded parameters to form a plurality of decoded parameters,
- means for forming an innovation-related parameter from a first one of the plurality of decoded parameters decoded by the decoding means;
- means for obtaining a sound synthesis characteristic parameter from a second one of the plurality of decoded parameters decoded by the decoding means;
- means for discriminating between the voiced and unvoiced sounds with reference to a third one of the plurality of decoded parameters decoded by the decoding means;
- sound quantizing means for quantizing the sound synthesis characteristic parameter based on a result of the discrimination by the means for discriminating of the voiced and unvoiced sounds by using the narrow-band voiced and unvoiced sound code books to form narrow-band voiced and unvoiced sound data;
- sound dequantizing means for dequantizing the quantized voiced and unvoiced sound data from the sound quantizing means by using the wide-band voiced and unvoiced sound code books and producing dequantized data;
- and
- means for synthesizing a sound based on the dequantized data from the sound dequantizing means and the innovation-related parameter.
A sound synthesizing method for synthesizing sound from a plurality of coded parameters using a wide-band sound code book pre-formed from a characteristic parameter extracted from wide-band sounds at every predetermined time unit, comprising the steps of:
- decoding the plurality of coded parameters and forming a plurality of decoded parameters;
- forming an innovation-related parameter from a first one of the plurality of decoded parameters;
- converting a second one of the plurality of decoded parameters to a sound synthesis characteristic parameter;
- calculating a narrow-band characteristic parameter from each code vector in the wide-band sound code books;
- quantizing the sound synthesis characteristic parameter by comparison with the narrow-band characteristic parameter calculated by the step of calculating and producing quantized data;
- dequantizing the quantized data by using the wide-band sound code book and producing dequantized data;
- and
- synthesizing a sound based on the dequantized data and the innovation-related parameter.
A sound synthesizing apparatus for synthesizing sound from a plurality of coded parameters, a wide-band sound code book pre-formed from a characteristic parameter extracted from wide-band sounds at every predetermined time unit, comprising:
- means for decoding the plurality of coded parameters to form a plurality of decoded parameters;
- means for forming an innovation-related parameter from a first one of the plural kinds of parameters decoded by the decoding means;
- means for converting a second one of the plurality decoded parameters of the plural kinds of decoded parameters decoded by the means for decoding to a sound synthesis characteristic parameter;
- means for calculating a narrow-band characteristic parameter from each code vector in the wide-band sound code book;
- means for quantizing the sound synthesis characteristic parameter from the means for converting by using the narrow-band characteristic parameter from the means for calculating and producing quantized data;
- means for dequantizing the quantized data from the means for quantizing by using the wide-band sound code book;
- and
- means for synthesizing a source based on the dequantized data from the means for dequantizing and the innovation-related parameter from the means for forming.
A sound synthesizing method for synthesizing a sound from a plurality of coded parameters, using a wide-band sound code book pre-formed from a characteristic parameter extracted from wide-band sounds at every predetermined time unit, the method comprising the steps of:
- decoding the plurality of coded parameters and forming decoded parameters;
- forming an innovation-related parameter from a first one of the decoded parameters;
- converting a second one of the decoded parameters to a sound synthesis characteristic parameter;
- calculating a narrow-band characteristic parameter, by partial extraction, from each code vector in the wide-band sound code book;
- quantizing the sound synthesis characteristic parameter by comparison with the narrow-band characteristic parameter calculated in the step of calculating and producing quantized data;
- dequantizing the quantized data by using the wide-band sound code book and producing dequantized data;
- and
- synthesizing a sound based on the dequantized data and the innovation-related parameter.
A sound synthesizing method for synthesizing a sound from a plurality of input coded parameters, using a wide-band sound code book pre-formed from a characteristic parameter extracted from wide-band sounds at every predetermined time unit, the method comprising the steps of:
- decoding the plurality of coded parameters and producing decoded parameters;
- forming an innovation-related parameter from a first one of the decoded parameters;
- converting a second one of decoded parameters to a sound synthesis characteristic parameter,
- calculating a narrow-band characteristic parameter, by partial extraction, from each code vector in the wide-band sound code book;
- quantizing the sound synthesis characteristic parameter by comparison with the narrow-band characteristic parameter extracted in the step of calculating and producing quantized data;
- dequantizing the quantized data by using the wide-band sound code book and producing dequantized data;
- and
- synthesizing a sound based on the dequantized data and the innovation-related parameter.
A sound synthesizing apparatus for synthesizing a sound from a plurality of coded parameters using a wide-band sound code book pre-formed from a characteristic parameter extracted from wide-band sounds at every predetermined time unit, the apparatus comprising:
- decoding means for decoding the plurality of coded parameters and producing a plurality of decoded parameters;
- means for forming an innovation-related parameter from a first one of the plurality of decoded parameters from the decoding means;
- parameter converting means for converting a second one of the plurality of the decoded parameters from the decoding means to a sound synthesis characteristic parameter;
- calculating means for calculating a narrow-band characteristic parameter, by partial extraction, from each code vector in the wide-band sound code book;
- quantizing means for quantizing the sound synthesis characteristic parameter from the parameter converting means by using the narrow-band characteristic parameter from the calculating means and producing quantized data;
- dequantizing means for dequantizing the quantized data from the quantizing means by using the wide-band sound code book and producing dequantized data;
- and
- means for synthesizing a sound based on the dequantized data from the dequantizing means and the innovation-related parameter.
A sound band expanding method for expanding a band of an input narrow-band sound using a wide-band voiced sound code book and a wide band unvoiced sound code book pre-formed from voiced and unvoiced sound parameters, respectively, extracted from wide-band voiced and unvoiced sounds separated at every predetermined time unit, and using a narrow-band voiced sound code book and a narrow-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters extracted from a narrow-band sound obtained by limiting a frequency band of the wide-band voiced and unvoiced sounds, the method comprising the steps of:
- discriminating between a voiced sound and an unvoiced sound in the input narrow-band sound at every predetermined time unit;
- generating a voiced parameter and an unvoiced parameter from the narrow-band voiced and unvoiced sounds;
- quantizing the narrow-band voiced parameter and the unvoiced sound parameter of the narrow-band sound by using the narrow-band voiced and unvoiced sound code books and generating narrow-band voiced and unvoiced sound data;
- dequantizing, by using the wide-band voiced and unvoiced sound code books, the narrow-band voiced and unvoiced sound data having been quantized using the narrow-band voiced and unvoiced sound code books and generating dequantized data;
- and
- expanding the band of the narrow-band sound based on the dequantized data.
A sound band expanding apparatus for expanding a band of an input narrow-band sound, using a wide-band voiced sound code book and a wide-band unvoiced sound code book pre-formed from voiced and unvoiced sound parameters, respectively, extracted from wide-band voiced and unvoiced sounds separated at every predetermined time unit, and using a narrow-band voiced sound code book and a narrow-band unvoiced sound code book pre-formed from voiced and unvoiced sound characteristic parameters extracted from a narrow-band sound obtained by limiting a frequency band of the wide-band voiced and unvoiced sounds, the apparatus comprising:
- voiced/unvoiced sound discriminating means for discriminating between a voiced sound and an unvoiced sound in the input narrow-band sound at every predetermined time unit;
- means for generating a voiced parameter and an unvoiced parameter from the narrow-band voiced and unvoiced sounds discriminated by the voiced/unvoiced sound discriminating means;
- quantizing means for quantizing the narrow-band voiced parameter and unvoiced sound parameter from the generated narrow-band voiced parameter and unvoiced parameter by using the narrow-band voiced and unvoiced sound code books and for generating narrow-band voiced and unvoiced sound data;
- and
- dequantizing means for dequantizing, by using the wide-band voiced and unvoiced sound code books, the narrow-band voiced and unvoiced sound data from the quantizing means by using the narrow-band voiced and unvoiced sound code books and producing dequantized data, wherein
- the band of the narrow-band sound is expanded based on the dequantized data from the dequantizing means.
A sound band expanding method for expanding a band of an input narrow-band sound using a wide-band sound code book pre-formed from a parameter extracted from wide-band sounds at every predetermined time unit, the method comprising the steps of:
- generating a narrow-band parameter from the input narrow-band sound;
- calculating a narrow-band parameter from each code vector in the wide-band sound code book;
- quantizing the narrow-band parameter generated from the input narrow-band sound by comparison with the calculated narrow-band parameter;
- dequantizing the quantized data by using the wide-band sound code book and producing dequantized data;
- and
- expanding a band of the narrow-band sound based on the dequantized data.
A sound band expanding apparatus for expanding a band of an input narrow-band sound using a wide-band sound code book pre-formed from parameters extracted from wide-band sounds at every predetermined time unit, the apparatus comprising:
- generating means for generating a narrow-band parameter from the input narrow-band sound;
- calculating means for calculating a narrow-band parameter from each code vector in the wide-band sound code book;
- quantizing means for quantizing the narrow-band parameter from the generating means by comparison with the narrow-band parameter from the calculating means and producing quantized narrow-band data;
- and
- dequantizing means for dequantizing the quantized narrow-band data from the quantizing means by using the wide-band sound code book and producing dequantized data, wherein
- the band of the narrow-band sound being expanded is based on the dequantized data from the dequantizing means.
A sound band expanding method for expanding a band of an input narrow-band sound using a wide-band sound code book pre-formed from a parameter extracted from wide-band sounds at every predetermined time unit, the method comprising the steps of:
- generating a narrow-band parameter from the input narrow-band sound;
- calculating a narrow-band parameter, by partial extraction, from each code vector in the wide-band sound code book;
- quantizing the narrow-band parameter generated from the input narrow-band sound in the step of generating by comparison with the calculated narrow-band parameter from the step of calculating and forming quantized data;
- dequantizing the quantized data by using the wide-band sound code book and forming dequantized data;
- and
- expanding the band of the narrow-band sound based on the dequantized data.
A sound band expanding apparatus for expanding a band of an input narrow-band sound using a wide-band code book pre-formed from a parameter extracted from wide-band sounds at every predetermined time unit, the apparatus comprising:
- generating means for generating a narrow-band parameter from the input narrow-band sound;
- calculating means for calculating a narrow-band parameter, by partial extraction, from each code vector in the wide-band sound code book;
- quantizing means for quantizing the narrow-band parameter generating from the generating means by using the narrow-band parameter from the calculating means and producing quantized narrow-band data;
- and
- dequantizing means for dequantizing the quantized narrow-band data from the quantizing means by using the wide-band sound code book and producing dequantized data, wherein
- the band of the narrow-band sound being expanded is based on the dequantized data from the dequantizing means.
Dependencies are inferred from the claim text.