# US 7,412,380 B1 · Ambience extraction and modification for enhancement and upmix of audio signals > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 7,412,380 B1 - Document ID: US7412380B1 - Status: Granted - Kind: B1 - Application number: 10/738,361 - Filed: 2003-12-17 - Granted: 2008-08-12 - Earliest claimed: 2003-12-17 - Assignees: Creative Technology Ltd - Inventors: Carlos Avendano; Michael Goodwin; Ramkumar Sridharan; Martin Wolters; Jean-Marc Jot - Web page: https://patentgrep.com/patent/US7412380B1 ## CPC - G10L 25/48: specially adapted for particular use - G10L 21/00: Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility (G10L19/00 takes precedence) - H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)} - H04S 5/005: {of the pseudo five- or more-channel type, e.g. virtual surround} - G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04S: STEREOPHONIC SYSTEMS ## Abstract Modifying an audio signal comprising a plurality of channel signals is disclosed. At least selected ones of the channel signals are transformed into a time-frequency domain. The at least selected ones of the channel signals are compared in the time-frequency domain to identify corresponding portions of the channel signals that are not correlated or are only weakly correlated across channels. The identified corresponding portions of said channel signals are modified. ## Claims ### Claim 1 A method for modifying an audio signal comprising a plurality of channel signals, the method comprising: transforming at least selected ones of the channel signals into a time-frequency domain; comparing said at least selected ones of the channel signals in the time-frequency domain to identify corresponding portions of said channel signals that are not correlated or are only weakly correlated across channels; and modifying the identified corresponding portions of said channel signals, wherein the step of modifying comprises: determining for each channel an input ratio in which the numerator comprises a measure of said portions of the channel signal that are uncorrelated or weakly correlated and the denominator comprises a measure of the overall channel signal; receiving a user input indicating a desired output ratio of uncorrelated or weakly correlated portions to total signal; and applying to said portions of said channel signals that are uncorrelated or weakly correlated a modification factor calculated to modify the channel signals as required to achieve the desired output ratio indicated by the user. ### Claim 2 (depends on 1) The method of claim 1, wherein determining for each channel an input ratio comprises: extracting the uncorrelated or weakly correlated portions from the overall signal; determining the energy level of the uncorrelated or weakly correlated portions; determining the energy level of the overall signal; and dividing the energy level of the uncorrelated or weakly correlated portions by the energy level of the overall signal. ### Claim 3 (depends on 2) The method of claim 2, wherein the modification factor comprises the square root of the result obtained by dividing the user-indicated ratio by the input ratio. ### Claim 4 A method for providing a generated signal to a playback channel of a multichannel playback system, the method comprising: receiving an input audio signal comprising a plurality of input channel signals; transforming at least selected ones of the input channel signals into a time-frequency domain; comparing said at least selected ones of the input channel signals in the time-frequency domain to identify corresponding portions of said input channel signals that are not correlated or are only weakly correlated; extracting from each of said input channel signals the identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated; combining the extracted portions, including: determining the magnitude of the respective portions of said input channel signals that are not correlated or are only weakly correlated; taking the absolute difference of the magnitude values; and applying a phase to the result of the absolute difference; and providing to the playback channel a signal comprising at least in part said extracted and combined identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated. ### Claim 5 (depends on 4) The method of claim 4, wherein combining the extracted portions comprises taking the difference between the corresponding extracted portions. ### Claim 6 (depends on 4) The method of claim 4, wherein the playback channel comprises a first playback channel and further comprising providing to at least one additional playback channel a signal comprising at least in part said extracted and combined identified corresponding portions of said input channel signals that are not correlated or are only weakly correlated. ### Claim 7 (depends on 6) The method of claim 6, further comprising decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel. ### Claim 8 (depends on 7) The method of claim 7, wherein decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel comprises processing the signal provided to each respective playback channel using an allpass filter configured to apply a phase adjustment that is different than the phase adjustment applied to the respective signals provided to the other playback channel(s). ### Claim 9 (depends on 7) The method of claim 7, wherein decorrelating the signal provided to said first playback channel and the signal provided to said at least one additional playback channel comprises processing the signal provided to each respective playback channel using a delay line configured to apply a delay that is different than the delay applied to the respective signals provided to the other playback channel(s). ### Claim 10 (depends on 4) The method of claim 4, further comprising modifying the extracted and combined portions prior to providing them to the playback channel. ### Claim 11 (depends on 10) The method of claim 10, wherein the modification is determined at least in part by a user input. ### Claim 12 (depends on 11) The method of claim 11, wherein the user input determines at least in part the gain of an amplifier used to process the extracted and combined portions. ### Claim 13 (depends on 11) The method of claim 11, wherein the user input determines at least in part a bandwidth within which the modification is performed. ### Claim 14 (depends on 13) The method of claim 13, wherein the bandwidth is implemented by processing the extracted and combined portions using a bandpass filter and the user input determines at least in part the lower and upper boundary frequencies of the bandpass filter. ### Claim 15 (depends on 4) The method of claim 4, wherein the steps of extracting and combining comprise determining the magnitude of the respective portions of said input channel signals that are not correlated or are only weakly correlated, taking the absolute difference of the magnitude values, and applying the phase of one of the input channels to the result. ### Claim 16 (depends on 4) The method of claim 4, wherein one of the plurality of input channel signals corresponds to the playback channel and wherein the signal provided to the playback channel further comprises the corresponding input channel signal.