# US 2012/0251069 A1 · Audio enhancement based on video and/or other characteristics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0251069 A1
- Document ID: US20120251069A1
- Status: Published application
- Kind: A1
- Application number: 13/074,244
- Filed: 2011-03-29
- Published: 2012-10-04
- Earliest claimed: 2011-03-29
- Assignees: Broadcom Corporation
- Inventors: Ike A. Ikizyan
- Web page: https://patentgrep.com/patent/US20120251069A1

## CPC

- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 9/87: Regeneration of colour television signals (H04N9/80 takes precedence)
- H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)}
- H04N 21/439: Processing of audio elementary streams
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- G11B 2020/10555: {wherein the frequency, the amplitude, or other characteristics of the audio signal is taken into account}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Audio enhancement based on video and/or other characteristics. Information associated with a media signal is employed to modify an audio signal portion thereof. When undergoing playback, a modified audio signal enhances a perceptual experience for a user (e.g., a listener, a viewer, etc.). Based on information from any desired source, an audio signal may undergo certain modification so that, when played back, the modified audio signal enhances a user's perceptual experience. For example, information related to a scene (e.g., foreground, background, etc.) of a media signal (e.g., extracted from an image frame of a video signal thereof) may be used to modify the audio effects of the audio signal portion of the media signal. In addition, information related to the position of an audio source (e.g., such as a location of a speaker/character in a film) may be used to modify the audio signal to reflect that audio source's location.

## Claims

### Claim 1

An apparatus, comprising:
a processing module for processing a media signal thereby identifying a characteristic associated there with, wherein:
the media signal including a video signal and an audio signal; and
the characteristic associated with the media signal being image information associated with at least one of a plurality of frames of the video signal; and
an audio processor for identifying at least one audio playback parameter based on the characteristic for use in playback of the audio signal to effectuate an audio effect corresponding to the characteristic.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein:
the image information corresponding to at least one of a color, a contrast, a brightness, a background, a foreground, an object, an object location, a change of the color, a change of the contrast, a change of the brightness, a change of the background, a change of the foreground, a change of the object, and a change of the object location.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein:
the processing module processing the media signal thereby identifying meta data associated with the media signal; and
the audio processor identifying the at least one audio playback parameter based on the meta data.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising:
an audio player including at least one speaker for outputting the audio signal in accordance with the at least one audio playback parameter.

### Claim 5 (depends on 1)

The apparatus of claim 1, further comprising:
a display; and
an audio player including at least one speaker for outputting the audio signal in accordance with the at least one audio playback parameter when the display outputting the video signal.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein:
the at least one audio playback parameter being at least one of a balance parameter, a fader parameter, an equalizer parameter, an audio effect parameter, a speaker parameter, a mono parameter, a stereo parameter, an audio high definition (HD) parameter, an audio three-dimensional (3D) parameter, and a surround sound parameter.

### Claim 7

An apparatus, comprising:
an input for receiving a characteristic associated with a media signal including an audio signal; and
an audio processor for identifying at least one audio playback parameter based on the characteristic for use in playback of the audio signal to effectuate an audio effect corresponding to the characteristic.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein:
the media signal also including a video signal; and
the characteristic associated with the media signal being image information associated with at least one of a plurality of frames of the video signal.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein:
the media signal also including a video signal;
the characteristic associated with the media signal being image information associated with at least one of a plurality of frames of the video signal; and
the image information corresponding to at least one of a color, a contrast, a brightness, a background, a foreground, an object, an object location, a change of the color, a change of the contrast, a change of the brightness, a change of the background, a change of the foreground, a change of the object, and a change of the object location.

### Claim 10 (depends on 7)

The apparatus of claim 7, wherein:
the audio processor modifying the audio signal of the media signal in accordance with the characteristic thereby generating a modified media signal; and further comprising:
a memory for storing the media signal and the modified media signal.

### Claim 11 (depends on 7)

The apparatus of claim 7, wherein:
the characteristic associated with the media signal being meta data associated with the media signal.

### Claim 12 (depends on 7)

The apparatus of claim 7, further comprising:
a processing module for processing the media signal thereby identifying the characteristic associated with the media signal and for providing the characteristic via the input.

### Claim 13 (depends on 7)

The apparatus of claim 7, further comprising:
an audio player including at least one speaker for outputting the audio signal in accordance with the at least one audio playback parameter.

### Claim 14 (depends on 7)

The apparatus of claim 7, wherein:
the media signal also including a video signal; and further comprising:
a display; and
an audio player including at least one speaker for outputting the audio signal in accordance with the at least one audio playback parameter when the display outputting the video signal.

### Claim 15 (depends on 7)

The apparatus of claim 7, wherein:
the at least one audio playback parameter being at least one of a balance parameter, a fader parameter, an equalizer parameter, an audio effect parameter, a speaker parameter, a mono parameter, a stereo parameter, an audio high definition (HD) parameter, an audio three-dimensional (3D) parameter, and a surround sound parameter.

### Claim 16

A method, comprising:
receiving a characteristic associated with a media signal including an audio signal; and
operating an audio processor for identifying at least one audio playback parameter based on the characteristic for use in playback of the audio signal to effectuate an audio effect corresponding to the characteristic.

### Claim 17 (depends on 16)

The method of claim 16, further comprising:
processing the media signal thereby identifying the characteristic associated with the media signal and for providing the characteristic.

### Claim 18 (depends on 16)

The method of claim 16, wherein:
the media signal also including a video signal;
the characteristic associated with the media signal being image information associated with at least one of a plurality of frames of the video signal; and
the image information corresponding to at least one of a color, a contrast, a brightness, a background, a foreground, an object, an object location, a change of the color, a change of the contrast, a change of the brightness, a change of the background, a change of the foreground, a change of the object, and a change of the object location.

### Claim 19 (depends on 16)

The method of claim 16, wherein:
the media signal also including a video signal; and further comprising:
outputting the video signal via a display; and
outputting the audio signal in accordance with the at least one audio playback parameter when the display outputting the video signal.

### Claim 20 (depends on 16)

The method of claim 16, wherein:
the at least one audio playback parameter being at least one of a balance parameter, a fader parameter, an equalizer parameter, an audio effect parameter, a speaker parameter, a mono parameter, a stereo parameter, an audio high definition (HD) parameter, an audio three-dimensional (3D) parameter, and a surround sound parameter.
