# US 8,108,220 B2 · Techniques for accommodating primary content (pure voice) audio and secondary content remaining audio capability in the digital audio production process

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,108,220 B2
- Document ID: US8108220B2
- Status: Granted
- Kind: B2
- Application number: 11/849,934
- Filed: 2007-09-04
- Published: 2008-03-06
- Granted: 2012-01-31
- Earliest claimed: 2000-03-02
- Assignees: Akiba Electronics Institute LLC
- Inventors: William R. Saunders; Michael A. Vaudrey
- Web page: https://patentgrep.com/patent/US8108220B2

## CPC

- H04S 3/00: Systems employing more than two channels, e.g. quadraphonic (H04S5/00, H04S7/00 take precedence)
- G09B 5/04: with audible presentation of the material to be studied (sound recording or reproducing G11B)
- G11B 20/00007: {Time or data compression or expansion (audio compression based on psychoacoustics G10L19/00; data processing for reproducing audio data at different playback speeds G10L21/04; video compression H04N19/00; data compression per se H03M7/30)}
- G11B 20/00992: {Circuits for stereophonic or quadraphonic recording or reproducing}
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G10L 2021/0575: {Aids for the handicapped in speaking}
- G11B 2020/00036: {AC-3, i.e. ATSC digital audio compression standard}
- G11B 2020/10546: {specifically adapted for audio data}
- G11B 2020/10592: {specifically adapted for recording or reproducing multichannel signals}
- G11B 2020/10601: {surround sound signal}
- H04S: STEREOPHONIC SYSTEMS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

The invention enables the inclusion of voice and remaining audio information at different parts of the audio production process. In particular, the invention embodies special techniques for VRA-capable digital mastering, accommodation of PCPV/PCA and/or SCRA signals in audio CODECs, VRA-capable encoders and decoders, and VRA in DVD and other digital audio file formats. The invention facilitates an end-listener's voice-to-remaining audio (VRA) adjustment upon the playback of digital audio media formats by focusing on new configurations of multiple parts of the entire digital audio system, thereby enabling a new technique intended to benefit audio end-users (end-listeners) who wish to control the ratio of the primary vocal/dialog content of an audio program relative to the remaining portion of the audio content in that program. The invention facilitates storage of VRA audio programs on optical storage media, authoring systems for VRA-capable DVDs, playback hardware integrated into VRA-capable optical disc apparatus, and VRA playback hardware for use with non-VRA capable optical disc playback apparatus.

## Claims

### Claim 1

A non-transitory computer-readable storage medium whose contents cause an audio and/or video device to perform operations for decoding a voice-to-remaining-audio-capable (VRA-capable) audio program stored on the storage medium, the operations comprising:
identifying VRA data stored in the storage medium that assigns individual primary content pure voice (PCPV/PCA) audio tracks to first individual spatial channels and also assigns individual contextual audio tracks to second individual spatial channels, wherein the first and second individual spatial channels comprise non-VRA based audio channels; and
decoding the audio program based at least in part on the assignments contained in the VRA data.

### Claim 2 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the VRA data includes at least one of a combination of data bits, a data word, and a data sub-word that is identifiable by the audio and/or video device.

### Claim 3 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein decoding the audio program comprises:
using a first decoder to decode the individual PCPV/PCA audio tracks; and
using a second decoder to decode the individual contextual audio tracks.

### Claim 4 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the operations further comprise outputting the decoded audio program to one or more digital and/or analog outputs.

### Claim 5 (depends on 4)

The non-transitory computer-readable storage medium of claim 4 wherein the digital and/or analog outputs are coupled to a VRA-capable set-top box.

### Claim 6 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the VRA data stored in the storage medium further assigns auxiliary data to a third non-VRA based spatial channel.

### Claim 7 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the PCPV/PCA and contextual audio tracks are stored as a compressed data format on the storage medium.

### Claim 8 (depends on 7)

The non-transitory computer-readable storage medium of claim 7 wherein the compressed data format is based on at least one of an LPCM format, a Dolby Digital format, a DTS format, a PCM format, an MPEG-1 format, an MPEG-2 format, an MPEG-2 ACC format, and a VRA format.

### Claim 9 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the first and second individual spatial channels are associated with at least one of a right front (R), a left front (L), a right surround (Rs), a left surround (Ls), a center (C), and a low frequency effect (LFE) channel.

### Claim 10 (depends on 1)

The non-transitory computer-readable storage medium of claim 1 wherein the storage medium is a DVD.

### Claim 11

A method for storing a voice-to-remaining-audio-capable (VRA-capable) audio program on a computer-readable storage medium, the method comprising:
receiving the VRA-capable audio program;
creating VRA data from the VRA-capable audio program that assigns individual primary content pure voice (PCPV/PCA) audio tracks to first individual spatial channels and also assigns individual contextual audio tracks to second individual spatial channels, wherein the first and second individual spatial channels are non-VRA based audio channels;
storing the VRA-capable audio program on the storage medium; and
storing the VRA data on the storage medium.

### Claim 12 (depends on 11)

The method of claim 11 wherein storing the VRA-capable audio program occurs as part of a digital audio mastering process.

### Claim 13 (depends on 11)

The method of claim 11 further comprising encoding the PCPV/PCA and contextual audio tracks based on at least one of an LPCM format, a Dolby Digital format, a DTS format, a PCM format, an MPEG-1 format, an MPEG-2 format, an MPEG-2 ACC format, and a VRA format.

### Claim 14 (depends on 11)

The method of claim 11 wherein storing the VRA-capable audio program occurs as part of a DVD authoring process.

### Claim 15 (depends on 11)

The method of claim 11 wherein storing the audio program further includes:
assigning a non-VRA based audio track to at least one of the individual first and second spatial channels; and
storing auxiliary data on the storage medium that indicates to an audio and/or video device to revert to non-VRA audio playback when the non-VRA based audio track is encountered by the audio and/or video device.

### Claim 16 (depends on 11)

The method of claim 11 wherein the storage medium is a DVD.

### Claim 17 (depends on 16)

The method of claim 16, further comprising authoring the DVD so that VRA audio playback can be enabled or disabled when an audio and/or video device is using the DVD.

### Claim 18 (depends on 16)

The method of claim 16, further comprising creating a video title set in the DVD that automatically initiates VRA audio playback when an audio and/or video device uses the DVD.

### Claim 19

An apparatus for producing voice-to-remaining-audio-capable (VRA-capable) audio, comprising:
one or more individual signal paths corresponding to non-VRA based audio channels; and
a post processor coupled to the one or more individual signal paths and configured to produce a first signal corresponding to at least one primary content pure voice (PCPV/PCA) audio track and a second signal corresponding to at least one contextual audio track, the first and second signals being based on audio information associated with the non-VRA based audio channels.

### Claim 20 (depends on 19)

The apparatus of claim 19 wherein the apparatus is a VRA-capable DVD player or a set-top box for coupling to a non-VRA capable DVD player.

### Claim 21 (depends on 19)

The apparatus of claim 19 wherein the non-VRA based audio channels correspond to at least one of a right front (R), a left front (L), a right surround (Rs), a left surround (Ls), a center (C), and a low frequency effect (LFE) channel.

### Claim 22 (depends on 19)

The apparatus of claim 19 wherein the apparatus is a set-top box and the one or more individual signal paths include one or more digital or analog inputs.

### Claim 23 (depends on 19)

The apparatus of claim 19 further comprising a control coupled to the post processor and allowing independent amplitude adjustments of the first and second signals.

### Claim 24 (depends on 19)

The apparatus of claim 19 wherein the post processor is configured to sum the PCPV/PCA audio track with the contextual audio track.

### Claim 25 (depends on 19)

The apparatus of claim 19 wherein the post processor is configured to produce virtual surround sound audio using the PCPV/PCA and contextual audio tracks.

### Claim 26 (depends on 19)

The apparatus of claim 19 wherein the post processor is configured to output video that is synchronized with the PCPV/PCA and contextual audio tracks.