# US 12,604,151 B2 · Computer system for processing audio content and method thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,604,151 B2
- Document ID: US12604151B2
- Status: Granted
- Kind: B2
- Application number: 17/809,337
- Filed: 2022-06-28
- Published: 2022-12-29
- Granted: 2026-04-14
- Earliest claimed: 2021-06-28
- Assignees: Naver Corporation; Gaudio Lab, Inc.
- Applicants: Naver Corporation; Gaudio Lab, Inc.
- Inventors: Jung Sik Kim; Dae Hwang Kim; Dong Hwan Kim; Taegyu Lee; Jeonghun Seo; Hyeonsu Seo
- Web page: https://patentgrep.com/patent/US12604151B2

## CPC

- H04S 7/301: {Automatic calibration of stereophonic sound system, e.g. with test microphone}
- G06F 16/683: using metadata automatically derived from the content
- H04S 3/002: {Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution (control circuits for electronic adaptation of the sound field H04S7/30)}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- H04S 2420/01: Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer system for processing audio content may receive content that includes metadata on spatial features about a plurality of objects, convert a format set according to a production environment of the content to a format according to a playback environment in an electronic apparatus, and transmit the content in the converted format to the electronic apparatus. The computer system may support content produced in various production environments and various playback environments.

## Claims

### Claim 1

A method, by a computer system, for providing content, comprising:
receiving content that includes metadata on spatial features about a plurality of objects;
determining if a production environment and a playback environment of the content match,
wherein if it is determined that the production environment and the playback environment of the content do not match:
converting a format of the content into at least one format among a plurality of formats including a first format, a second format and a third format according to the playback environment of the content in a plurality of electronic apparatuses, wherein one of the first format, the second format and the third format is a multichannel format and at least two of the plurality of electronic apparatuses are different electronic apparatuses;
wherein if it is determined that the production environment and the playback environment of the content do match, then no converting of the format of the content is performed:
transmitting the content in the first format to a first electronic apparatus of the plurality of electronic apparatuses;
transmitting the content in the second format to a second electronic apparatus of the plurality of electronic apparatuses; and
transmitting the content in the third format to a third electronic apparatus of the plurality of electronic apparatuses,
wherein the first format and the second format are formats for immersive-typed audio content, the first format including a GA7 format and the second format including an audio definition model (ADM) format, and the third format is a format for plain-typed audio content, and
wherein the first electronic apparatus and the second electronic apparatus are electronic apparatuses for playing back the immersive audio content, and the third electronic apparatus is an electronic apparatus for playing back the plain-typed audio content.

### Claim 2 (depends on 1)

The method of claim 1, wherein the format of the content is set according to a production environment of the content.

### Claim 3 (depends on 2)

The method of claim 2, further comprising:
transmitting the content to the electronic apparatus while maintaining the format of the content when the production environment and the playback environment for the content match.

### Claim 4 (depends on 1)

The method of claim 1, wherein the format of the content includes at least one of the first format for rendering and playing back audio signals related to the objects based on the metadata, the second format for playing back audio signals related to the objects through a plurality of audio output devices based on the metadata, and wherein the third format is plain audio content.

### Claim 5 (depends on 4)

The method of claim 4, wherein the converting of the format of the content comprises converting the content in the second format to the content in the first format.

### Claim 6 (depends on 5)

The method of claim 5, wherein the converting to the content in the first format comprises:
detecting the metadata from the content in the second format; and
converting the metadata to the first format.

### Claim 7 (depends on 4)

The method of claim 4, wherein the converting of the format of the content comprises converting the content in the first format to the content in the second format.

### Claim 8 (depends on 7)

The method of claim 7, wherein the first format is converted to the content in the second format based on a layout for the audio output devices of the playback environment.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
receiving content completed using a plurality of audio signals; and
transmitting the received content to the electronic apparatus.

### Claim 10 (depends on 1)

A non-transitory computer-readable recording medium storing instructions that, when executed by a processor, cause the processor to perform the method of claim 1.

### Claim 11

A computer system for providing content, comprising:
a memory;
a communication module; and
a processor configured to connect to each of the memory and the communication module and to execute at least one instruction stored in the memory,
wherein the processor is configured to:
receive content that includes metadata on spatial features about a plurality of objects through the communication module, wherein the content may be in a first format for rendering and playing back audio signals related to objects based on metadata, a second format for rendering and playing back audio signals related to objects through a plurality of output devices based on metadata, and a third format that is plain content;
determine if a production environment and a playback environment of the content match,
wherein if it is determined that the production environment and the playback environment of the content do not match, then convert a format of the content into one of the first format, the second format and the third format according to the playback environment of the content in a plurality of electronic apparatuses, wherein one of the first format, the second format and the third format is a multichannel format and at least two of the plurality of electronic apparatuses are different electronic apparatuses,
wherein if it is determined that the production environment and the playback environment of the content do match, then do not convert the format of the content,
transmit the content in the first format to a first electronic apparatus;
transmit the content in the second format to a second electronic apparatus; and
transmit the content in the third format to a third electronic apparatus,
wherein the first format and the second format are formats for immersive-typed audio content, the first format including a GA7 format and the second format including an audio definition model (ADM) format, and the third format is a format for plain-typed audio content, and
wherein the plurality of electronic apparatuses includes a first electronic apparatus and a second electronic apparatus that are electronic apparatuses for playing back the immersive audio content, and a third electronic apparatus that is an electronic apparatus for playing back the plain-typed audio content.

### Claim 12 (depends on 11)

The computer system of claim 11, wherein the format of the content is set according to a production environment of the content.

### Claim 13 (depends on 12)

The computer system of claim 12, wherein the processor is configured to transmit the content to the first electronic apparatus, the second electronic apparatus or the third electronic apparatus through the communication module while maintaining the format of the content when the production environment and the playback environment for the content match.

### Claim 14 (depends on 11)

The computer system of claim 11, wherein the processor comprises a first conversion module configured to convert the content in the second format to the content in the first format.

### Claim 15 (depends on 14)

The computer system of claim 14, wherein the first conversion module is configured to,
detect the metadata from the content in the second format, and
convert the metadata to the first format.

### Claim 16 (depends on 11)

The computer system of claim 11, wherein the processor comprises a second conversion module configured to convert the content in the first format to the content in the second format.

### Claim 17 (depends on 16)

The computer system of claim 16, wherein the second conversion module is configured to convert the content in the first format to the content in the second format based on a layout for the audio output devices of the playback environment.

### Claim 18 (depends on 11)

The computer system of claim 11, wherein the processor is configured to
receive content completed using a plurality of audio signals through the communication module, and
transmit the received content to the electronic apparatus through the communication module.
