# US 12,604,149 B2 · Electronic device and method thereof for outputting audio data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,604,149 B2
- Document ID: US12604149B2
- Status: Granted
- Kind: B2
- Application number: 18/105,074
- Filed: 2023-02-02
- Published: 2023-06-15
- Granted: 2026-04-14
- Earliest claimed: 2020-08-04
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Kyumin Kim; Injune Choi; Misun Kim; Jaesung Ahn; Hyunil An; Hyojin Lee
- Web page: https://patentgrep.com/patent/US12604149B2

## CPC

- A63F 13/54: involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
- H04S 7/30: {Control circuits for electronic adaptation of the sound field}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G10L 19/008: Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
- G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes}
- H04R 5/02: Spatial or constructional arrangements of loudspeakers
- H04R 5/04: Circuit arrangements, {e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments (combinations of amplifiers H03F3/68; stereophonic systems H04S)}
- H04S 3/008: {in which the audio signals are in digital form, i.e. employing more than two discrete digital channels (data reduction aspects thereof based on psychoacoustics G10L19/02)}
- G10L 19/173: {Transcoding, i.e. converting between two coded representations avoiding cascaded coding-decoding}
- H04R 2420/07: Applications of wireless loudspeakers or wireless microphones
- H04S 2400/01: Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- H04S: STEREOPHONIC SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

An electronic device and method thereof for outputting audio data, the electronic device including: an audio module for outputting at least one of a piece of first audio data having a designated format or a piece of second audio data having a format different from the designated format; a memory configured to store instructions; and a processor configured to execute the instructions to: mix (hereinafter, first-mix) the at least one piece of second audio data, convert the first-mixed audio data into the designated format, mix (hereinafter, second-mix) the at least one piece of first audio data and the audio data converted into the designated format, post-process the second-mixed audio data; and transmit the post-processed audio data to the audio module to be output through the first sound output device.

## Claims

### Claim 1

An electronic device comprising:
an audio module configured to output, to at least one sound output device, at least one of at least one piece of first audio data having a designated format and at least one piece of second audio data having a format different from the designated format;
at least one processor operatively connected to the audio module; and
at least one memory operatively connected to the at least one processor and configured to store at least one instruction,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
generate first-mixed audio data by mixing the at least one piece of second audio data;
convert the first-mixed audio data into the designated format;
generate second-mixed audio data by mixing the at least one piece of first audio data and the first-mixed audio data converted into the designated format;
post-process the second-mixed audio data;
transmit the post-processed second-mixed audio data to the audio module; and
cause the audio module to output the post-processed second-mixed audio data through the at least one sound output device, and
wherein the at least one instruction, when executed by the at least one processor, further causes the electronic device to:
determine whether the at least one piece of second audio data comprises a plurality of pieces of second audio data; and
based on determining that the at least one piece of second audio data comprises a plurality of pieces of second audio data, mix the plurality of pieces of second audio data to generate the first-mixed audio data.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the at least one processor comprises a main processor and an audio signal processor,
wherein the at least one instruction, when executed by the main processor, causes the main processor to transmit audio data having various formats to the audio signal processor, and
wherein the at least one instruction, when executed by the audio signal processor, causes the audio signal processor to generate processed audio data by performing at least one of format conversion, mixing, and post-processing to be performed on at least a part of the audio data having various formats received from the main processor, and to transmit the processed audio data to the audio module.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor further causes the electronic device to convert the first-mixed audio data into the designated format by converting a sampling rate of the first-mixed audio data into a sampling rate of the designated format.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor further causes the electronic device to:
based on determining that the at least one piece of second audio data comprises a plurality of pieces of second audio data, first-mix the plurality of pieces of second audio data to generate the mixed audio data by:
identifying a sampling rate of each of the plurality of pieces of second audio data,
determining a highest sampling rate from among the identified sampling rates,
for each respective piece of second audio data of the plurality of pieces of second audio data with a respective sampling rate that is not equal to the highest sampling rate from among the identified sampling rates, convert the respective sampling rate of the respective piece of second audio data into the highest sampling rate from among the identified sampling rates, and
mixing the plurality of pieces of second audio data.

### Claim 5 (depends on 1)

The electronic device of claim 1, wherein the at least one piece of first audio data comprises audio data requiring low latency.

### Claim 6 (depends on 1)

The electronic device of claim 1, wherein the at least one sound output device comprises a wireless sound output device in communication with the electronic device via short-range wireless communication or a wired sound output device in communication with the electronic device via wired communication.

### Claim 7 (depends on 6)

The electronic device of claim 6, wherein the short-range wireless communication comprises Bluetooth communication, and the post-processing of the second-mixed audio data comprises encoding.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor, is-further causes the electronic device to:
generate third-mixed audio data by mixing the at least one piece of first audio data;
convert the third-mixed audio data into a reference format;
convert the at least one piece of second audio data into the reference format;
generate fourth-mixed audio data by mixing the third-mixed audio data converted into the reference format and the at least one piece of second audio data converted into the reference format;
post-process the fourth-mixed audio data;
transmit the post-processed fourth-mixed audio data to the audio module; and
cause the audio module to output the post-processed fourth-mixed audio data through a second sound output device.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the at least one instruction, when executed by the at least one processor further causes the electronic device to:
determine whether the second sound output device supports the reference format, and
based on determining that the second sound output device does not support the reference format, convert the fourth-mixed audio data into a format supported by the second sound output device.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the at least one instruction, when executed by the at least one processor further causes the electronic device to:
generate fifth-mixed audio data by mixing the at least one piece of first audio data;
convert the fifth-mixed audio data into a reference format;
convert the at least one piece of second audio data into the reference format;
generate sixth-mixed audio data by mixing the fifth-mixed audio data converted into the reference format and the at least one piece of second audio data converted into the reference format;
convert the sixth-mixed audio data into a format supported by the at least one sound output device, encode the converted sixth-mixed audio data, and cause the audio module to output the encoded audio data through the at least one sound output device; and
convert the sixth-mixed audio data into a format supported by a second sound output device, post-process the converted sixth-mixed audio data, and cause the audio module to output the post-processed audio data through the second sound output device.

### Claim 11

A method for outputting audio data of an electronic device, the method comprising:
generating first-mixed audio data by mixing at least one piece of second audio data;
converting the first-mixed audio data into a designated format;
generating second-mixed audio data by mixing at least one piece of first audio data and the first-mixed audio data converted into the designated format;
post-processing the second-mixed audio data; and
outputting the post-processed second-mixed audio data through at least one sound output device,
wherein the generating the first-mixed audio data by mixing the at least one piece of second audio data comprises:
determining whether the at least one piece of second audio data comprises a plurality of pieces of second audio data; and
based on the determining that the at least one piece of second audio data comprises a plurality of pieces of second audio data, mixing the plurality of pieces of second audio data to generate the first-mixed audio data.

### Claim 12 (depends on 11)

The method of claim 11, wherein the converting of the first-mixed audio data into the designated format comprises converting a sampling rate of the first-mixed audio data into a sampling rate of the designated format.

### Claim 13 (depends on 11)

The method of claim 11, wherein the generating the first-mixed audio data by mixing the at least one piece of second audio data comprises:
based on the determining that the at least one piece of second audio data comprises a plurality of pieces of second audio data, mixing the plurality of pieces of second audio data to generate the first-mixed audio data by:
identifying a sampling rate of each of the plurality of pieces of second audio data,
determining a highest sampling rate from among the identified sampling rates,
for each respective piece of second audio data of the plurality of pieces of second audio data with a respective sampling rate that is not equal to the highest sampling rate from among the identified sampling rates, convert the respective sampling rate of the respective piece of second audio data into the highest sampling rate from among the identified sampling rates, and
mixing the plurality of pieces of second audio data.

### Claim 14 (depends on 11)

The method of claim 11, wherein the at least one piece of first audio data comprises audio data requiring low latency.

### Claim 15 (depends on 11)

The method of claim 11, wherein the at least one sound output device comprises a wireless sound output device in communication with the electronic device via short-range wireless communication or a wired sound output device in communication with the electronic device via wired communication.

### Claim 16

An electronic device comprising:
an audio module configured to output, to at least one sound output device, at least one of at least one piece of first audio data having a designated format and at least one piece of second audio data having a format different from the designated format;
at least one processor operatively connected to the audio module; and
at least one memory operatively connected to the at least one processor and configured to store at least one instruction,
wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:
generate first-mixed audio data by mixing the at least one piece of second audio data;
convert the first-mixed audio data into the designated format;
generate second-mixed audio data by mixing the at least one piece of first audio data and the first-mixed audio data converted into the designated format;
post-process the second-mixed audio data;
transmit the post-processed second-mixed audio data to the audio module; and
cause the audio module to output the post-processed second-mixed audio data through the at least one sound output device,
wherein the at least one processor comprises a main processor and an audio signal processor,
wherein the at least one instruction, when executed by the main processor, causes the main processor to transmit audio data having various formats to the audio signal processor, and
wherein the at least one instruction, when executed by the audio signal processor, causes the audio signal processor to generate processed audio data by performing at least one of format conversion, mixing, and post-processing to be performed on at least a part of the audio data having various formats received from the main processor, and to transmit the processed audio data to the audio module.