# US 12,513,372 B2 · Audio data processing method, audio data processing apparatus, computer readable storage medium, and electronic device suitable for stage

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,513,372 B2
- Document ID: US12513372B2
- Status: Granted
- Kind: B2
- Application number: 18/344,876
- Filed: 2023-06-30
- Published: 2024-01-04
- Granted: 2025-12-30
- Earliest claimed: 2022-07-01
- Applicants: Jueqing He
- Inventors: Jueqing He
- Web page: https://patentgrep.com/patent/US12513372B2

## CPC

- H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- G11B 2020/10638: {First-in-first-out memories [FIFO] buffers}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

An audio data processing method, an audio data processing apparatus, a computer readable storage medium, and an electronic device, which are suitable for a stage, are provided. The audio data processing method includes steps of obtaining audio data packets sent by wireless communication modules of the audio playing device, and extracting a first timestamp from audio data package names of the audio data packets; determining whether each of first package names corresponding to a preset primary cache queue includes the first timestamp; and inserting the audio data packets into the preset primary cache queue if each of the first package names corresponding to the preset primary cache queue does not include the first timestamp; taking an earliest value in the timestamps corresponding to each of the first package names corresponding to the preset primary cache queue as a second timestamp.

## Claims

### Claim 1

An audio data processing method suitable for a stage, applied to an audio playing device, comprising:
obtaining audio data packets sent by wireless communication modules of the audio playing device, and extracting a first timestamp from audio data package names of the audio data packets;
determining whether each of first package names corresponding to a preset primary cache queue comprises the first timestamp;
inserting the audio data packets into the preset primary cache queue if each of the first package names corresponding to the preset primary cache queue does not comprise the first timestamp, so as to sort each of the first package names corresponding to the preset primary cache queue in an ascending order according to timestamps; not inserting the audio data packets into the preset primary cache queue if each of the first package names corresponding to the preset primary cache queue comprises the first timestamp;
taking an earliest value in the timestamps corresponding to each of the first package names corresponding to the preset primary cache queue as a second timestamp; subtracting a preset delay extraction duration from current time to obtain a latest extraction time, and determining whether the second timestamp is later than the latest extraction time;
if the second timestamp is not later than the latest extraction time, extracting a first audio data packet in the preset primary cache queue corresponding to the second timestamp, and performing audio analysis on the first audio data packet to obtain an audio data segment, inserting the audio data segment into a preset playing queue, and repeatedly taking the earliest value in the timestamps corresponding to each of the first package names corresponding to the preset primary cache queue as the second timestamp until obtaining a preset process stopping signal;
if the second timestamp is later than the latest extraction time, repeatedly taking the earliest value in the timestamps corresponding to each of the first package names corresponding to the preset primary cache queue as the second timestamp until obtaining the preset process stopping signal; and
playing audio by speakers of the audio playing devices, according to the preset playing queue.

### Claim 2 (depends on 1)

The audio data processing method suitable for the stage according to claim 1, wherein the not inserting the audio data packets into the preset primary cache queue if each of the first package names corresponding to the preset primary cache queue comprises the first timestamp comprises:
not inserting the audio data packets into the preset primary cache queue if each of the first package names corresponding to the preset primary cache queue comprises the first timestamp, and initializing a value of a preset counter to 1;
obtaining auxiliary cache queues each having a number corresponding to the value of the preset counter as queues to be analyzed;
determining whether each of second package names corresponding to the queues to be analyzed comprises the first timestamp;
inserting the audio data packets into the queues to be analyzed if each of the second package names corresponding to the queues to be analyzed does not comprise the first timestamp, so as to sort each of the second package names corresponding to the queues to be analyzed in the ascending order according to the timestamps;
adding 1 to the value of the preset counter if each of the second package names corresponding to the queues to be analyzed comprises the first timestamp, and repeatedly obtaining the auxiliary cache queues each having the number corresponding to the value of the preset counter as the queues to be analyzed until obtaining the preset process stopping signal;
wherein the extracting the first audio data packet in the preset primary cache queue corresponding to the second timestamp and the performing the audio analysis on the first audio data packet comprise:
extracting the first audio data packet in the preset primary cache queue corresponding to the second timestamp as a first data packet; and
confirming the audio data segment according to the first data packet and each of the auxiliary cache queues.

### Claim 3 (depends on 2)

The audio data processing method suitable for the stage according to claim 2, wherein the confirming the audio data segment according to the first data packet and each of the auxiliary cache queues comprises:
extracting a second audio data packet in each of the auxiliary cache queues corresponding to the second timestamp as a second data packet;
extracting a third audio data packet having highest channel priority from each of the first data packet and the second data packet in each of the auxiliary cache queues as a data packet to be analyzed according to a preset channel priority configuration; and
performing the audio analysis on the data packet to be analyzed to obtain the audio data segment.

### Claim 4 (depends on 2)

The audio data processing method suitable for the stage according to claim 2, wherein the confirming the audio data segment according to the first data packet and each of the auxiliary cache queues further comprises:
performing the audio analysis on the first data packet to obtain a first data segment;
inputting the first data segment into a preset audio quality evaluation model for quality evaluation and calculation to serve as a first quality evaluation result;
determining whether the first quality evaluation result is within a preset quality evaluation range;
if the first quality evaluation result is within the preset quality evaluation range, taking the first data segment as the audio data segment;
if the first quality evaluation result is not within the preset quality evaluation range, extracting a fourth audio data packet in each of the auxiliary cache queues corresponding to the second timestamp as a third data packet;
performing the audio analysis on the third data packet to obtain a second data segment;
inputting the second data segment into the preset audio quality evaluation model for quality evaluation and calculation to serve as a second quality evaluation result;
extracting a quality evaluation result having highest quality from the first quality evaluation result and the second quality evaluation result as a target quality evaluation result; and
performing the audio analysis on a fifth audio data packet corresponding to the target quality evaluation result to obtain the audio data segment.

### Claim 5 (depends on 4)

The audio data processing method suitable for the stage according to claim 4, wherein the performing the audio analysis on the first data packet to obtain the first data segment comprises:
subtracting the second timestamp from the current time as a duration to be analyzed;
determining whether the duration to be analyzed is less than a preset duration threshold;
if the duration to be analyzed is less than the preset duration threshold, performing the audio analysis on the first data packet to obtain the first data segment; and
if the duration to be analyzed is not less than the preset duration threshold, performing the audio analysis on the first data packet to obtain the audio data segment.

### Claim 6 (depends on 1)

The audio data processing method suitable for the stage according to claim 1, wherein before the obtaining the audio data packets sent by the wireless communication modules of the audio playing device, the audio data processing method suitable for the stage comprises:
obtaining a device correction time and a time auxiliary list sent by a master console;
updating a local clock of the audio playing device according to the device correction time;
obtaining each of time points corresponding to a preset time window from the time auxiliary list based on a preset interval duration as a time point set;
setting nodes of the preset primary cache queue according to the time point set, where each of the nodes is configured to store one of the audio data packets;
wherein the inserting the audio data packets into the preset primary cache queue comprises:
inserting each of the audio data packets into each of first nodes in the nodes of the preset primary cache queue corresponding to the first timestamp;
wherein the extracting the first audio data packet in the preset primary cache queue corresponding to the second timestamp and the performing the audio analysis on the first audio data packet to obtain the audio data segment comprises:
performing the audio analysis on the first audio data packet in second nodes in the nodes of the preset primary cache queue corresponding to the second timestamp to obtain the audio data segment; and
deleting the second nodes in the nodes of the preset primary cache queue corresponding to the second timestamp.

### Claim 7 (depends on 6)

The audio data processing method suitable for the stage according to claim 6, wherein the obtaining the audio data packets sent by the wireless communication modules of the audio playing device comprises:
if a communication type of each of the wireless communication modules is not wireless fidelity (WiFi), obtaining the audio data packets sent by a preset audio output device through the wireless communication modules;
if the communication type of each of the wireless communication modules is the WiFi, obtaining the audio data packets sent by a preset transit device through the wireless communication modules;
wherein the preset transit device is located above the stage, and the preset transit device is configured to obtain the audio data packets sent by the preset audio output device;
wherein the audio output device is configured to obtain the device correction time and the time auxiliary list sent by the master console, update a local clock of the audio playing device according to the device correction time, and perform data packet packaging on preset target audio data according to the time auxiliary list to obtain the audio data packets.

### Claim 8 (depends on 1)

A non-transitory computer readable storage medium having stored therein a computer program to be executed by a processor, causing the processor to execute:
the audio data processing method suitable for the stage according to claim 1.

### Claim 9 (depends on 1)

An electronic device, comprising:
a memory; and
a processor;
wherein the memory stores a computer program, and the computer program is executed by the processor, causing the processor to execute the audio data processing method suitable for the stage according to claim 1.