# US 11,908,482 B2 · Packet loss retransmission method, system, and apparatus, computer-readable storage medium, and device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,482 B2 - Document ID: US11908482B2 - Status: Granted - Kind: B2 - Application number: 17/730,061 - Filed: 2022-04-26 - Published: 2022-08-11 - Granted: 2024-02-20 - Earliest claimed: 2020-06-28 - Assignees: Tencent Technology (Shenzhen) Company Limited - Applicants: Tencent Technology (Shenzhen) Company Limited - Inventors: Junbin Liang - Web page: https://patentgrep.com/patent/US11908482B2 ## CPC - G10L 19/005: Correction of errors induced by the transmission channel, if related to the coding algorithm - H04L 1/18: Automatic repetition systems, e.g. Van Duuren systems - G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders - G10L 25/18: the extracted parameters being spectral information of each sub-band - G10L 25/21: the extracted parameters being power information - H04L 43/0829: Packet loss - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract This application provides a packet loss retransmission method, a computer-readable storage medium, and an electronic device. The packet loss retransmission method includes: obtaining a loudness corresponding to a target audio data packet; and in response to receiving a packet loss state indicating that the target audio data packet is lost, in accordance with a determination that the loudness corresponding to the target audio data packet meets a first threshold: retransmitting the target audio data packet. The technical solutions of this application may alleviate the problem of long data retransmission time, and improve data transmission efficiency. ## Claims ### Claim 1 A packet loss retransmission method, performed by an electronic device, the method comprising: performing packet loss detection on a plurality of audio data packets; providing feedback to a transmitter terminal in accordance with a determination that a packet loss detection result comprises a lost state, the feedback including indication of the lost state; after providing the feedback, screening a target audio data packet for an audio feature that meets a preset condition; after screening the target audio data packet, obtaining a loudness corresponding to the target audio data packet; and in response to receiving a packet loss state indicating that the target audio data packet is lost: in accordance with a determination that the loudness corresponding to the target audio data packet meets a first phon threshold, retransmitting the target audio data packet, wherein the first phon threshold corresponds to perceptibility by human ears; and in accordance with a determination that the loudness corresponding to the target audio data packet does not meet the first phon threshold, forgoing retransmitting the target audio data packet. ### Claim 2 (depends on 1) The method according to claim 1, wherein retransmitting the target audio data packet comprises: retransmitting the target audio data packet to a receiver terminal so that the receiver terminal decodes and outputs the target audio data packet received after retransmission and the target audio data packet received before retransmission. ### Claim 3 (depends on 1) The method according to claim 1, wherein obtaining the loudness corresponding to the target audio data packet comprises: framing an audio bitstream in the target audio data packet according to a preset duration to obtain a plurality of audio frames; processing each of the plurality of audio frames through a preset window function to obtain a plurality of reference frames; calculating a power spectrum for each of the plurality of reference frames; and calculating the loudness corresponding to the target audio data packet according to the power spectrum. ### Claim 4 (depends on 3) The method according to claim 3, wherein the preset window function is a Hanning window function, a Hamming window function, a Blackman window function, a Kaiser window function, a triangular window function, or a rectangular window function. ### Claim 5 (depends on 3) The method according to claim 3, wherein calculating the loudness corresponding to the target audio data packet according to the power spectrum comprises: calculating a frequency loudness at each frequency in the power spectrum according to an energy amplitude of each frequency in the power spectrum; calculating a loudness weight of each frequency in the power spectrum according to the frequency loudness; calculating a weighted sum between the energy amplitude of each frequency in the power spectrum and the loudness weight of each frequency in the power spectrum as a loudness value of the reference frame; and determining a sum of the loudness values corresponding to the plurality of reference frames as the loudness corresponding to the target audio data packet. ### Claim 6 (depends on 2) The method according to claim 2, wherein decoding and outputting, by the receiver terminal, the target audio data packet received after retransmission and the target audio data packet received before retransmission include: decoding, by the receiver terminal, the target audio data packet received after retransmission and the target audio data packet received before retransmission to obtain a plurality of to-be-outputted audio signals; and performing, by the receiver terminal, audio mixing on the plurality of to-be-outputted audio signals to obtain and play a mixed audio signal. ### Claim 7 (depends on 1) The method according to claim 1, further comprising: updating the plurality of audio data packets according to a retransmitted data packet. ### Claim 8 (depends on 1) The method according to claim 1, wherein the audio data packet comprises the loudness of the audio data packet, an audio bitstream, and an audio feature of the audio bitstream, and wherein the audio feature of the audio bitstream comprises an energy distribution of the audio bitstream and an energy amplitude of each frequency in the audio bitstream. ### Claim 9 (depends on 1) The method according to claim 1, wherein obtaining the plurality of audio data packets comprises receiving the plurality of audio data packets transmitted by the transmitter terminal. ### Claim 10 (depends on 8) The method according to claim 8, wherein the preset condition comprises a preset energy amplitude and/or a preset signal-to-noise ratio, and screening the target audio data packet for the audio feature that meets the preset condition from a plurality of obtained audio data packets comprises: in accordance with a determination that there is at least one energy amplitude greater than the preset energy amplitude in the audio feature and/or in accordance with a determination that there is at least one signal-to-noise ratio greater than the preset signal-to-noise ratio in the audio feature: setting the audio data packet associated with the audio bitstream corresponding to the audio feature belongs as the target audio data packet. ### Claim 11 A system, comprising: one or more processors; and memory storing one or more programs, the one or more programs comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising: performing packet loss detection on a plurality of audio data packets; providing feedback to a transmitter terminal in accordance with a determination that a packet loss detection result comprises a lost state, the feedback including indication of the lost state; after providing the feedback, screening a target audio data packet for an audio feature that meets a preset condition; after screening the target audio data packet, obtaining a loudness corresponding to the target audio data packet; and in response to receiving a packet loss state indicating that the target audio data packet is lost: in accordance with a determination that the loudness corresponding to the target audio data packet meets a first phon threshold, retransmitting the target audio data packet, wherein the first phon threshold corresponds to perceptibility by human ears; and in accordance with a determination that the loudness corresponding to the target audio data packet does not meet the first phon threshold, forgoing retransmitting the target audio data packet. ### Claim 12 (depends on 11) The system according to claim 11, wherein retransmitting the target audio data packet comprises: retransmitting the target audio data packet to a receiver terminal so that the receiver terminal decodes and outputs the target audio data packet received after retransmission and the target audio data packet received before retransmission. ### Claim 13 (depends on 11) The system according to claim 11, wherein obtaining the loudness corresponding to the target audio data packet comprises: framing an audio bitstream in the target audio data packet according to a preset duration to obtain a plurality of audio frames; processing each of the plurality of audio frames through a preset window function to obtain a plurality of respective reference frames; calculating a power spectrum for each of the plurality of reference frames; and calculating the loudness corresponding to the target audio data packet according to the power spectrum. ### Claim 14 (depends on 13) The system according to claim 13, wherein the preset window function is a Hanning window function, a Hamming window function, a Blackman window function, a Kaiser window function, a triangular window function, or a rectangular window function. ### Claim 15 (depends on 13) The system according to claim 13, wherein calculating the loudness corresponding to the target audio data packet according to the power spectrum comprises: calculating a frequency loudness at each frequency in the power spectrum according to an energy amplitude of each frequency in the power spectrum; calculating a loudness weight of each frequency in the power spectrum according to the frequency loudness; calculating a weighted sum between the energy amplitude of each frequency in the power spectrum and the loudness weight of each frequency in the power spectrum as a loudness value of the reference frame; and determining a sum of the loudness values corresponding to the plurality of reference frames as the loudness corresponding to the target audio data packet. ### Claim 16 A non-transitory computer-readable storage medium, storing a computer program, the computer program, when executed by one or more processors of an electronic device, causing the one or more processors to perform operations comprising: performing packet loss detection on a plurality of audio data packets; providing feedback to a transmitter terminal in accordance with a determination that a packet loss detection result comprises a lost state, the feedback including indication of the lost state; after providing the feedback, screening a target audio data packet for an audio feature that meets a preset condition; after screening the target audio data packet, obtaining a loudness corresponding to the target audio data packet; and in response to receiving a packet loss state indicating that the target audio data packet is lost: in accordance with a determination that the loudness corresponding to the target audio data packet meets a first phon threshold, retransmitting the target audio data packet, wherein the first phon threshold corresponds to perceptibility by human ears; and in accordance with a determination that the loudness corresponding to the target audio data packet does not meet the first phon threshold, forgoing retransmitting the target audio data packet. ### Claim 17 (depends on 16) The non-transitory computer-readable storage medium according to claim 16, wherein retransmitting the target audio data packet comprises: retransmitting the target audio data packet to a receiver terminal so that the receiver terminal decodes and outputs the target audio data packet received after retransmission and the target audio data packet received before retransmission. ### Claim 18 (depends on 17) The non-transitory computer-readable storage medium according to claim 17, wherein decoding and outputting the target audio data packet received after retransmission and the target audio data packet received before retransmission include: decoding the target audio data packet received after retransmission and the target audio data packet received before retransmission to obtain a plurality of to-be-outputted audio signals; and performing audio mixing on the plurality of to-be-outputted audio signals to obtain and play a mixed audio signal. ### Claim 19 (depends on 16) The non-transitory computer-readable storage medium according to claim 16, wherein obtaining the loudness corresponding to the target audio data packet comprises: framing an audio bitstream in the target audio data packet according to a preset duration to obtain a plurality of audio frames; processing each of the plurality of audio frames through a preset window function to obtain a plurality of reference frames; calculating a power spectrum for each of the plurality of reference frames; and calculating the loudness corresponding to the target audio data packet according to the power spectrum. ### Claim 20 (depends on 19) The non-transitory computer-readable storage medium according to claim 19, wherein the preset window function is a Hanning window function, a Hamming window function, a Blackman window function, a Kaiser window function, a triangular window function, or a rectangular window function.