# US 11,908,486 B2 · Integration of high frequency reconstruction techniques with reduced post-processing delay > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,486 B2 - Document ID: US11908486B2 - Status: Granted - Kind: B2 - Application number: 18/157,644 - Filed: 2023-01-20 - Published: 2023-05-25 - Granted: 2024-02-20 - Earliest claimed: 2018-04-25 - Assignees: Dolby International AB - Applicants: Dolby International AB - Inventors: Kristofer Kjoerling; Lars Villemoes; Heiko Purnhagen; Per Ekstrand - Web page: https://patentgrep.com/patent/US11908486B2 ## CPC - G10L 19/18: Vocoders using multiple modes - G10L 21/038: using band spreading techniques - G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A method for decoding an encoded audio bitstream is disclosed. The method includes receiving the encoded audio bitstream and decoding the audio data to generate a decoded lowband audio signal. The method further includes extracting high frequency reconstruction metadata and filtering the decoded lowband audio signal with an analysis filterbank to generate a filtered lowband audio signal. The method also includes extracting a flag indicating whether either spectral translation or harmonic transposition is to be performed on the audio data and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata in accordance with the flag. The high frequency regeneration is performed as a post-processing operation with a delay of 3010 samples per audio channel. ## Claims ### Claim 1 A method for performing high frequency reconstruction of an audio signal, the method comprising: receiving an encoded audio bitstream, the encoded audio bitstream including audio data representing a lowband portion of the audio signal and high frequency reconstruction metadata; decoding the audio data to generate a decoded lowband audio signal; extracting from the encoded audio bitstream the high frequency reconstruction metadata, the high frequency reconstruction metadata including operating parameters for a high frequency reconstruction process, the operating parameters including a patching mode parameter located in a backward-compatible extension container of the encoded audio bitstream, wherein a first value of the patching mode parameter indicates spectral translation and a second value of the patching mode parameter indicates harmonic transposition by phase-vocoder frequency spreading; filtering the decoded lowband audio signal to generate a filtered lowband audio signal; and regenerating a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata, wherein the regenerating includes spectral translation if the patching mode parameter is the first value and the regenerating includes harmonic transposition by phase-vocoder frequency spreading if the patching mode parameter is the second value, wherein the filtering, regenerating, and combining are performed as a post-processing operation with a delay of 3010 samples per audio channel and wherein the spectral translation comprises maintaining a ratio between tonal and noise-like components by adaptive inverse filtering. ### Claim 2 (depends on 1) The method of claim 1 wherein the backward-compatible extension container further includes a flag indicating whether additional preprocessing is used to avoid discontinuities in a shape of a spectral envelope of the highband portion when the patching mode parameter equals the first value, wherein a first value of the flag enables the additional preprocessing and a second value of the flag disables the additional preprocessing. ### Claim 3 (depends on 2) The method of claim 2 wherein the additional preprocessing includes calculating a pre-gain curve using a linear prediction filter coefficient. ### Claim 4 (depends on 1) The method of claim 1 wherein the backward-compatible extension container further includes a flag indicating whether signal adaptive frequency domain oversampling is to be applied when the patching mode parameter equals the second value, wherein a first value of the flag enables the signal adaptive frequency domain oversampling and a second value of the flag disables the signal adaptive frequency domain oversampling. ### Claim 5 (depends on 4) The method of claim 4 wherein the signal adaptive frequency domain oversampling is applied only for frames containing a transient. ### Claim 6 (depends on 1) The method of claim 1 wherein the harmonic transposition by phase-vocoder frequency spreading is performed with an estimated complexity at or below 4.5 million of operations per second and at or below 3 kWords of memory. ### Claim 7 (depends on 1) A non-transitory computer readable medium containing instructions that when executed by a processor perform the method of claim 1. ### Claim 8 (depends on 1) A computer program product stored in a non-transitory computer readable medium having instructions which, when executed by a computing device or system, cause said computing device or system to execute the method of claim 1. ### Claim 9 An audio processing unit for performing high frequency reconstruction of an audio signal, the audio processing unit comprising: an input interface for receiving an encoded audio bitstream, the encoded audio bitstream including audio data representing a lowband portion of the audio signal and high frequency reconstruction metadata; a core audio decoder for decoding the audio data to generate a decoded lowband audio signal; a deformatter for extracting from the encoded audio bitstream the high frequency reconstruction metadata, the high frequency reconstruction metadata including operating parameters for a high frequency reconstruction process, the operating parameters including a patching mode parameter located in a backward-compatible extension container of the encoded audio bitstream, wherein a first value of the patching mode parameter indicates spectral translation and a second value of the patching mode parameter indicates harmonic transposition by phase-vocoder frequency spreading; an analysis filterbank for filtering the decoded lowband audio signal to generate a filtered lowband audio signal; and a high frequency regenerator for reconstructing a highband portion of the audio signal using the filtered lowband audio signal and the high frequency reconstruction metadata, wherein the reconstructing includes a spectral translation if the patching mode parameter is the first value and the reconstructing includes harmonic transposition by phase-vocoder frequency spreading if the patching mode parameter is the second value, wherein the analysis filterbank, high frequency regenerator, and synthesis filterbank are performed in a post-processor with a delay of 3010 samples per audio channel and wherein the spectral translation comprises maintaining a ratio between tonal and noise-like components by adaptive inverse filtering.