# US 10,313,416 B2 · Dynamic latency control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,416 B2 - Document ID: US10313416B2 - Status: Granted - Kind: B2 - Application number: 15/656,680 - Filed: 2017-07-21 - Published: 2019-01-24 - Granted: 2019-06-04 - Earliest claimed: 2017-07-21 - Assignees: NXP B.V. - Applicants: NXP B.V. - Inventors: Mark Barry Dolson - Web page: https://patentgrep.com/patent/US10313416B2 ## CPC - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - G10L 21/02: Speech enhancement, e.g. noise reduction or echo cancellation (reducing echo effects in line transmission systems H04B3/20; echo suppression in hands-free telephones H04M9/08) - G10L 21/0208: Noise filtering - G10L 21/057: for improving intelligibility - H04L 65/80: Responding to QoS - G10L 19/167: {Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes} - G10L 21/055: for synchronising with other signals, e.g. video signals - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract As may be implemented in a manner consistent with one or more embodiment, aspects of the disclosure are directed to latency control with signals, such as audio signals. For instance, a quality characteristic of an audio signal having time-sequenced frames exhibiting a signal quality can assessed, and an output indicative of the signal quality is provided based on the assessment. An amount of latency in the audio signal is dynamically adjusted based on the output, and the latency can be used in processing the time-sequenced frames, such as to use future frames in assessing or correcting a current frame during a time period facilitated via the latency. ## Claims ### Claim 1 An apparatus comprising: a first circuit configured and arranged to assess a quality characteristic of an audio signal having time-sequenced frames exhibiting a signal quality, and to provide an output indicative of the signal quality; a second circuit configured and arranged to dynamically adjust an amount of latency in the audio signal, based on the output indicative of the signal quality; and a third circuit configured and arranged with the second circuit to: for each of the time-sequenced frames, assess at least one additional frame associated with the audio signal and corresponding to a future time using time provided via the latency, and modify the time-sequenced frame based on the assessment of the at least one additional frame. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the third circuit is configured and arranged with the second circuit to assess the at least one additional frame by assessing noise in a number of additional ones of the time-sequenced frames corresponding to a future time relative to the frame being modified, based on a timeframe defined by the amount of latency, and the second circuit is configured and arranged to increase or decrease the amount of latency to provide a desired number of the at least one additional frames to be assessed, therein providing a trade-off between latency and performance enhancement in processing of the audio signal. ### Claim 3 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal based on a content characteristic of the audio in the signal and a predefined amount of acceptable latency associated with the content characteristic. ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the content characteristic is indicative of one of a plurality of types of audio communication, wherein each type of audio communication has a predetermined amount of acceptable latency associated therewith. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the third circuit is configured and arranged with the second circuit to assess the at least one additional frame by assessing additional frames associated with the audio signal later in time relative to the frame being corrected and within a timeframe provided by the latency. ### Claim 6 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal based on an expected increase in quality of the signal gained relative to an increase in the latency. ### Claim 7 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal by: increasing the amount of latency in response to the signal degrading beyond a predefined amount of degradation; and after increasing the amount of latency, reducing the amount of latency in response to the signal recovering such that the amount of degradation of the signal is within the predefined amount. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal by increasing and decreasing the amount of latency over time in response to respective increases and decreases in quality of the signal. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal by: operating in a low-latency mode in response to the signal exhibiting a high level of signal quality; and operating an increased-latency mode in response to the signal exhibiting a low level of signal quality that is lower than the high level of signal quality. ### Claim 10 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to dynamically adjust the amount of latency in the audio signal by: increasing latency in the audio signal by adding at least one time-sequenced frame to the audio signal; and decrease latency in the audio signal by removing at least one time-sequenced frame from the audio signal. ### Claim 11 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to identify parts of speech in the audio signal, and to dynamically adjust the amount of latency for different portions of the audio signal based on, for each of the different portions, an identified part of speech that the portion pertains to. ### Claim 12 (depends on 1) The apparatus of claim 1, wherein the second circuit is configured and arranged to process audio signals including speech by increasing the amount of latency for portions of the audio signal corresponding to portions of the signal exhibiting low speech energy, and decreasing the amount of latency for portions of the audio signal corresponding to portions of the signal exhibiting relatively higher speech energy. ### Claim 13 (depends on 1) The apparatus of claim 1, wherein the third circuit is configured and arranged with the second circuit to correct the respective time-sequenced frames by removing noise from each frame based on the assessed at least one additional frame. ### Claim 14 A method comprising: assessing a quality characteristic of an audio signal exhibiting a signal quality; providing an output indicative of the signal quality based on the assessing; dynamically adjusting an amount of latency in the audio signal, based on the output indicative of the signal quality; and assessing at least one additional frame associated with the audio signal and corresponding to a future time using time provided via the latency, and modifying respective time-sequenced frames in the audio signal based on the assessing of the at least one additional frame. ### Claim 15 (depends on 14) The method of claim 14, wherein assessing the at least one additional frame includes assessing noise in a number of additional ones of the time-sequenced frames corresponding to a future time relative to the frame being modified, based on a timeframe defined by the amount of latency, and adjusting the amount of latency in the audio signal includes increasing or decreasing the amount of latency to provide a desired number of the at least one additional frames to be assessed. ### Claim 16 (depends on 14) The method of claim 14, wherein dynamically adjusting the amount of latency in the audio signal includes increasing or decreasing the amount of latency based on a content characteristic of the audio in the signal and a predefined amount of acceptable latency associated with the content characteristic. ### Claim 17 (depends on 14) The method of claim 14, wherein dynamically adjusting the amount of latency in the audio signal includes increasing and decreasing the amount of latency over time respectively in response to increases and decreases in quality of the signal. ### Claim 18 (depends on 14) The method of claim 14, wherein dynamically adjusting the amount of latency in the audio signal includes: increasing latency in the audio signal by adding at least one time-sequenced frame to the audio signal; and decreasing latency in the audio signal by removing at least one time-sequenced frame from the audio signal. ### Claim 19 (depends on 14) The method of claim 14, further including identifying parts of speech in the audio signal, and dynamically adjusting the amount of latency for different portions of the audio signal based on, for each of the different portions, an identified part of speech that the portion pertains to. ### Claim 20 An apparatus comprising: an input circuit configured and arranged to receive an audio signal exhibiting a signal quality; and a computer circuit configured and arranged with the input circuit to assess a quality characteristic of the audio signal; provide an output indicative of the signal quality based on the assessing; dynamically adjust an amount of latency in the audio signal, based on the output indicative of the signal quality; and assess at least one additional frame associated with the audio signal and corresponding to a future time using time provided via the latency, and modifying respective time-sequenced frames in the audio signal based on the assessing of the at least one additional frame.