# US 2017/0249952 A1 · Encoder, decoder and methods for encoding and decoding data segments representing a time-domain data stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0249952 A1
- Document ID: US20170249952A1
- Status: Published application
- Kind: A1
- Application number: 15/595,170
- Filed: 2017-05-15
- Published: 2017-08-31
- Earliest claimed: 2006-12-12
- Assignees: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Applicants: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
- Inventors: Ralf GEIGER; Max NEUENDORF; Yoshikazu YOKOTANI; Nikolaus RETTELBACH; Juergen HERRE; Stefan GEYERSBERGER
- Web page: https://patentgrep.com/patent/US20170249952A1

## CPC

- G10L 19/18: Vocoders using multiple modes
- G10L 19/00: Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis (in musical instruments G10H)
- G10L 19/02: using spectral analysis, e.g. transform vocoders or subband vocoders
- G10L 19/022: Blocking, i.e. grouping of samples in time; Choice of analysis windows; Overlap factoring
- G10L 19/032: Quantisation or dequantisation of spectral components
- G10L 19/265: {Pre-filtering, e.g. high frequency emphasis prior to encoding}
- H04N 19/00: Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N 21/2368: Multiplexing of audio and video streams
- H04N 21/2383: Channel coding {or modulation} of digital bit-stream, e.g. QPSK modulation (arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002)
- H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
- H04N 21/4341: {Demultiplexing of audio and video streams}
- H04N 21/4382: {Demodulation or channel decoding, e.g. QPSK demodulation (analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002)}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples. The apparatus includes a time-domain decoder for decoding a data segment being encoded in the time domain and a processor for processing the data segment being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks. The apparatus further includes an overlap/add-combiner for combining the overlapping time-domain data blocks to obtain a decoded data segment of the time-domain data stream.

## Claims

### Claim 1

An apparatus for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples, the apparatus comprising:
a time-domain decoder for decoding a data segment being encoded in the time domain;
a processor for processing the data segments being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks; and
an overlap/add-combiner for combining the overlapping time-domain data blocks to obtain the decoded data segments of the time-domain data stream.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the processor comprises a frequency-domain decoder for decoding data segments being encoded in the frequency domain to obtain frequency-domain data segments.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the processor is adapted for processing a data segment being encoded in the time domain and in the frequency domain in parallel.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein the processor comprises a time-domain to frequency-domain converter for converting the output data of the time-domain decoder to obtain converted frequency-domain data segments.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the processor comprises a frequency-domain combiner for combining the frequency-domain data segments and the converted frequency-domain data segments to obtain a frequency-domain data stream.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the processor comprises a frequency-domain to time-domain converter for converting the frequency-domain data stream to overlapping time-domain data blocks.

### Claim 7 (depends on 2)

The apparatus of claim 2, wherein the frequency domain decoder further comprises a re-quantization stage.

### Claim 8 (depends on 4)

The apparatus of claim 4, wherein the time-domain to frequency-domain converter comprises a cosine modulated filterbank, an extended lapped transform, a low-delay filterbank, a polyphase filterbank or a modified discrete cosine transform.

### Claim 9 (depends on 5)

The apparatus of claim 5, wherein the frequency-domain combiner comprises an adder.

### Claim 10 (depends on 6)

The apparatus of claim 6, wherein the frequency-domain to time-domain converter comprises a cosine modulated filterbank or an inverse modified discrete cosine transform.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the time-domain decoder is adapted for using a prediction filter to decode a data segment encoded in the time domain.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the processor comprises a calculator for calculating overlapping time-domain data blocks based on the output data of the time-domain decoder.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the calculator is adapted for reproducing an overlapping property of the frequency-domain to time-domain converter based on the output data of the time-domain decoder.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the calculator is adapted for reproducing a time-domain aliasing characteristic of the frequency-domain to time-domain converter based on the output data of the time-domain decoder.

### Claim 15 (depends on 6)

The apparatus of claim 6, wherein the frequency-domain to time-domain converter is adapted for converting the frequency-domain data segments provided by the frequency-domain decoder to overlapping time-domain data blocks.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the overlap/add-combiner is adapted for combining the overlapping time-domain data blocks provided by the frequency-domain to time-domain converter and the calculator to obtain decoded data segments of the time-domain data stream.

### Claim 17 (depends on 8)

The apparatus of claim 8, wherein the calculator comprises a time-domain aliasing stage for time-aliasing output data of the time-domain decoder to obtain the overlapping time-domain data blocks.

### Claim 18 (depends on 12)

The apparatus of claim 12, wherein the calculator is adapted for
segmenting the output of the time-domain decoder in calculator segments comprising 2N sequential samples,
applying weights to the 2N samples according to an analysis window function, subtracting the first N/2 samples in reversed order from the second N/2 samples,
adding the last N/2 samples in reversed order to third N/2 samples,
inverting the second and third N/2 samples
replacing the first N/2 samples with the time-reversed and inverted version of the second N/2 samples,
replacing the fourth N/2 samples with the time-reversed version of the third N/2 samples, and
applying weights to the 2/N samples according to a synthesis windowing function.

### Claim 19 (depends on 6)

The apparatus of claim 6, wherein the overlap/add-combiner is adapted for applying weights according to a synthesis windowing function to overlapping time-domain data blocks provided by the frequency-domain to time-domain converter.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the overlap/add-combiner is adapted for applying weights according to a synthesis windowing function being adapted to a size of an overlapping region of consecutive overlapping time-domain data blocks.

### Claim 21 (depends on 20)

The apparatus of claim 20, wherein the calculator is adapted for applying weights to the 2N samples according to an analysis windowing function being adapted to a size of an overlapping region of consecutive overlapping time-domain data blocks and wherein the calculator is adapted for applying weights to the 2N samples according to a synthesis windowing function being adapted to the size of the overlapping region.

### Claim 22 (depends on 1)

The apparatus of claim 1, wherein a size of an overlapping region of two consecutive time-domain data blocks which are encoded in the frequency domain is larger than a size of an overlapping region of two consecutive time-domain data blocks of which one being encoded in the frequency domain and one being encoded in the time domain.

### Claim 23 (depends on 1)

The apparatus of claim 1, wherein the overlapping of data blocks is being determined according to the AAC-specifications.

### Claim 24 (depends on 1)

The apparatus of claim 1, further comprising a bypass for the processor and the overlap/add-combiner, the bypass being adapted for bypassing the processor and the overlap/add-combiner when non-overlapping consecutive time-domain data blocks incur in data segments which are encoded in the time domain.

### Claim 25

Method for decoding data segments representing a time-domain data stream, a data segment being encoded in the time domain or in the frequency domain, a data segment being encoded in the frequency domain having successive blocks of data representing successive and overlapping blocks of time-domain data samples, comprising the steps of:
decoding a data segment being encoded in the time domain;
processing the data segment being encoded in the frequency domain and output data of the time-domain decoder to obtain overlapping time-domain data blocks; and combining the overlapping time-domain data blocks to obtain the decoded data segments of the time-domain data stream.

### Claim 26 (depends on 25)

Computer program having a program code for performing the method of claim 25, when the program code runs on a computer.

### Claim 27

An apparatus for generating an encoded data stream based on a time-domain data stream, the time-domain data stream having samples of a signal, the apparatus comprising
a segment processor for providing data segments from the data stream, two consecutive data segments having a first or a second overlapping region, the second overlapping region being smaller than the first overlapping region;
a time-domain encoder for encoding a windowed data segment in the time domain;
a frequency-domain encoder for applying weights to samples of the time-domain data stream according to a first or second windowing function to obtain a windowed data segment, the first and second windowing functions being adapted to the first and second overlapping regions, the frequency-domain encoder being adapted for encoding a windowed data segment in the frequency domain;
a time-domain data analyzer for determining a transition indication associated with a data segment; and
a controller for controlling the apparatus such that for data segments having a first transition indication output data of the time-domain encoder is included in the encoded data stream and for data segments having a second transition indication, output data of the frequency-domain encoder is included in the encoded data stream.

### Claim 28 (depends on 27)

The apparatus of claim 27, wherein the time-domain data analyzer is adapted for determining the transition indication from the time-domain data stream, the data segments or from data directly provided by the segment processor.

### Claim 29 (depends on 27)

The apparatus of claim 27, wherein the time-domain data analyzer is adapted for determining a transition measure, the transition measure being based on the level of transience in the time-domain data stream or the data segment and wherein the transition indicator indicates whether a level of transience exceeds a predetermined threshold.

### Claim 30 (depends on 27)

The apparatus of claim 27, wherein the segment processor is adapted for providing data segments with the first and the second overlapping regions,
the time-domain encoder is adapted for encoding the data segments,
the frequency-domain encoder is adapted for encoding the windowed data segments, and
the controller is adapted for controlling the time-domain encoder and the frequency-domain encoder such that for data segments having a first transition indication output data of the time-domain encoder is included in the encoded data stream and for windowed data segments having a second transition indication output data of the frequency-domain encoder is included in the encoded data stream.

### Claim 31 (depends on 27)

The apparatus of claim 27, wherein the controller is adapted for controlling the segment processor for providing the data segments either to the time-domain encoder or the frequency-domain encoder.

### Claim 32 (depends on 27)

The apparatus of claim 27, wherein the frequency-domain encoder is adapted for applying weights of windowing functions according to the AAC-specifications.

### Claim 33 (depends on 27)

The apparatus of claim 27, wherein the frequency-domain encoder is adapted for converting a windowed data segment to the frequency domain to obtain a frequency-domain data segment.

### Claim 34 (depends on 33)

The apparatus of claim 33, wherein the frequency-domain encoder is adapted for quantizing the frequency-domain data segment.

### Claim 35 (depends on 34)

The apparatus of claim 34, wherein the frequency-domain encoder is adapted for evaluating the frequency-domain data segment according to a perceptual model.

### Claim 36 (depends on 35)

The apparatus of claim 35, wherein the frequency-domain encoder is adapted for utilizing a cosine-modulated filterbank, an extended lapped transform, a low-delay filterbank or a polyphase filterbank to obtain the frequency-domain data segments.

### Claim 37 (depends on 33)

The apparatus of claim 33, wherein the frequency-domain encoder is adapted for utilizing a modified discrete cosine transform to obtain the frequency-domain data segments.

### Claim 38 (depends on 27)

The apparatus of claim 27, wherein the time-domain encoder is adapted for using a prediction filter for encoding the data segments.

### Claim 39

Method for generating an encoded data stream based on a time-domain data stream, the time-domain data stream having samples of a signal, comprising the steps of
providing data segments from the data stream, two consecutive data segments having a first or a second overlapping region, the second overlapping region being smaller than the first overlapping region;
determining a transition indication associated with the data segments;
encoding a data segment in the time domain, and/or applying weights to samples of the time-domain data stream according to a first or a second windowing function to obtain a windowed data segment, the first and second windowing functions being adapted to the first and second overlapping regions and encoding the windowed data segment in the frequency domain and;
controlling such that for data segments having a first transition indication output data being encoded in the time-domain is included in the encoded data stream and for data segments having a second transition indication output data being encoded in the frequency domain is included in the encoded data stream.

### Claim 40 (depends on 39)

Computer program having a program code for performing the method of claim 39, when the program code runs on a computer.
