# US 2019/0246040 A1 · Compression and decoding of single sensor color image data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246040 A1
- Document ID: US20190246040A1
- Status: Published application
- Kind: A1
- Application number: 16/234,389
- Filed: 2018-12-27
- Published: 2019-08-08
- Earliest claimed: 2006-03-22
- Assignees: GoPro, Inc.
- Applicants: GoPro, Inc.
- Inventors: David A. Newman
- Web page: https://patentgrep.com/patent/US20190246040A1

## CPC

- H04N 19/186: the unit being a colour or a chrominance component
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06T 9/00: Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00)
- H04N 1/648: {Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof (H04N1/642 - H04N1/646 take precedence)}
- H04N 5/265: Mixing
- H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635)
- H04N 19/136: Incoming video signal characteristics or properties
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 19/85: using pre-processing or post-processing specially adapted for video compression
- H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

## Claims

### Claim at position 1

-21. (canceled)

### Claim 22

A method for compressing an image, comprising:
receiving raw sensor data that has been captured by an imaging sensor, the raw sensor data comprised of a plurality of arrays of imaging components, each of the plurality of arrays configured to generate a first imaging component, a second imaging component, a third imaging component and a fourth imaging component;
summing the second imaging component with the third imaging component in order to generate a first modified image plane;
subtracting the third imaging component from the second imaging component in order to generate a second modified image plane;
subtracting the first modified image plane from at least the first imaging component in order to generate a third modified image plane;
subtracting the first modified image plane from at least the fourth imaging component in order to generate a fourth modified image plane; and
outputting the first, second, third, and fourth modified image planes.

### Claim 23 (depends on 22)

The method of claim 22, further comprising encoding each of the output first, second, third, and fourth modified image planes independent of other ones of the modified image planes.

### Claim 24 (depends on 23)

The method of claim 23, wherein the encoding comprises using a wavelet compression technology.

### Claim 25 (depends on 23)

The method of claim 23, wherein the encoding comprises using a Discrete Cosine Transform (DCT) compression technology.

### Claim 26 (depends on 22)

The method of claim 22, further comprising separating the received raw sensor data into the first imaging component, the second imaging component, the third imaging component and the fourth imaging component.

### Claim 27 (depends on 26)

The method of claim 26, wherein the separating of the received raw sensor data comprises separating the received raw sensor data into three color primaries.

### Claim 28

A computer readable apparatus comprising a storage medium adapted to store a computer program, the computer program which, when executed, is configured to:
receive raw sensor data that has been captured by an imaging sensor, the raw sensor data comprised of a plurality of arrays of imaging components, each of the plurality of arrays configured to generate a first imaging component, a second imaging component, a third imaging component and a fourth imaging component;
sum the second imaging component with the third imaging component in order to generate a first modified image plane;
subtract the third imaging component from the second imaging component in order to generate a second modified image plane;
subtract the first modified image plane from at least the first imaging component in order to generate a third modified image plane;
subtract the first modified image plane from at least the fourth imaging component in order to generate a fourth modified image plane; and
output the first, second, third, and fourth modified image planes.

### Claim 29 (depends on 28)

The computer readable apparatus of claim 28, wherein the computer program, which when executed is further configured to encode each of the output first, second, third, and fourth modified image planes independent of other ones of the modified image planes.

### Claim 30 (depends on 29)

The computer readable apparatus of claim 29, wherein the encode uses a wavelet compression technology.

### Claim 31 (depends on 29)

The computer readable apparatus of claim 29, wherein the encode uses a Discrete Cosine Transform (DCT) compression technology.

### Claim 32 (depends on 28)

The computer readable apparatus of claim 28, wherein the computer program, which when executed is further configured to separate the received raw sensor data into the first imaging component, the second imaging component, the third imaging component and the fourth imaging component.

### Claim 33 (depends on 32)

The computer readable apparatus of claim 32, wherein the separation of the received raw sensor data comprises separation of the received raw sensor data into three color primaries.

### Claim 34

An imaging decoder system, comprising:
an input configured to receive four quarter-resolution planes, the four quarter-resolution planes comprising:
a first modified image plane, the first modified image plane comprising a sum of a second imaging component with a third imaging component;
a second modified image plane, the second modified image plane comprising a subtraction of the third imaging component and the second imaging component;
a third modified image plane, the third modified image plane comprising a subtraction of a first imaging component from the first modified image plane; and
a fourth modified image plane, the fourth modified image plane comprising a subtraction of a fourth imaging component from the first modified image plane; and
a decoder apparatus, the decoder apparatus configured to reconstruct the four quarter-resolution planes into: (i) a first image that is a quarter of its native resolution, and/or (ii) a second image that comprises the native resolution.

### Claim 35 (depends on 34)

The imaging decoder system of claim 34, wherein the reconstruction of the first image that is the quarter of the native resolution comprises:
division of the third modified image plane by a factor of two;
division of the first modified image plane by a factor of two; and
division of the fourth modified image plane by a factor of two.

### Claim 36 (depends on 34)

The imaging decoder system of claim 34, wherein the reconstruction of the second image that comprises the native resolution comprises:
a decode of the first modified image plane;
a decode of the second modified image plane;
a decode of the third modified image plane; and
a decode of the fourth modified image plane.

### Claim 37 (depends on 36)

The imaging decoder system of claim 36, wherein the decode of the first, second, third, and fourth modified image planes results in generation of the first imaging component, the second imaging component, the third imaging component, and the fourth imaging component.

### Claim 38 (depends on 37)

The imaging decoder system of claim 37, wherein the decoder apparatus is further configured to interleave the generated first imaging component, the generated second imaging component, the generated third imaging component, and the generated fourth imaging component.

### Claim 39 (depends on 38)

The imaging decoder system of claim 38, wherein the result of the interleave comprises an original Bayer layout of a captured image.

### Claim 40 (depends on 39)

The imaging decoder system of claim 39, wherein the decoder apparatus is further configured to perform a de-Bayer operation on the original Bayer layout in order to generate a full raster RGB frame.

### Claim 41 (depends on 40)

The imaging decoder system of claim 40, further comprising an output, the output configured to provide the full raster RGB frame.
