# US 9,436,976 B2 · Video camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,436,976 B2
- Document ID: US9436976B2
- Status: Granted
- Kind: B2
- Application number: 14/609,090
- Filed: 2015-01-29
- Published: 2015-12-03
- Granted: 2016-09-06
- Earliest claimed: 2007-04-11
- Assignees: Red.Com, Inc.
- Applicants: Red.Com, Inc.
- Inventors: James H. Jannard; Thomas Graeme Nattress
- Web page: https://patentgrep.com/patent/US9436976B2

## CPC

- G06T 5/70: Denoising; Smoothing
- G06T 3/4015: Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 9/007: {Transform coding, e.g. discrete cosine transform}
- H04N 19/51: Motion estimation or motion compensation
- H04N 19/593: involving spatial prediction techniques
- H04N 19/615: using motion compensated temporal filtering [MCTF]
- H04N 19/625: using discrete cosine transform [DCT]
- H04N 19/86: involving reduction of coding artifacts, e.g. of blockiness
- H04N 23/00: Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values}
- H04N 25/134: {based on three different wavelength filter elements}
- H04N 25/683: by defect estimation performed on the scene signal, e.g. real time or on the fly detection
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments provide a video camera that can be configured to highly compress video data in a visually lossless manner. The camera can be configured to transform blue and red image data in a manner that enhances the compressibility of the data. The data can then be compressed and stored in this form. This allows a user to reconstruct the red and blue data to obtain the original raw data for a modified version of the original raw data that is visually lossless when demosacied. Additionally, the data can be processed in a manner in which the green image elements are demosaiced first and then the red and blue elements are reconstructed based on values of the demosaiced green image elements.

## Claims

### Claim 1

A method of compressing digital motion picture image data, comprising:
with a plurality of digital image sensor pixels, generating mosaiced image data for each of a plurality of motion video image frames, the mosaiced image data comprising at least:
first pixel data corresponding to first pixels of the plurality of sensor pixels and that represents light corresponding to a first color; and
second pixel data corresponding to second pixels of the plurality of sensor pixels and that represents light corresponding to a second color, the second color being different than the first color;
pre-emphasizing the mosaiced image data;
for each second pixel of a plurality of the second pixels, and based on values of the first pixel data corresponding to two or more of the first pixels, transforming the mosaiced image data at least partly by modifying the second pixel data corresponding to the second pixel, said two or more of the first pixels located on opposite sides of and in the vicinity of the second pixel;
subsequent to said transforming and said pre-emphasizing, compressing the pre-emphasized, transformed mosaiced image data to generate compressed mosaiced image data; and
storing the compressed mosaiced image data on a memory device at a motion video frame rate of at least 23 frames per second.

### Claim 2 (depends on 1)

The method of claim 1, wherein said transforming comprises:
calculating an average of the values of the first pixel data corresponding to said two or more of the first pixels; and
subtracting the calculated average from a value of the second pixel data corresponding to the second pixel.

### Claim 3 (depends on 1)

The method of claim 1, wherein said two or more of the first pixels comprise three or more of the first pixels.

### Claim 4 (depends on 1)

The method of claim 1, wherein said two or more of the first pixels comprise four or more of the first pixels.

### Claim 5 (depends on 1)

The method of claim 1, wherein said two or more of the first pixels include first pixels that are adjacent to the second pixel.

### Claim 6 (depends on 5)

The method of claim 5, wherein said two or more of the first pixels include four of the first pixels that are adjacent to the second pixel.

### Claim 7 (depends on 1)

The method of claim 1, wherein said transforming comprises:
calculating an average of at least the values of the first pixel data corresponding to four of the first pixels that are adjacent to the second pixel; and
subtracting the calculated average from a value corresponding to the second pixel.

### Claim 8 (depends on 1)

The method of claim 1, wherein the mosaiced digital image data comprises third pixel data corresponding to third pixels of the plurality of sensor pixels and that represents light corresponding to a third color, the third color being different than the first and second colors; and wherein said transforming further comprises, for each third pixel of a plurality of the third pixels, and based on values of the first pixel data corresponding to two or more of the first pixels, modifying the third pixel data corresponding to the third pixel, said two or more of the first pixels located on opposite sides of and in the vicinity of the third pixel.

### Claim 9 (depends on 8)

The method of claim 8, wherein the mosaiced digital image data is arranged in a Bayer pattern.

### Claim 10 (depends on 1)

The method of claim 1, wherein said transforming exploits spatial correlation of the second pixel data and improves compression of the second pixel data.

### Claim 11 (depends on 1)

The method of claim 1, wherein the mosaiced image data corresponds to linear light sensor data.

### Claim 12 (depends on 1)

The method of claim 1, further comprising applying a pixel defect management algorithm on the mosaiced image data prior to said compression.

### Claim 13 (depends on 1)

The method of claim 1, wherein said compressing comprises applying a lossy compression algorithm.

### Claim 14 (depends on 1)

The method of claim 1, wherein said pre-emphasizing is performed prior to said transforming.

### Claim 15 (depends on 1)

The method of claim 1, further comprising denoising the mosaiced image data prior to said compressing.

### Claim 16 (depends on 15)

The method of claim 15, wherein said denoising is performed prior to said pre-emphasizing and said transforming.

### Claim 17 (depends on 1)

The method of claim 1, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion picture video having a resolution of at least 2k.

### Claim 18 (depends on 17)

The method of claim 17, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion video image data having a resolution falling in a range of between 2k and 4.5k, inclusive.

### Claim 19 (depends on 17)

The method of claim 17, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion video image data having a resolution of 2k, 4k, or 4.5k.

### Claim 20 (depends on 1)

The method of claim 1 wherein said storing comprises storing the compressed mosaiced image data on a memory device at a motion video frame rate of between 23.976 frames per second and 120 frames per second, inclusive.

### Claim 21

A video camera, comprising:
a portable housing;
a plurality of digital image sensor pixels configured, in response to light emanating from outside the portable housing into the portable housing, to generate mosaiced image data for each of a plurality of motion video image frames, the mosaiced image data comprising at least:
first pixel data corresponding to first pixels of the plurality of sensor pixels and that represents light corresponding to a first color; and
second pixel data corresponding to second pixels of the plurality of sensor pixels and that represents light corresponding to a second color, the second color being different than the first color;
a memory device;
an image processing module configured to:
pre-emphasize the mosaiced image data;
for each second pixel of a plurality of the second pixels and based on values of the first pixel data corresponding to two or more of the first pixels, transform the mosaiced image data at least partly by modifying values of the second pixel data corresponding to the second pixel, said two or more of the first pixels located on opposite sides of and in the vicinity of the second pixel; and
a compression module configured, subsequent to the image processing module performing the pre-emphasis and transformation, to compress the pre-emphasized, transformed mosaiced image data to generate compressed mosaiced image data, wherein the compressed mosaiced image data is stored on the memory device at a motion video frame rate of at least 23 frames per second.

### Claim 22 (depends on 21)

The video camera of claim 21, wherein the image processing module performs the transformation of the mosaiced image data at least partly by:
calculating an average of the values of the first pixel data corresponding to said two or more of the first pixels; and
subtracting the calculated average from a value of the second pixel data corresponding to the second pixel.

### Claim 23 (depends on 21)

The video camera of claim 21, wherein said two or more of the first pixels comprise three or more of the first pixels.

### Claim 24 (depends on 21)

The video camera of claim 21, wherein said two or more of the first pixels comprise four or more of the first pixels.

### Claim 25 (depends on 21)

The video camera of claim 21, wherein said two or more of the first pixels include first pixels that are adjacent to the second pixel.

### Claim 26 (depends on 25)

The video camera of claim 25, wherein said two or more of the first pixels include four of the first pixels that are adjacent to the second pixel.

### Claim 27 (depends on 21)

The video camera of claim 21, wherein the image processing module performs the transformation of the mosaiced image data at least partly by:
calculating an average of at least the values of the first pixel data corresponding to four of the first pixels that are adjacent to the second pixel; and
subtracting the calculated average from a value corresponding to the second pixel.

### Claim 28 (depends on 21)

The video camera of claim 21, wherein the mosaiced digital image data comprises third pixel data corresponding to third pixels of the plurality of sensor pixels and that represents light corresponding to a third color, the third color being different than the first and second colors, wherein the image processing module is further configured to, as part of the transformation of the mosaiced image data, for each third pixel of a plurality of the third pixels, and based on values of the first pixel data corresponding to two or more of the first pixels, modify values of the third pixel data corresponding to the third pixel, said two or more of the first pixels located on opposite sides of and in the vicinity of the third pixel.

### Claim 29 (depends on 21)

The video camera of claim 21, wherein said transforming exploits spatial correlation of the second pixel data and improves compression of the second pixel data.

### Claim 30 (depends on 21)

The video camera of claim 21, wherein the mosaiced image data corresponds to linear light sensor data.

### Claim 31 (depends on 21)

The video camera of claim 21, wherein the image processing module is further configured to apply a pixel defect management algorithm on the mosaiced image data.

### Claim 32 (depends on 21)

The video camera of claim 21, wherein the compression module is configured to apply a lossy compression algorithm.

### Claim 33 (depends on 21)

The video camera of claim 21, wherein the image processing module is configured to perform the pre-emphasis prior to performing the transformation.

### Claim 34 (depends on 21)

The video camera of claim 21, wherein said image processing module is further configured to denoise the mosaiced image data prior to said compressing.

### Claim 35 (depends on 34)

The video camera of claim 34, wherein the image processing module is configured to perform the denoise prior to the pre-emphasis and the transformation.

### Claim 36 (depends on 21)

The video camera of claim 21, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion video image data having a resolution of at least 2k.

### Claim 37 (depends on 36)

The video camera of claim 36, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion video image data having a resolution falling in a range of between 2k and 4.5k, inclusive.

### Claim 38 (depends on 36)

The video camera of claim 36, wherein the compressed mosaiced image data can be decompressed and demosaiced into substantially visually lossless motion video image data having a resolution that is 2k, 4k, or 4.5k.

### Claim 39 (depends on 21)

The video camera of claim 21, wherein the compressed mosaiced image data is stored on a memory device at a motion video frame rate of between 23.976 frames per second and 120 frames per second, inclusive.