# US 8,280,098 B2 · Digital watermarking CMOS sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,280,098 B2
- Document ID: US8280098B2
- Status: Granted
- Kind: B2
- Application number: 12/202,151
- Filed: 2008-08-29
- Published: 2009-06-04
- Granted: 2012-10-02
- Earliest claimed: 2005-05-19
- Assignees: UTI Limited Partnership
- Inventors: Orly Yadid-Pecht; Yonatan Shoshan; Alexander Fish
- Web page: https://patentgrep.com/patent/US8280098B2

## CPC

- G06T 1/0035: {Output size adaptive watermarking}
- H04N 1/32165: {using cosine transforms}
- H04N 1/32187: {with selective or adaptive application of the additional information, e.g. in selected frequency coefficients}
- H04N 23/60: Control of cameras or camera modules
- H04N 25/00: Circuitry of solid-state image sensors [SSIS]; Control thereof
- G06T 2200/28: involving image processing hardware
- G06T 2201/0051: Embedding of the watermark in the spatial domain
- G06T 2201/0052: Embedding of the watermark in the frequency domain
- G06T 2201/0053: Embedding of the watermark in the coding stream, possibly without decoding; Embedding of the watermark in the compressed domain
- G06T 2201/0061: Embedding of the watermark in each block of the image, e.g. segmented watermarking
- H10F 39/803: {Pixels having integrated switching, control, storage or amplification elements}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H10F: INORGANIC SEMICONDUCTOR DEVICES SENSITIVE TO INFRARED RADIATION, LIGHT, ELECTROMAGNETIC RADIATION OF SHORTER WAVELENGTH OR CORPUSCULAR RADIATION

## Abstract

The subject matter of this specification can be implemented in, among other things, an imaging system including an active pixel sensor imaging array configured to capture an image, said imaging array being in electronic communication with a watermark embedder.

## Claims

### Claim 1

An imaging system, comprising:
an active pixel sensor imaging array configured to capture an image, said imaging array being in electronic communication with a digitizer that digitizes an output of the imaging array;
a discrete cosine transform circuit in electronic communication with said imaging array that generates coefficients for a block of said digitized array output;
a quantizer circuit, in electronic communication with said discrete cosine transform circuit, that quantizes said coefficients;
a watermark generating circuit for generating a digital watermark;
a watermark embedder circuit, in electronic communication with said discrete cosine transform circuit and said watermark generating circuit that receives a transformed, quantized block of said digitized array output and said digital watermark and produces a watermarked image therefrom; and
an entropy encoder circuit, in electronic communication with said watermark embedder, that receives and encodes said watermarked image, and produces a watermarked image file.

### Claim 2 (depends on 1)

The imaging system of claim 1, wherein said active pixel sensor imaging array is a CMOS active pixel sensor array.

### Claim 3 (depends on 1)

The imaging system of claim 1, wherein said encoder circuit is a Huffman encoder circuit.

### Claim 4 (depends on 1)

The imaging system of claim 1, wherein said active pixel sensor imaging array comprises an n-well photodiode.

### Claim 5 (depends on 4)

The imaging system of claim 4, where said n-well photodiode has an octagonal layout.

### Claim 6 (depends on 1)

The imaging system of claim 1, wherein said digitizer comprises column parallel analog digital converters (ADCs), pixel parallel ADCs, or a single ADC for the active pixel sensor (APS) array.

### Claim 7 (depends on 6)

The imaging system of claim 6, wherein said digitizer comprises column parallel ADCs.

### Claim 8 (depends on 1)

The imaging system of claim 1, wherein said watermark generating circuit is a random number generator and said watermark data comprises a stream of pseudorandom bits.

### Claim 9 (depends on 8)

The imaging system of claim 8, wherein said random number generator is selected from the group consisting of: a linear-feedback shift register, a feedback with carries shift register, and a filtered feedback with carries shift register.

### Claim 10 (depends on 9)

The imaging system of claim 9, wherein said random number generator is adapted to produce said stream of pseudorandom bits from an initial state, and further comprises means for providing bit values from the ADC to generate the initial state of the random number generator.

### Claim 11 (depends on 8)

The imaging system of claim 8, wherein said watermark generating circuit generates a digital watermark dependent on a key.

### Claim 12 (depends on 11)

The imaging system of claim 11, wherein the key is a secret key.

### Claim 13 (depends on 11)

The imaging system of claim 11, wherein said watermark generating circuit generates a digital watermark dependent on the architecture of said random number generator and said key.

### Claim 14 (depends on 1)

The imaging system of claim 1, wherein said coefficients for the block of said digitized array output represent spatial frequencies in two dimensions.

### Claim 15 (depends on 14)

The imaging system of claim 14, wherein said quantizer circuit is configured to reduce the spatial frequencies to one dimension.

### Claim 16 (depends on 15)

The imaging system of claim 15, wherein said quantizer circuit is configured to organize said one-dimensional spatial frequencies in a “zigzag” order.

### Claim 17 (depends on 1)

The imaging system of claim 1, wherein said block of said digitized array output consists of eight rows by eight columns.

### Claim 18 (depends on 1)

The imaging system of claim 1, wherein said discrete cosine transform circuit, said quantizer circuit, said watermark generating circuit, said watermark embedder circuit and said entropy encoder comprise a JPEG encoder circuit.

### Claim 19 (depends on 1)

The imaging system of claim 1, wherein said imaging system is included in a digital video camera.

### Claim 20 (depends on 19)

The imaging system of claim 19, wherein said digital video camera utilizes a DCT based video compression standard.

### Claim 21 (depends on 20)

The imaging system of claim 20, wherein said digital watermark is embedded in an “I” frame of a group of pictures.

### Claim 22

A method for embedding a digital watermark, comprising:
receiving, at a discrete cosine transform circuit, a digitized output of an active pixel sensor array and generating coefficients for a block of said digitized output;
receiving said coefficients at a quantizer circuit that generates an output comprising transformed, quantized coefficients;
generating a watermark from a watermark generating circuit;
generating a watermarked image from a combination of said watermark and said transformed, quantized coefficients at a watermark embedder circuit; and
entropy encoding said watermarked image into a digitized file format.

### Claim 23 (depends on 22)

The method of claim 22, wherein said entropy encoding said watermarked image comprises encoding using a Huffman encoder.

### Claim 24 (depends on 22)

The method of claim 22, wherein said active pixel sensor array is a CMOS active pixel sensor array.

### Claim 25 (depends on 22)

The method of claim 22, wherein said file format is selected from the group consisting of: JPEG, MPEG-2, MPEG-4, H.261, H.262, H.263, and H.264.

### Claim 26

A method for providing an imaging system with built-in watermarking, comprising:
combining an image watermarking chip with a circuit board that is in electronic communication with an imaging sensor array;
wherein said image watermarking chip comprises:
a discrete cosine transform circuit that receives a digitized output of said sensor array and generates coefficients for a block of said digitized array output;
a quantizer circuit, in electronic communication with said discrete cosine transform circuit, that quantizes said coefficients;
a watermark generating circuit that generates a digital watermark;
a watermark embedder circuit that receives said coefficients for a block of said digitized array output and said digital watermark and produces a watermarked image therefrom; and
an encoder circuit, in electronic communication with said watermark embedder, that receives and encodes said watermarked image; and
wherein said image watermarking chip, said circuit board, and said imaging sensor array are configured and operable to cooperatively produce a digitally-watermarked image from an original, un-watermarked image captured by said imaging sensor array.

### Claim 27 (depends on 26)

The method of claim 26, wherein said encoder circuit comprises a Huffman encoder.

### Claim 28 (depends on 26)

The method of claim 26, wherein said imaging system is a digital camera, video recorder, scanner, or other imaging device.

### Claim 29 (depends on 26)

The method of claim 26, wherein said circuit board is operable to control imaging aspects of said imaging system.

### Claim 30

A digital watermarking chip, comprising:
a discrete cosine transform circuit that receives a digitized array output and generates coefficients for a block of said digitized array output;
a quantizer circuit, in electronic communication with said discrete cosine transform circuit, that receives said coefficients and generates quantized coefficients therefrom;
a watermark generating circuit that generates a digital watermark based on a key;
a watermark embedder circuit that receives said quantized coefficients and said digital watermark and produces a watermarked image therefrom; and
an entropy encoder circuit that receives said watermarked image and encodes said image thereby producing an image file.

### Claim 31 (depends on 30)

The digital watermarking chip of claim 30, wherein said entropy encoder circuit comprises a Huffman encoder.

### Claim 32 (depends on 30)

An imaging device comprising the digital watermarking chip of claim 30.

### Claim 33 (depends on 32)

The imaging device of claim 32 , wherein the imaging device is selected from the group consisting of camera, video recorder, and optical scanner.

### Claim 34 (depends on 1)

A method for authenticating an origin of a digital image, comprising:
receiving, at a computing device, an encrypted digital image with embedded digital watermark data provided by an imaging system according to claim 1; and
providing an authentication result as a display or a tangible output of said computing device as to whether or not said encrypted digital image originated from said imaging system, by:
(a) decrypting said encrypted digital image using a decryption algorithm; and
(b) determining whether or not said digital watermark data was embedded using said imaging system by deciphering said embedded digital watermark data in cooperation with a secret key used by said imaging system for embedding said digital watermark data;
wherein if said deciphering reveals that said digital watermark data was embedded using said secret key said digital image is authentic, and if said deciphering reveals that said digital watermark data was not embedded using said secret key, said digital image is not authentic.

### Claim 35 (depends on 34)

The method of claim 34, wherein said digital image is a compressed digital image, and step (a) further comprises decompressing said image.

### Claim 36

A watermark embedder circuit, comprising:
a memory buffer configured to receive quantized discrete cosine transform (DCT) image data;
a combination unit module configured to generate a calculated binary value;
wherein said calculated binary value is calculated by combining said quantized DCT image data with a watermark, and wherein said calculated binary value has an associated index corresponding to one or more blocks of said quantized DCT data, and wherein said combination unit module is in electronic communication with a watermark generator and said memory buffer;
a first register configured to store a first index value and a second index value, wherein said first index value is a highest numerical index value corresponding to a non-zero calculated binary value, and said second index value is less than said first index value, wherein said first register is in electronic communication with said combination unit module;
a second register configured to store a first modification value and a second modification value wherein said second register is in electronic communication with said first register and said combination unit module;
a third register configured to receive a copy of said first index value and said second index value; wherein said third register is in electronic communication with said first register;
a fourth register configured to receive a copy of said first modification value and said second modification value; wherein said fourth register is in electronic communication with said second register; and
a least significant bit module configured to modify a bit of said DCT image data.

### Claim 37 (depends on 1)

An imaging system comprising the imaging system of claim 1, wherein said watermark embedder circuit comprises:
a memory buffer configured to receive quantized discrete cosine transform (DCT) image data;
a combination unit module configured to generate a calculated binary value;
wherein said calculated binary value is calculated by combining said quantized DCT image data with a watermark, and wherein said calculated binary value has an associated index corresponding to one or more blocks of said quantized DCT data, and wherein said combination unit module is in electronic communication with a watermark generator and said memory buffer;
a first register configured to store a first index value and a second index value, wherein the first index value is the highest numerical index value corresponding to a non-zero calculated binary value, and the second index value is less than the first index value, wherein said first register is in electronic communication with said combination unit module;
a second register configured to store a first modification value and a second modification value wherein said second register is in electronic communication with said first register and said combination unit module;
a third register configured to receive a copy of said first index value and said second index value; wherein said third register is in electronic communication with said first register;
a fourth register configured to receive a copy of said first modification value and said second modification value; wherein said fourth register is in electronic communication with said second register; and
a least significant bit module configured to modify a bit of said DCT image data.

### Claim 38

A method for embedding a watermark in a second block of image data, comprising:
receiving a compression coefficient for said second block of image data;
storing said compression coefficient for said second block of image data in a memory buffer, wherein said memory buffer includes a compression coefficient for a first block of image data;
generating a watermark;
combining said watermark with said compression coefficient for said second block of image data with said compression coefficients for said previous block of said first block of image data; and
generating a calculated binary value, wherein said calculated binary value is used to determine modifications to said second block of image data.

### Claim 39 (depends on 38)

The method of claim 38, wherein said compression coefficients are DCT coefficients.

### Claim 40 (depends on 1)

A computer program product tangibly embodied in a computer-readable storage medium, the computer program product including instructions that, when executed, perform operations for authenticating an origin of a digital image, said operations comprising:
receiving, at a computing device, an encrypted digital image with embedded digital watermark data provided by an imaging system according to claim 1; and
providing an authentication result as a display or a tangible output of said computing device as to whether or not said encrypted digital image originated from said imaging system, by:
(a) decrypting said encrypted digital image using a decryption algorithm; and
(b) determining whether or not said digital watermark data was embedded using said imaging system by deciphering said embedded digital watermark data in cooperation with a secret key used by said imaging system for embedding said digital watermark data;
wherein if said deciphering reveals that said digital watermark data was embedded using said secret key said digital image is authentic, and if said deciphering reveals that said digital watermark data was not embedded using said secret key, said digital image is not authentic.
