# US 2009/0290750 A1 · Block-based watermarking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0290750 A1
- Document ID: US20090290750A1
- Status: Published application
- Kind: A1
- Application number: 11/720,970
- Filed: 2005-12-07
- Published: 2009-11-26
- Earliest claimed: 2004-12-09
- Assignees: Sony United Kingdom Limited
- Inventors: Daniel Warrer Tapson; Daniel Luke Hooper
- Web page: https://patentgrep.com/patent/US20090290750A1

## CPC

- H04N 21/23892: {involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level}
- G06T 1/005: {Robust watermarking, e.g. average attack or collusion attack resistant}
- G06T 2201/0051: Embedding of the watermark in the spatial domain
- G06T 2201/0061: Embedding of the watermark in each block of the image, e.g. segmented watermarking
- G06T 2201/0065: Extraction of an embedded watermark; Reliable detection
- G06T 2201/0083: whereby only watermarked image required at decoder, e.g. source-based, blind, oblivious
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A water marking system generates a water marked image frame for conveying a payload data word by combining at least one image frame with a two-dimensional water mark pattern. The water mark pattern includes plural regions each associated with one of symbols of the payload data word. Each region includes a two dimensional water mark block selected from a predetermined set of possible water mark blocks to represent the value of the payload data symbol associated with that region. A detecting data processing apparatus detects the payload data from a received water marked image frame, which has been encoded by utilizing a block match prior probability calculator operable to correlate each region of the water marked image frame with each of the water mark blocks from the set of water marked blocks) to form for each region a set of probability surfaces.

## Claims

### Claim 1

A detecting data processing apparatus for detecting payload data from a water marked image which has been generated by combining an image frame with a two-dimensional water mark pattern, the water mark pattern comprising a plurality of regions, each region of the pattern being associated with one of the symbols of the payload data word, each region of the water mark pattern including a two dimensional water mark block selected from a predetermined set of possible water mark blocks to represent the value of the payload data symbol associated with that region, the apparatus comprising
a block match prior probability calculator operable
to correlate each region of the water marked image frame with each of the water marked blocks from the set of water marked blocks, to form for each region a set of probability surfaces, each probability surface providing a two-dimensional distribution of probability vectors, for each possible water mark block, representing a probability that the water mark block is present at a position identified by that distortion vector, and
a payload probabilities calculator operable
to combine a distortion probability value for each region with each of the block match probability surfaces for each of the water mark blocks which may be present in the region, to form for each region, for each of the possible values of the payload symbol a probability value that region includes that symbol value, and
to form from the probability values for each symbol value from each of the regions of the water mark frame a set of payload probability values representing the probability of each of the possible symbol values for each payload symbol, from which an estimate of the payload data can be generated from the payload probability values.

### Claim 2 (depends on 1)

A detecting data processing apparatus as claimed in claim 1, wherein the payload probabilities calculator is operable
to combine the distortion probability value for each region of the water marked image frame with the block match probability surfaces for each region by correlating the distortion probabilities with the block match probability surfaces.

### Claim 3 (depends on 1)

A detecting data processing apparatus as claimed in claim 1, wherein the payload probabilities calculator is operable
to combine the distortion probability value for each region of the water marked image frame with the block match probability surfaces for each region by forming a dot product of the distortion probabilities with the block match probability.

### Claim 4 (depends on 1)

A detecting data processing apparatus as claimed in claim 1, wherein the payload data represented by the water mark pattern from which the water marked image is formed has been error correction encoded, the detecting apparatus comprising
a error correction decoder operable to receive the set of payload probability values and to perform a soft decision error correction decoding algorithm to generate an estimate of the payload data from the payload probability values.

### Claim 5 (depends on 1)

A detecting data processing apparatus as claimed in claim 1, wherein the water ark blocks within the frame pattern are scrambled before the water mark frame is combined with the image frame, the detecting data processing apparatus comprising
a de-scrambling processor operable
to receive the payload probability values and to change the order of the payload probability values in accordance with the scrambling of the order of the water mark blocks in the water mark frame pattern applied when the water marked image was formed.

### Claim 6 (depends on 1)

A detecting data processing apparatus as claimed in claim 1, comprising
a blind alignment decoder operable to receive the water marked image frame and to generate the spatial probability distortion vector values comprising for each of the regions of the water marked image frame at least one probability value that the distortion within that region of the water marked image is represented by a calculated distortion vector.

### Claim 7 (depends on 6)

A detecting data processing apparatus as claimed in claim 6, wherein the water mark pattern representing the payload data is a first water mark pattern and the water mark image frame is formed from a combination of the first water mark pattern and a second water mark pattern, the second water mark pattern a so being comprised of a plurality of regions each of which includes one of plurality of possible two-dimensional water mark blocks from a second set of water mark blocks, and the blind alignment decoder is operable
to generate the spatial probability distortion vectors by correlating each of the water mark blocks with each region of the second water mark pattern,
to form a spatial probability surface for each possible water mark block from the second set of water mark blocks, for each region comprising a two dimensional distribution of distortion vectors, and
to combine the spatial probability surfaces of each possible water mark block for each region with a probability of that water mark block being present within that region, to form the spatial probability distortion vector values for each region.

### Claim 8

An encoding data processor operable to form a water marked image by combining payload data with a copy of the image, the encoding data processor comprising
a water mark block generator operable to generate each of a set of two-dimensional blocks of water mark coefficients each being representative of one of a plurality of possible values of payload data word symbols,
a water mark frame pattern former operable
to form a water mark frame comprising a plurality of regions, each region being associated with one of the symbols in the payload data,
to select one of the water mark blocks from the set of water mark blocks in accordance with the symbol value of the payload symbol associated with the region to form a water mark frame pattern, and
to combine the water mark frame pattern with the copy of the image frame to form the water marked image frame.

### Claim 9 (depends on 8)

An encoding data processing apparatus as claimed in claim 8, wherein the first water mark block representing the payload data is a first water mark pattern, the encoding data processor comprising
a second water mark block generator operable to generate each of a second set of two-dimensional blocks of water mark coefficients each being representative of one of a plurality of possible values of a set of values,
a sequence generator operable to generate a sequence of block selection values, each selection value identifying one of the predetermined second set of water mark blocks, and
a second water mark frame pattern former operable to form the blocks identified by the key sequence into a second two-dimensional water mark pattern providing a plurality of regions, each of the blocks identified by the key sequence being provided for one of the regions of the pattern, wherein the water mark combiner is operable to combine the first and the second water mark patterns with the image frame to form the water marked image frame.

### Claim 10 (depends on 9)

An encoding data processor as claimed in claim 9, comprising
a scrambler operable to change the order of the water mark blocks in at least one of the first and second water mark patterns for the image frame in accordance with one or more scrambling codes, before the scrambled water mark patterns are combined with the image frame.

### Claim 11

A method of detecting payload data from a water marked image which has been encoded with a two-dimensional water mark pattern, the water mark pattern comprising a plurality of regions, each region of the pattern being associated with one of the symbols of the payload data word, each region of the water mark pattern including a two dimensional water mark block selected from a predetermined set of possible water mark blocks to represent the value of the payload data symbol associated with that region, the method comprising
correlating each region of the water marked image frame with each of the water marked blocks from the set of water marked blocks, to form for each region a set of probability surfaces, each probability surface providing a two-dimensional distribution of probability vectors, for each possible water mark block, representing a probability that the water mark block is present at a position identified by that distortion vector,
combining a distortion probability value for each region with each of the block match probability surfaces for each of the water mark blocks which may be present in the region, to form for each region, for each of the possible values of the payload symbol a probability value that that region includes that symbol value,
forming from the probability values for each symbol value from each of the regions of the water mark frame a set of payload probability values representing the probability of each of the possible symbol values for each payload symbol, for which an estimate of the payload data can be generated.

### Claim 12

A method of forming a water marked image by combining payload data with a copy of the image, the method comprising
generating each of a set of two-dimensional blocks of water mark coefficients, each water mark block being representative of one of a plurality of possible values of payload data word symbols,
forming a water mark frame comprising a plurality of regions, each region being associated with one of the symbols in the payload data,
selecting one of the water mark blocks from the set of water mark blocks in accordance with the symbol value of the payload symbol associated with the region to form a water mark frame pattern, and
combining the water mark frame pattern with the copy of the image frame to form the water marked image frame.

### Claim 13 (depends on 12)

A method of forming as claimed in claim 12, wherein the water mark pattern representing the payload data is a first water mark pattern, the method of encoding comprising
generating a second set of two-dimensional blocks of water mark coefficients each being representative of one of a plurality of possible values of a set of values,
generating a sequence of block selection values, each selection value identifying one of the predetermined second set of water mark blocks, and
forming the blocks identified by the key sequence into a second two-dimensional water mark pattern providing a plurality of regions, each of the blocks identified by the key sequence being provided for one of the regions of the pattern, and
combining the first and the second water mark patterns with the image frame to form the water marked image frame.

### Claim 14

A data detection processor operable to marginalise over a first probability surface representing a two dimensional probability distribution of the distortion of a water mark region in order to determine a probability of the presence of a value represented by the water mark block, by forming the dot product of the first probability distortion surface with a second probability value representing the presence of the value.

### Claim 15 (depends on 11)

A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 11.

### Claim 16 (depends on 15)

A computer program product having a computer readable medium having recorded thereon information signals representative of the computer program claimed in claim 15.

### Claim 17 (depends on 15)

A carrying medium representing the computer program as claimed in claim 15.

### Claim 18

An apparatus for detecting payload data from a water marked image which has been encoded with a two-dimensional water mark pattern, the water mark pattern comprising a plurality of regions, each region of the pattern being associated with one of the symbols of the payload data word, each region of the water mark pattern including a two dimensional water mark block selected from a predetermined set of possible water mark blocks to represent the value of the payload data symbol associated with that region, the apparatus comprising
means for correlating each region of the water marked image frame with each of the water marked blocks from the set of water marked blocks, to form for each region a set of probability surfaces, each probability surface providing a two-dimensional distribution of probability vectors, for each possible water mark block, representing a probability that the water mark block is present at a position identified by that distortion vector,
means or combining a distortion probability value for each region with each of the block match probability surfaces for each of the water mark blocks which may be present in the region, to form for each region, for each of the possible values of the payload symbol a probability value that that region includes that symbol value,
means for forming from the probability values for each symbol value from each of the regions of the water mark frame a set of payload probability values representing the probability of each of the possible symbol values for each payload symbol, from which an estimate of the payload data can be generated.

### Claim 19

An apparatus for forming a water marked image by combining payload data with a copy of the image, the apparatus comprising
means for generating each of a set of two-dimensional blocks of water mark coefficients, each water mark block being representative of one of a plurality of possible values of payload data word symbols,
means for forming a water mark frame comprising a plurality of regions, each region being associated with one of the symbols in the payload data,
means for selecting one of the water mark blocks from the set of water mark blocks in accordance with the symbol value of the payload symbol associated with the region to form a water mark frame pattern, and
means for combining the water mark frame pattern with the copy of the image frame to form the water marked image frame.

### Claim at position 20

20-21. (canceled)

### Claim 22 (depends on 12)

A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 12.

### Claim 23 (depends on 22)

A computer program product having a computer readable medium having recorded thereon information signals representative of the computer program claimed in claim 22.

### Claim 24 (depends on 22)

A carrying medium representing the computer program as claimed in claim 22.

### Claim 25 (depends on 13)

A computer program providing computer executable instructions, which when loaded on to a data processor causes the data processor to perform the method according to claim 13.

### Claim 26 (depends on 25)

A computer program product having a computer readable medium having recorded thereon information signals representative of the computer program claimed in claim 25.

### Claim 27 (depends on 25)

A carrying medium representing the computer program as claimed in claim 25.
