# US 2001/0024311 A1 · Demodulation and phase estimation of two-dimensional patterns

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0024311 A1
- Document ID: US20010024311A1
- Status: Published application
- Kind: A1
- Application number: 09/754,310
- Filed: 2001-01-05
- Published: 2001-09-27
- Earliest claimed: 2000-01-06
- Assignees: Canon Kabushiki Kaisha
- Inventors: Kieran Gerard Larkin; Michael Alexander Oldfield; Donald James Bone
- Web page: https://patentgrep.com/patent/US20010024311A1

## CPC

- G06V 40/1347: {Preprocessing; Feature extraction}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 2207/20056: Discrete and fast Fourier transform, [DFT, FFT]
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method (400) of estimating an orientation angle (β0) of a pattern in an image (405) is described. A complex energy operator is applied to the image (405). The complex energy operator is defined as Ψc{ƒ}=(D{ƒ})2−ƒD2{ƒ}. A phase component of the result, which is defined as 2β0=arg(Ψc{ƒ}) is determined, from which the orientation angle (β0) is calculated. A method (100,200) of demodulating a real two-dimensional pattern is also described. A two-dimensional spiral phase filter is applied to the pattern. The result is combined with the original pattern to provide a demodulated image. Furthermore, a method (600) of estimating a spatial phase of fringe pattern images in a sequence of fringe patterns is disclosed. The fringe pattern images are converted to pure AMFM patterns by removing offsets from each. Contingent analytic images are determined corresponding to each of said AMFM patterns, from which phase differences and phase shifts are determined from dependent pairs. This allows for a spatial phase of the fringe pattern images to be estimated.

## Claims

### Claim 1

A method of demodulating a real two-dimensional pattern, the method comprising the steps of:
estimating a quadrature two-dimensional pattern from said real two-dimensional pattern using a two-dimensional spiral phase filter; and
creating a demodulated image by combining said real two-dimensional pattern and said estimated quadrature two-dimensional pattern.

### Claim 2 (depends on 1)

A method as claimed in claim 1, wherein said estimating step includes the steps of:
generating a frequency domain signal from said real two-dimensional pattern using a linear transform;
applying said two-dimensional spiral phase filter to at least part of said frequency domain signal to provide a filter signal;
generating a spatial domain pattern from said filtered signal using an inverse of said linear transform; and
extracting from the spatial domain pattern an estimate of said quadrature two-dimensional pattern.

### Claim 3 (depends on 1)

A method as claimed in claim 1, wherein said estimating step includes the steps of:
convolving said real two-dimensional pattern with a complex function to provide a convolved spatial domain pattern, said complex function being an inverse Fourier transform of said two-dimensional spiral phase filter; and
extracting from the spatial domain pattern an estimate of said imaginary two-dimensional pattern.

### Claim 4 (depends on 2)

A method as claimed in claim 2, wherein the extracting step further includes determining an approximate orientation angle of at least one fringe pattern in said spatial domain pattern.

### Claim 5 (depends on 4)

A method as claimed in claims 4 wherein determining said approximate orientation angle of at least one fringe pattern in said spatial domain pattern step comprises the steps of:
applying a complex energy operator to the image to provide an energy encoded image;
determining a phase component of said energy encoded image; and
calculating said orientation angle from said phase component of said energy encoded image.

### Claim 6 (depends on 5)

A method as claimed in claim 5 wherein said complex energy operator is defined as:
Ψc{ƒ}=(D{ƒ})2−ƒD2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(Ψc{ƒ})

### Claim 7 (depends on 5)

A method as claimed in claim 5 wherein said complex energy operator is a modified complex energy operator defined as:
ΨM{ƒ}=(DM{ƒ})2ƒDM2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(ΨM{ƒ})

### Claim 8 (depends on 5)

A method as claimed in claim 5 wherein said image is pre-processed to remove background offsets.

### Claim 9

Apparatus for demodulating a real two-dimensional pattern, the apparatus comprising:
means for estimating a quadrature two-dimensional pattern from said real two-dimensional pattern using a two-dimensional spiral phase filter; and
means for creating a demodulated image by combining said real two-dimensional pattern and said estimated quadrature two-dimensional pattern.

### Claim 10 (depends on 9)

Apparatus as claimed in claim 9, wherein said means for estimating an imaginary two-dimensional pattern includes:
means for generating a frequency domain signal from said real two-dimensional pattern using a linear transform;
means for applying said two-dimensional spiral phase filter to at least part of said frequency domain signal to provide a filter signal;
means for generating a spatial domain pattern from said filtered signal using an inverse of said linear transform; and
means for extracting from the spatial domain pattern an estimate of said quadrature two-dimensional pattern.

### Claim 11 (depends on 9)

Apparatus as claimed in claim 9, wherein said means for estimating an imaginary two-dimensional pattern includes:
means for convolving said real two-dimensional pattern with a complex function to provide a convolved spatial domain pattern, said complex function being an inverse Fourier transform of said two-dimensional spiral phase filter; and
means for extracting from the spatial domain pattern an estimate of said imaginary two-dimensional pattern.

### Claim 12 (depends on 10, 11)

Apparatus as claimed in claim 10 or 11, wherein the extracting means further includes means for determining an approximate orientation angle of at least one fringe pattern in said spatial domain pattern.

### Claim 13 (depends on 12)

Apparatus as claimed in claims 12 wherein said means for determining said approximate orientation angle of at least one fringe pattern in said spatial domain pattern comprises:
means for applying a complex energy operator to the image to provide an energy encoded image;
means for determining a phase component of said energy encoded image; and
means for calculating said orientation angle from said phase component of said energy encoded image.

### Claim 14

Apparatus for calculating a quadrature conjugate of a real two-dimensional code pattern, the apparatus comprising:
a first spatial light modulator for modulating coherent light to produce said real two-dimensional pattern;
a first lens for Fourier transformation of said real two-dimensional pattern to produce a first Fourier transformed image;
a second spatial light modulator or spiral phase plate for phase modulating said first Fourier transformed image to produce a phase modulated image;
a second lens for Fourier transformation of said phase modulated image to produce a second Fourier transformed image;
a third spatial light modulator or spiral phase plate for phase modulating said second Fourier transformed image to produce said conjugate of said real two-dimensional pattern; and
an image sensor for capturing said conjugate of said real two-dimensional pattern.

### Claim 15

A method of estimating an orientation angle of a pattern in an image, said method comprising the steps of:
applying a complex energy operator to the image to provide an energy encoded image;
determining a phase component of said energy encoded image; and
calculating said orientation angle from said phase component of said energy encoded image.

### Claim 16 (depends on 15)

A method as claimed in claim 15 wherein said complex energy operator is defined as:
Ψc{ƒ}=(D{ƒ})2−ƒD2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(Ψc{ƒ})

### Claim 17 (depends on 15)

A method as claimed in claim 15 wherein said complex energy operator is a modified complex energy operator defined as:
ΨM{ƒ}=(DM{ƒ})2−ƒDM2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(ΨM{ƒ})

### Claim 18 (depends on 15)

A method as claimed in claim 15 wherein said image is pre-processed to remove background offsets.

### Claim 19

Apparatus for estimating an orientation angle of a pattern in an image, said apparatus comprises:
means for applying a complex energy operator to the image to provide an energy encoded image;
means for determining a phase component of said energy encoded image; and
means for calculating said orientation angle from said phase component of said energy encoded image.

### Claim 20 (depends on 19)

Apparatus as claimed in claim 19 wherein said complex energy operator is defined as:
Ψc{ƒ}=(D{ƒ})2−ƒD2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(Ψc{ƒ})

### Claim 21 (depends on 19)

Apparatus as claimed in claim 19 wherein said complex energy operator is a modified complex energy operator defined as:
ΨM{ƒ}=(DM{ƒ})2−ƒDM2{ƒ}
and said phase component of said energy encoded image is defined as:
2β0=arg(ΨM{ƒ})

### Claim 22 (depends on 19)

Apparatus as claimed in claim 19, said apparatus further comprising a means for pre-processing said image to remove background offsets.

### Claim 23

A method of estimating relative phase shifts between fringe pattern images in a sequence of phase-related fringe patterns, said method comprising the steps of:
a) removing offsets from each of said fringe pattern images to obtain pure AMFM patterns;
b) determining contingent analytic images corresponding to each of said AMFM patterns;
c) determining phase differences from dependent pairs of said contingent analytic images; and
d) estimating phase shifts between pairs of said contingent analytic images, wherein said phase shifts between pairs of said contingent analytic images are said relative phase shifts between fringe pattern images.

### Claim 24 (depends on 23)

A method as claimed in claim 23 wherein said removing step is performed by calculating interframe difference images between pairs of said fringe pattern images.

### Claim 25 (depends on 23)

A method as claimed in claim 23 wherein said contingent analytic images comprise complex images with said AMFM patterns as imaginary parts and imaginary parts of a vortex operator applied to said AMFM patterns in said real parts

### Claim 26 (depends on 23)

A method as claimed in claim 23 further comprising the steps of:
e) estimating a spatial phase of said fringe pattern images;
f) estimating an amplitude modulation and said offset of said fringe pattern images;
g) determining an accuracy measure of said contingent analytic images from said estimated amplitude modulation, offset and spatial phase;
h) determining a weighting function wherein areas of low accuracy measure are given a low weighting; and
i) iteratively repeating steps d) to h) by applying said weighting function in step d), until said accuracy measure is above a predetermined quantity.

### Claim 27 (depends on 26)

A method as claimed in claim 26 wherein said accuracy measure determination step is performed by comparing one of said analytic images with a reconstructed fringe pattern, wherein said reconstructed fringe pattern is reconstructed using said estimated amplitude modulation, offset and spatial phase.

### Claim 28

A method of estimating a spatial phase of fringe pattern images in a sequence of fringe patterns, said method comprising the steps of:
a) removing offsets from each of said fringe pattern images to obtain pure AMFM patterns;
b) determining contingent analytic images corresponding to each of said AMFM patterns;
c) determining phase differences from dependent pairs of said contingent analytic images;
d) estimating phase shifts between pairs of said contingent analytic images; and
e) estimating a spatial phase of said fringe pattern images.

### Claim 29 (depends on 28)

A method as claimed in claim 28 wherein said removing step is performed by calculating interframe difference images between pairs of said fringe pattern images.

### Claim 30 (depends on 28)

A method as claimed in claim 28 wherein said contingent analytic images comprise complex images with said AMFM patterns as imaginary parts and imaginary parts of a vortex operator applied to said AMFM patterns in said real parts.

### Claim 31 (depends on 28)

A method as claimed in claim 28 further comprising the steps of:
f) estimating an amplitude modulation and said offset of said fringe pattern images;
g) determining an accuracy measure of said contingent analytic images from said estimated amplitude modulation, offset and spatial phase;
h) determining a weighting function wherein areas of low accuracy measure are given a low weighting; and
i) iteratively repeating steps d) to h) by applying said weighting function in step d), until said accuracy measure is above a predetermined quantity.

### Claim 32 (depends on 31)

A method as claimed in claim 31 wherein said accuracy measure determination step is performed by comparing one of said analytic images with a reconstructed fringe pattern, wherein said reconstructed fringe pattern is reconstructed using said estimated amplitude modulation, offset and spatial phase.

### Claim 33 (depends on 23)

A method as claimed in claim 23 wherein an intensity of said fringe pattern images are in the form:
ƒn(x,y)=a(x,y)+b(x,y)cos[χ(x,y)+δn]
wherein a(x,y) is said offset, b(x,y) is said amplitude modulation χ(x,y) is said spatial phase and δn is a phase shift parameter.

### Claim 34

Apparatus for estimating relative phase shifts between fringe pattern images in a sequence of phase-related fringe patterns, said apparatus comprising:
means for removing offsets from each of said fringe pattern images to obtain pure AMFM patterns;
means for determining contingent analytic images corresponding to each of said AMFM patterns;
means for determining phase differences from dependent pairs of said contingent analytic images; and
means for estimating phase shifts between pairs of said contingent analytic images, wherein said phase shifts between pairs of said contingent analytic images are said relative phase shifts between fringe pattern images.

### Claim 35 (depends on 34)

Apparatus as claimed in claim 34 wherein said means for removing offsets comprises means for calculating interframe difference images between pairs of said fringe pattern images.

### Claim 36 (depends on 34)

Apparatus as claimed in claim 34 wherein said contingent analytic images comprise complex images with said AMFM patterns as imaginary parts and imaginary parts of a vortex operator applied to said AMFM patterns in said real parts.

### Claim 37 (depends on 34)

Apparatus as claimed in claim 34 further comprising:
means for estimating a spatial phase of said fringe pattern images;
means for estimating an amplitude modulation and an offset of said fringe pattern images;
means for determining an accuracy measure of said contingent analytic images from said estimated amplitude modulation, offset and spatial phase;
means for determining a weighting function wherein areas of low accuracy measure are given a low weighting; and
iterative means for providing said weighting function to said means for estimating phase shifts, until said accuracy measure is above a predetermined quantity.

### Claim 38 (depends on 37)

Apparatus as claimed in claim 37 wherein said means for determining an accuracy measure comprises a comparator for comparing one of said analytic images with a reconstructed fringe pattern, wherein said reconstructed fringe pattern is reconstructed using said estimated amplitude modulation, offset and spatial phase.

### Claim 39

Apparatus for estimating a spatial phase of fringe pattern images in a sequence of fringe patterns, said apparatus comprising:
means for removing offsets from each of said fringe pattern images to obtain pure AMFM patterns;
means for determining contingent analytic images corresponding to each of said AMFM patterns;
means for determining phase differences from dependent pairs of said contingent analytic images;
means for estimating phase shifts between pairs of said contingent analytic images; and
means for estimating a spatial phase of said fringe pattern images.

### Claim 40 (depends on 39)

Apparatus as claimed in claim 39 wherein said means for removing offsets comprises means for calculating interframe difference images between pairs of said fringe pattern images.

### Claim 41 (depends on 39)

Apparatus as claimed in claim 39 wherein said contingent analytic images comprise complex images with said AMFM patterns as imaginary parts and imaginary parts of a vortex operator applied to said AMFM patterns in said real parts.

### Claim 42 (depends on 39)

Apparatus as claimed in claim 39 further comprising:
means for estimating an amplitude modulation and an offset of said fringe pattern images;
means for determining an accuracy measure of said contingent analytic images from said estimated amplitude modulation, offset and spatial phase;
means for determining a weighting function wherein areas of low accuracy measure are given a low weighting; and
iterative means for providing said weighting function to said means for estimating phase shifts, until said accuracy measure is above a predetermined quantity.

### Claim 43 (depends on 42)

Apparatus as claimed in claim 42 wherein said means for determining an accuracy measure comprises a comparator for comparing one of said analytic images with a reconstructed fringe pattern, wherein said reconstructed fringe pattern is reconstructed using said estimated amplitude modulation, offset and spatial phase.

### Claim 44 (depends on 34)

Apparatus as claimed in claim 34 wherein said fringe pattern images are in the form:
ƒn(x,y)=a(x,y)+b(x,y)cos[χ(x,y)+δn]
wherein a(x,y) is said offset, b(x,y) is said amplitude modulation χ(x,y) is said spatial phase and δn is a phase shift parameter.
