# US 2003/0227442 A1 · Optical state modulation apparatus, display system and optical state modulation method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2003/0227442 A1
- Document ID: US20030227442A1
- Status: Published application
- Kind: A1
- Application number: 10/458,158
- Filed: 2003-06-09
- Published: 2003-12-11
- Earliest claimed: 2002-06-11
- Assignees: Sony Corporation
- Inventors: Tomohiro Nishi; Michihiro Ohnishi
- Web page: https://patentgrep.com/patent/US20030227442A1

## CPC

- H04N 5/913: for scrambling {; for copy protection}
- H04N 2005/91392: {using means for preventing making copies of projected video images}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An optical state modulation unit is provided to apply an optical intensity modulation in temporal domain on a display image generated from an inputted image signal for different gray scale values such that the optical intensity modulation performed at least one of the gray scale values of the display image falls into a region at which the flicker is perceptible to human vision when a recorded image obtained by image-capturing the display image is viewed, while remaining imperceptible when the display image is directly viewed. The optical state modulation unit provides the optical intensity modulation such that the average optical intensity of the display image based on the image signal with the optical intensity modulation is the same as that of the display image generated from the image signal without the optical intensity modulation at each gray scale value.

## Claims

### Claim 1

An optical state modulation apparatus, comprising:
optical state modulation means for applying an optical intensity modulation in temporal domain on a display image generated from a inputted image signal on single gray scale value basis in such away that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed;
wherein said optical state modulation means provides the optical intensity modulation in such a way that, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation.

### Claim 2 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said optical state modulation means provides the optical intensity modulation in such a way that the image signal resulting from the optical intensity modulation is an image signal of a value equal to or less than a maximum value of an image signal acceptable to a display apparatus being used.

### Claim 3 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said optical state modulation means comprises:
memory means for storing an image signal;
reading-out means for reading out an image signal for a single frame from said memory means; and
modulation means for applying an optical intensity modulation in temporal domain on a display image generated from the image signal readout for the single frame on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed;
wherein said modulation means provides the optical intensity modulation in such a way that, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation.

### Claim 4 (depends on 3)

The optical state modulation apparatus according to claim 3, wherein said modulation means splits an image signal for a single frame read out by said reading-out means into a plurality of fields in the temporal domain, and modulates an optical intensity of each split field in the temporal domain.

### Claim 5 (depends on 3)

The optical state modulation apparatus according to claim 3, further comprising:
output means for outputting an image signal on which the optical intensity modulation is applied by said modulation means;
wherein said modulation means generates a plurality of identical frames based on an image signal for a single frame read out by said reading-out means, and modulates the optical intensity of each generated frame in the temporal domain, and
said output means outputs said plurality of identical frames, of which optical intensities are modulated, during a display period for the single frame.

### Claim 6 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said optical state modulation means provides the optical intensity modulation at a part or all of said gray scale values.

### Claim 7 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said optical state modulation means provides the optical intensity modulation on said image signal at different spatial positions.

### Claim 8 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said image signal is a luminance signal, and said optical state modulation means provides the optical intensity modulation on the display image generated from said luminance signal.

### Claim 9 (depends on 1)

The optical state modulation apparatus according to claim 1, wherein said optical state modulation means provides the optical intensity modulation on at least one color of primary colors of a color display image generated from the image signal.

### Claim 10 (depends on 3)

The optical state modulation apparatus according to claim 3, wherein said optical state modulation means provides the optical intensity modulation according to the following function F(f,t);
F(f,t)=A+αA×cos(2πft) ((Amax−A)>αA) F(f,t)=A+(Amax−A)×cos(2πft) ((Amax−A)≦αA)
where A is the optical intensity of a display image generated from an image signal for a single frame without the optical intensity modulation, Amax is a maximum optical intensity of a display image generated from a maximum value of an image signal acceptable to a display apparatus being used, f is a frequency for the optical intensity modulation, α(0≦α≦1) is a contrast, and t is a time.

### Claim 11

A display system, comprising:
an optical state modulation apparatus for applying an optical intensity modulation in temporal domain on a display image generated from a inputted image signal on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed; and
a display apparatus for converting an output signal of said optical state modulation apparatus into a predetermined display signal, and displaying said display signal;
wherein said optical state modulation apparatus provides the optical intensity modulation in such a way that, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation, and within a maximum optical intensity output range of said display apparatus.

### Claim 12 (depends on 11)

The display system according to claim 11, wherein said optical state modulation apparatus comprises:
memory means for storing an image signal;
reading-out means for reading out an image signal for a single frame from said memory means; and
modulation means for applying an optical intensity modulation in temporal domain on a display image generated from the image signal readout for the single frame on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed;
wherein said modulation means provides the optical intensity modulation in such a way that, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation.

### Claim 13 (depends on 11)

The display system according to claim 11, wherein said modulation means splits an image signal for a single frame read out by said reading-out means into a plurality of fields in the temporal domain, and modulates an optical intensity of each split field in the temporal domain.

### Claim 14 (depends on 11)

The display system according to claim 11, further comprising:
output means for outputting an image signal on which the optical intensity modulation is applied by said modulation means;
wherein said modulation means generates a plurality of identical frames based on an image signal for a single frame read out by said reading-out means, and modulates the optical intensity of each generated frame in the temporal domain, and
said output means outputs said plurality of identical frames, of which optical intensities are modulated, during a display period for the single frame.

### Claim 15 (depends on 11)

The display system according to claim 11, wherein said optical state modulation apparatus provides the optical intensity modulation at a part or all of said gray scale values.

### Claim 16 (depends on 11)

The display system according to claim 11, wherein said image signal is a luminance signal, and said optical state modulation apparatus provides the optical intensity modulation on the display image generated from said luminance signal.

### Claim 17 (depends on 11)

The display system according to claim 11, wherein said optical state modulation apparatus provides the optical intensity modulation on at least one color of primary colors of a color display image generated from the image signal.

### Claim 18 (depends on 11)

The display system according to claim 11, wherein said optical state modulation apparatus provides the optical intensity modulation on said image signal at different spatial positions.

### Claim 19 (depends on 11)

The display system according to claim 11, wherein said display apparatus utilizes a raster scan system to display the image signal resulting from the optical intensity modulation performed by said optical state modulation apparatus.

### Claim 20 (depends on 11)

The display system according to claim 11, wherein said display apparatus utilizes a X-Y dot matrix system to display the image signal resulting from the optical intensity modulation performed by said optical state modulation apparatus.

### Claim 21 (depends on 11)

The display system according to claim 11, wherein said display apparatus is of a projection system or a direct view system.

### Claim 22 (depends on 11)

The display system according to claim 11, wherein said optical state modulation means provides the optical intensity modulation according to the following function F(f,t);
F(f,t)=A+αA×cos(2πft) ((Amax−A)>αA) F(f,t)=A+(Amax−A)×cos(2πft) ((Amax−A)≦αA)
where A is the optical intensity of a display image generated from an image signal for a single frame without the optical intensity modulation, Amax is a maximum optical intensity of a display image generated from a maximum value of an image signal acceptable to a display apparatus being used, f is a frequency for the optical intensity modulation, α(0≦α≦1) is a contrast, and t is a time.

### Claim 23

An optical intensity modulation apparatus, comprising;
first optical state modulation means for applying a lighter-modulation in temporal domain on an optical intensity of a display image generated from a first image signal inputted on single gray scale value basis;
conversion output means for converting a second image signal, on which said first optical state modulation means applies the lighter-modulation on the optical intensity of said display image, into a predetermined third display signal and outputting said third display signal;
second optical state modulation means for applying a darker-modulation in temporal domain on an optical intensity of a display image generated from said third display signal resulting from the conversion performed by said conversion output means on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed;
detection means for detecting image information in said first image signal; and
control means for controlling said first optical state modulation means and said second optical state modulation means according to a modulation condition determined based on said image information;
wherein said control means provides a control in such a way that, at each gray scale value, an average optical intensity of a display image generated from a fourth display signal generated from said second optical state modulation means is the same as the optical intensity of a display image generated from said first image signal inputted into said first optical state modulation means.

### Claim 24 (depends on 23)

The optical state modulation apparatus according to claim 23,
wherein said first optical state modulation means includes a memory means for storing a plurality of lighter-modulation patterns used for applying the lighter-modulation on the optical intensity of the display image generated from the first image signal inputted, and
the lighter-modulation pattern to be used for applying the lighter-modulation on the optical intensity of the display image generated from said first image signal inputted is determined in accordance with the modulation condition determined by said control means.

### Claim 25 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said second optical state modulation means provides the optical intensity modulation at different spatial positions in the display image generated from said third display signal.

### Claim 26 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said first optical state modulation means and said second optical state modulation means provide the optical state modulation at a part or all of the gray scale values.

### Claim 27 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said first image signal is a luminance signal, and said first optical state modulation means and said second optical state modulation means provide the optical intensity modulation on the display image generated from said luminance signal.

### Claim 28 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said first optical state modulation means and said second optical state modulation means provide the optical intensity modulation on at least one color of primary colors of a color display image generated from said first image signal.

### Claim 29 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said conversion output means converts said second image signal into a display signal of raster scan system and outputs the display signal of raster scan system.

### Claim 30 (depends on 23)

The optical state modulation apparatus according to claim 23, wherein said conversion output means converts said second image signal into a display signal of X-Y dot matrix system and outputs the display signal of X-Y dot matrix system.

### Claim 31

A display system, comprising:
an optical state modulation apparatus including;
first optical state modulation means for applying a lighter-modulation in temporal domain on an optical intensity of a display image generated from a first image signal inputted on single gray scale value basis;
conversion output means for converting a second image signal, on which said first optical state modulation means applies the lighter-modulation on the optical intensity of said display image, into a predetermined third display signal and outputting said third display signal;
second optical state modulation means for applying a darker-modulation in temporal domain on an optical intensity of a display image generated from said third display signal resulting from the conversion performed by said conversion output means on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed;
detection means for detecting image information in said first image signal; and
control means for controlling said first optical state modulation means and said second optical state modulation means according to a modulation condition determined based on said image information; and
a display apparatus for displaying a fourth display signal outputted from said second optical state modulation means in the optical intensity modulation performed at each gray scale value in said optical state modulation apparatus;
wherein said optical state modulation apparatus provides a control in such a way that an average optical intensity of a display image generated from said fourth display signal is the same as the optical intensity of a display image generated from said first image signal inputted into said first optical state modulation means.

### Claim 32 (depends on 31)

The display system according to claim 31,
wherein said first optical state modulation means includes a memory means for storing a plurality of lighter-modulation patterns used for applying the lighter-modulation on the optical intensity of the display image generated from the first image signal inputted, and
the lighter-modulation pattern to be used for applying the lighter-modulation on the optical intensity of the display image generated from said first image signal inputted is determined in accordance with the modulation condition determined by said control means.

### Claim 33 (depends on 31)

The display system according to claim 31, wherein said second optical state modulation means provides the optical intensity modulation at different spatial positions in the display image generated from said third display signal.

### Claim 34 (depends on 31)

The display system according to claim 31, wherein said first optical state modulation means and said second optical state modulation means provide the optical state modulation at a part or all of the gray scale values.

### Claim 35 (depends on 31)

The display system according to claim 31, wherein said first image signal is a luminance signal, and said first optical state modulation means and said second optical state modulation means provide the optical intensity modulation on the display image generated from said luminance signal.

### Claim 36 (depends on 31)

The display system according to claim 31, wherein said first optical state modulation means and said second optical state modulation means provide the optical intensity modulation on at least one color of primary colors of a color display image generated from said first image signal.

### Claim 37 (depends on 31)

The display system according to claim 31, wherein said conversion output means converts said second image signal into a display signal of raster scan system and outputs said display signal of raster scan system.

### Claim 38 (depends on 31)

The display system according to claim 31, wherein said conversion output means converts said second image signal into a display signal of X-Y dot matrix system and outputs said display signal of the X-Y dot matrix system.

### Claim 39

An optical state modulation method, comprising:
applying an optical intensity modulation in temporal domain on a display image generated from a inputted image signal on single gray scale value basis;
wherein the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed, and
wherein, at each gray scale value, an average optical intensity of the display signal resulting from the optical intensity modulation performed is the same as the optical intensity of a display image generated from the image signal without the optical intensity modulation.

### Claim 40 (depends on 37)

The optical state modulation method according to claim 37, comprising:
storing said image signal;
reading out an image signal for a single frame from the image signals stored; and
applying an optical intensity modulation in temporal domain on a display image generated from the image signal readout for the single frame on single gray scale value basis;
wherein the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed; and
wherein, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation.

### Claim 41

An optical state modulation method, comprising;
applying an optical intensity modulation in temporal domain on a display image generated from a inputted image signal on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed, and that, at each gray scale value, an average optical intensity of the display signal resulting from the optical intensity modulation performed is the same as the optical intensity of a display image generated from the image signal without the optical intensity modulation;
converting an image signal that is optical intensity modulated into a display signal; and
displaying said display signal on a display unit.

### Claim 42 (depends on 41)

The optical state modulation method according to claim 41, comprising:
storing said image signal;
reading out an image signal for a single frame from the image signals stored; and
applying an optical intensity modulation in temporal domain on a display image generated from the image signal readout for the single frame on single gray scale value basis;
wherein the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which a flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed; and
wherein, at each gray scale value, an average optical intensity of a display image generated from an image signal resulting from the optical intensity modulation performed is the same as an optical intensity of a display image generated from an image signal without the optical intensity modulation.

### Claim 43

An optical state modulation method, comprising:
detecting image information from a first image signal inputted;
generating a second image signal by applying a lighter-modulation in temporal domain on an optical intensity of a display image generated from said first image signal on single gray scale value basis in accordance with a modulation condition determined based on said image information;
converting said second image signal into a predetermined third display signal; and
applying, according to said modulation condition determined based on said image information, a darker-modulation in temporal domain on an optical intensity of a display image generated from said third display signal on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision system when said display image is directly viewed.

### Claim 44

An optical state modulation method, comprising:
detecting image information in a first image signal inputted;
generating a second image signal by applying, in accordance with a modulation condition determined based on said image information, a lighter-modulation in temporal domain on an optical intensity of a display image generated from said first image signal on single gray scale value basis;
converting said second image signal into a predetermined third display signal;
generating a fourth display signal by applying a darker-modulation in temporal domain on an optical intensity of a display image generated from said third display signal on single gray scale value basis in such a way that the optical intensity modulation performed at least one of gray scale values of the display image falls into a region at which the flicker is perceptible to a human vision system when a recorded image obtained by image-capturing said display image is viewed, while remaining imperceptible to the human vision when said display image is directly viewed; and
displaying said fourth display signal on a display unit.
