# US 2019/0246095 A1 · Image creation device, method for image creation, image creation program, method for designing eyeglass lens and method for manufacturing eyeglass lens

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246095 A1
- Document ID: US20190246095A1
- Status: Published application
- Kind: A1
- Application number: 16/389,428
- Filed: 2019-04-19
- Published: 2019-08-08
- Earliest claimed: 2016-10-20
- Assignees: Nikon-Essilor Co., Ltd.
- Applicants: Nikon-Essilor Co., Ltd.
- Inventors: Takeshi KISHIMOTO
- Web page: https://patentgrep.com/patent/US20190246095A1

## CPC

- H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- A61B 3/00: Apparatus for testing the eyes; Instruments for examining the eyes (eye inspection using ultrasonic, sonic or infrasonic waves A61B8/10)
- A61B 3/0025: {characterised by electronic signal processing, e.g. eye models}
- G02B 27/0172: {characterised by optical features}
- G02C 7/00: Optical parts (characterised by the material G02B1/00)
- G02C 7/025: {considering parameters of the viewed object}
- G02C 7/027: {considering wearer's parameters}
- G02C 7/061: {Spectacle lenses with progressively varying focal power}
- G02C 13/00: Assembling (producing spectacle frames from plastics or from substances in a plastic state B29D12/02); Repairing; Cleaning (disinfection or sterilisation of contact lenses A61L12/00)
- G06F 30/00: Computer-aided design [CAD]
- G06T 7/0014: {using an image reference approach}
- G06T 7/593: from stereo images
- G06T 15/06: Ray-tracing
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 40/19: Sensors therefor
- H04N 13/128: Adjusting depth or disparity
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02C 13/005: {Measuring geometric parameters required to locate ophtalmic lenses in spectacles frames (apparatus for testing or instruments for examining the eyes per se A61B3/00; machines or devices and accessories for grinding the edges of lenses using spectacles as a template B24B9/144)}
- G06T 2207/10012: Stereo images
- G06T 2207/30041: Eye; Retina; Ophthalmic
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02C: SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES (trial frames for testing the eyes A61B3/04; goggles or eyeshields not having the same features as spectacles A61F9/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image creation device includes: a storage unit in which target scene three-dimensional information related to a position, a shape and optical characteristics of a structural object present in a virtual target scene, eyeglass lens three-dimensional information related to a position, a shape and optical characteristics of an eyeglass lens and eyeball three-dimensional information related to a position, a shape and optical characteristics of an eye of a wearer viewing the target scene through the eyeglass lens used as a virtual lens; and a retina image creation unit that creates a retina image based upon the target scene three-dimensional information, the eyeglass lens three-dimensional information and the eyeball three-dimensional information, wherein: the retina image is a virtual image projected onto a retina of the eye of the wearer viewing the target scene through the eyeglass lens.

## Claims

### Claim 1

An image creation device, comprising:
a storage unit in which target scene three-dimensional information related to a position, a shape and optical characteristics of a structural object present in a virtual target scene, eyeglass lens three-dimensional information related to a position, a shape and optical characteristics of an eyeglass lens and eyeball three-dimensional information related to a position, a shape and optical characteristics of an eye of a wearer viewing the target scene through the eyeglass lens used as a virtual lens; and
a retina image creation unit that creates a retina image based upon the target scene three-dimensional information, the eyeglass lens three-dimensional information and the eyeball three-dimensional information, wherein:
the retina image is a virtual image projected onto a retina of the eye of the wearer viewing the target scene through the eyeglass lens.

### Claim 2 (depends on 1)

The image creation device according to claim 1, further comprising:
a corresponding point calculation unit that calculates corresponding points, in retina images of two eyes, the corresponding points corresponding to a position within the target scene; and
a disparity calculation unit that calculates a binocular disparity with respect to the position based upon the corresponding points.

### Claim 3 (depends on 2)

The image creation device according to claim 2, wherein:
the corresponding point calculation unit calculates the corresponding points based upon correlation coefficients with respect to, or differences between, luminance values at pixels in a first pixel region where a plurality of pixels are present, set in the retina image for one eye, and luminance values at pixels in a second pixel region where a plurality of pixels are present, set in the retina image for another eye.

### Claim 4 (depends on 2)

The image creation device according to claim 2, further comprising:
a composite image creation unit that creates a composite image by using the retina images for the two eyes based upon the binocular disparity and a disparity correction parameter that includes a fusion ratio.

### Claim 5 (depends on 2)

The image creation device according to claim 2, further comprising:
a disparity display unit that displays a distribution of the binocular disparity, which corresponds to the retina images.

### Claim 6 (depends on 1)

The image creation device according to claim 1, wherein:
the retina image creation unit comprises a correction image creation unit that creates the retina image projected onto each retina of the eye based upon corrective lens three-dimensional information related to a position, a shape and optical characteristics of a corrective lens.

### Claim 7 (depends on 1)

The image creation device according to claim 1, further comprising:
a ray tracing unit that calculates an entry direction along which, and an entry position at which a ray of light entering the retina of the eye at each position, enters an anterior surface of a cornea of the eye and calculates a light path along which the ray of light, having departed the target scene, passes through the anterior surface of the cornea and arrives at the position in the retina, and a luminance value at a pixel corresponding to the position in the retina, based upon the entry direction and the entry position.

### Claim 8 (depends on 1)

The image creation device according to claim 1, further comprising:
an eyeball shape calculation unit that calculates the shape and the optical characteristics of the eye of the wearer based upon prescription data pertaining to the wearer.

### Claim 9 (depends on 8)

The image creation device according to claim 8, wherein:
the eyeball shape calculation unit calculates the shape of the eye based upon accommodation ability and a pupil diameter of the wearer.

### Claim 10 (depends on 1)

The image creation device according to claim 1, further comprising:
a moving image display unit that displays the retina image, or a composite image created by using the retina images for two eyes, as a moving image based upon a change occurring in the eyeball three-dimensional information.

### Claim 11

A method for image creation, comprising:
creating a retina image based upon target scene three-dimensional information related to a position, a shape and optical characteristics of a structural object in a virtual target scene, eyeglass lens three-dimensional information related to a position, a shape and optical characteristics of an eyeglass lens and eyeball three-dimensional information related to a position, a shape and optical characteristics of an eye of a wearer virtually viewing the target scene through the eyeglass lens, wherein:
the retina image is an image of the target scene virtually viewed by the wearer through the eyeglass lens, projected onto a retina of the eye of the wearer.

### Claim 12 (depends on 11)

The method for image creation according to claim 11, further comprising:
creating a composite image by using retina images of the two eyes based upon a disparity correction parameter that sets an extent by which a binocular disparity of the two eyes is to be corrected.

### Claim 13

An image creation program enabling a computer to execute:
retina image creation processing through which a retina image is created based upon target scene three-dimensional information related to a position, a shape and optical characteristics of a structural object in a virtual target scene, eyeglass lens three-dimensional information related to a position, a shape and optical characteristics of an eyeglass lens and eyeball three-dimensional information related to a position, a shape and optical characteristics of an eye of a wearer virtually viewing the target scene through the eyeglass lens, wherein:
the retina image is an image of the target scene virtually viewed by the wearer through the eyeglass lens, projected onto a retina of the eye of the wearer.

### Claim 14 (depends on 1)

A method for designing an eyeglass lens, the method comprising:
designing an eyeglass lens based upon the shape of the eyeglass lens used by the image creation device according to claim 1, to create the retina image.

### Claim 15 (depends on 14)

A method for manufacturing an eyeglass lens, the method comprising:
designing the eyeglass lens through the method for designing an eyeglass lens according to claim 14; and
manufacturing the eyeglass lens having been designed through the method for designing an eyeglass lens.
