# US 2025/0095176 A1 · Optical processing method, optical processing apparatus, optical processing system, and non-transitory storage medium storing optical processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095176 A1
- Document ID: US20250095176A1
- Status: Published application
- Kind: A1
- Application number: 18/817,826
- Filed: 2024-08-28
- Published: 2025-03-20
- Earliest claimed: 2023-09-19
- Assignees: Kabushiki Kaisha Toshiba
- Applicants: Kabushiki Kaisha Toshiba
- Inventors: Hiroshi OHNO; Takashi USUI
- Web page: https://patentgrep.com/patent/US20250095176A1

## CPC

- G06T 7/507: from shading (G06T7/586 takes precedence)
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 7/11: Region-based segmentation
- G06T 7/50: Depth or shape recovery
- G06T 7/90: Determination of colour characteristics
- G06T 15/205: {Image-based rendering}
- G06T 2207/10024: Color image
- G06T 2207/20021: Dividing image into blocks, subimages or windows
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

According to an embodiment, an optical processing method includes: inputting an image including direction information of light from an object as hue information for each pixel into an artificial neural network; and acquiring depth information of the object for the image based on a result output from the artificial neural network.

## Claims

### Claim 1

An optical processing method comprising:
inputting an image including direction information of light from an object as hue information for each pixel into an artificial neural network; and
acquiring depth information of the object for the image based on a result output from the artificial neural network.

### Claim 2 (depends on 1)

The optical processing method according to claim 1, further comprising:
performing iterative calculation so that a three-dimensional shape of the object output when the direction information of the light is input using the artificial neural network satisfies an equation derived based on geometric optics.

### Claim 3 (depends on 1)

The optical processing method according to claim 1, wherein:
the direction information of the light is an angle of a light beam with respect to a specific axis as a reference.

### Claim 4 (depends on 1)

The optical processing method according to claim 1, further comprising:
acquiring, by an image sensor, the image including the direction information of the light through an image formation optical element and a wavelength selection portion including a plurality of regions including at least two different transmission wavelength spectra or at least two different reflection wavelength spectra.

### Claim 5

An optical processing apparatus comprising:
a processing portion which is configured to input an image including direction information of light from an object as hue information for each pixel into an artificial neural network, and which is configured to acquire depth information of the object for the image based on a result output from the artificial neural network.

### Claim 6 (depends on 5)

An optical processing system comprising:
the optical processing apparatus according to claim 5; and
an imaging portion which is configured to acquire the image,
wherein the imaging portion comprises:
an image formation optical element,
an image sensor, and
a wavelength selection portion that causes the image sensor to acquire direction information of light from the object as hue information.

### Claim 7 (depends on 6)

The optical processing system according to claim 6, wherein
the wavelength selection portion is disposed at a focal plane of the image formation optical element.

### Claim 8 (depends on 6)

The optical processing system according to claim 6, wherein:
the wavelength selection portion includes a plurality of regions including at least two different transmission wavelength spectra or at least two different reflection wavelength spectra, and
the plurality of regions are arranged concentrically.

### Claim 9 (depends on 6)

The optical processing system according to claim 6, wherein:
the wavelength selection portion includes a plurality of regions having at least two different transmission wavelength spectra or at least two different reflection wavelength spectra, and
the plurality of regions are arranged in stripes.

### Claim 10

A non-transitory storage medium storing an optical processing program which causes a computer to execute:
inputting an image including direction information of light from an object as hue information for each pixel into an artificial neural network; and
acquiring depth information of the object for the image based on a result output from the artificial neural network.
