# US 2025/0095181 A1 · Methods and Apparatus for Capturing Images and Using Images for Depth Determination and/or other Purposes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0095181 A1
- Document ID: US20250095181A1
- Status: Published application
- Kind: A1
- Application number: 18/411,045
- Filed: 2024-01-12
- Published: 2025-03-20
- Earliest claimed: 2023-09-19
- Assignees: More S.R.L.
- Applicants: More, Inc.
- Inventors: Divya Gupta; Rajiv Laroia
- Web page: https://patentgrep.com/patent/US20250095181A1

## CPC

- G03B 21/208: {Homogenising, shaping of the illumination light}
- G06T 7/593: from stereo images
- G03B 15/02: Illuminating scene
- G03B 35/02: by sequential recording
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- H04N 23/73: by influencing the exposure time
- H04N 23/74: by influencing the scene brightness using illuminating means
- G06T 2207/10152: Varying illumination
- G06T 2207/20221: Image fusion; Image merging
- G06V 2201/07: Target detection
- H04N 23/56: provided with illuminating means
- H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals}
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Methods and apparatus for illuminating scene areas to facilitate depth determination are described. A sequence of frames is displayed, e.g., projected, onto a scene area to illuminate the area for image capture. The sequence of frames includes a patterned frame followed by a concealing frame. The patterned frame and concealing frame are each displayed for no more than 1/60 of a second. The concealing frame maybe and sometimes does display a complementary pattern to the preceding patterned frame. When viewed sequentially by a human viewer the human sees a non-distracting uniformly illuminated scene area as a result of the effect of the concealing frame. One or more cameras are used to capture images of the illuminated area during a time in which the pattern is displayed and the scene area is effectively painted with a pattern that can facilitate depth determination based on one or more captured images.

## Claims

### Claim 1

A method of capturing images of an area illuminated with an illumination sequence of frames including a first illumination frame corresponding to a first illumination frame period having a first light pattern followed by a first concealing frame having a second light pattern, the first illumination frame period having a first frame duration, the first concealing frame having a second frame duration, the second light pattern concealing the first light pattern when the illuminated area is observed over a duration corresponding to the combined period having a combined duration equal to the sum of the first and second frame durations, the method comprising:
operating a first camera to capture a first image of the illuminated area using an exposure time which is different from said combined duration, the captured first image including a light pattern due to the illumination of the illuminated area; and
making a depth determination based on the first image.

### Claim 2 (depends on 1)

The method of claim 1, wherein said first illumination frame and the first concealing frame have the same duration and wherein the exposure time is aligned to begin with the start of one of the first illumination frame or the start of the first concealing frame.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
producing an additional image of the illuminated area which does not include said first light pattern, producing the additional image including at least one of:
i) operating an additional camera to capture the additional image of the illuminated area, using an exposure time which is an integer multiple of the combined frame duration: ii) generating the additional image by combining first and second images captured by said first camera or an additional camera, said first image corresponding to a first exposure frame time and said second image corresponding to a second exposure frame time that follows said first exposure frame time, or iii) operating the first camera to capture the additional image of the illuminated area using an exposure time which is an integer multiple of the combined frame duration.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
storing the additional image which does not include an illumination pattern; and
performing a model training operation, said step of performing a model training operation including using the additional image to train a model to recognize an object in the additional image.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
synchronizing the first camera with the illumination device based on captured images.

### Claim 6 (depends on 1)

The method of claim 1, wherein making a depth determination includes performing a structured light depth determination based on the pattern included in the first image.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
operating a second camera to capture a second image of the illuminated area at the same time the first camera captures the first image; and
wherein making a depth determination based on the first image includes making a stereoscopic depth determination based on both the first and second images.

### Claim 8 (depends on 7)

The method of claim 7, wherein the second camera uses a second exposure time which is a non-even multiple of the frame duration to capture the second image (note that as a result of using an exposure time which is not an even multiple of the frame duration and thus will differ from the combined frame duration, the second image which will include a pattern due to patterned illumination of the scene area.

### Claim 9 (depends on 8)

The method of claim 8, wherein the first exposure time is less than or equal to the first frame time.

### Claim 10 (depends on 9)

The method of claim 9, wherein the first exposure time used by the first camera to capture the first image and the second exposure time used by the second camera to capture the second image are the same and correspond to the interval of time with the first and second cameras capturing the first and second images in parallel for use in stereoscopic depth determinations.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
controlling a start of an exposure used in the capture of the first image to align the start of the exposure with the start of one of said first and second frames.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
prior to controlling the start of the exposure, electronically or wirelessly synchronizing the first camera with an illumination device used to project said first and second frames to thereby illuminate the area.

### Claim 13 (depends on 11)

The method of claim 11, prior to controlling the start of the exposure, synchronizing the first camera to the illumination device based on processing of images captured by the first camera.

### Claim 14 (depends on 12)

The method of claim 12, wherein synchronizing the first camera to the illumination device based on processing of images captured by the first camera includes:
adjusting image capture start time of the first camera to optimize the contrast of images captured by the first camera.

### Claim 15

An system for use in an area illuminated with an illumination sequence of frames including a first illumination frame corresponding to a first illumination frame period and having a first light pattern followed by a first concealing frame having a second light pattern, the first illumination frame period having a first frame duration, the first concealing frame having a second frame duration, the second light pattern concealing the first light pattern when the illuminated area is observed over a duration corresponding to the combined period having a combined duration equal to the sum of the first and second frame durations, comprising:
a first camera; and
a processor, the processor being configured to:
control the first camera to capture a first image of the illuminated area using an exposure time which is different from said combined duration, the captured first image including a light pattern due to the illumination of the illuminated area; and
make a depth determination based on the first image.

### Claim 16 (depends on 15)

The system of claim 15, wherein the processor is further configured to:
produce an additional image of the illuminated area which does not include said first light pattern by: i) controlling an additional camera to capture the additional image of the illuminated area, using an exposure time which is an integer multiple of the combined frame duration: ii) combining first and second images captured by said first camera or an additional camera, said first image corresponding to a first exposure frame time and said second image corresponding to a second exposure frame time that follows (e.g., immediately follows in most cases) said first exposure frame time, or iii) controlling the first camera to capture the additional image of the illuminated area using an exposure time which is an integer multiple of the combined frame duration.

### Claim 17 (depends on 16)

The system of claim 16, further comprising:
a storage device that stores the additional image which does not include an illumination pattern; and
wherein the processor is further configured to:
use the additional image to train a model to recognize an object in the additional image.

### Claim 18 (depends on 15)

The system of claim 15, wherein the processor is configured to perform a structured light depth determination based on the pattern included in the first image as part of making a depth determination.

### Claim 19 (depends on 15)

The system of claim 15, wherein the processor is further configured to:
control a second camera to capture a second image of the illuminated area at the same time the first camera captures the first image; and
wherein the processor is configured, as part of making a depth determination, to make a stereoscopic depth determination based on both the first and second images.

### Claim 20

A non-transitory machine readable medium including processor executable instructions which when executed by a processor control the capture and use of one or more images in an area illuminated with an illumination sequence of frames including a first illumination frame corresponding to a first illumination frame period having a first light pattern followed by a first concealing frame having a second light pattern, the first illumination frame period having a first frame duration, the first concealing frame having a second frame duration, the second light pattern concealing the first light pattern when the illuminated area is observed over a duration corresponding to the combined period having a combined duration equal to the sum of the first and second frame durations, the processor, as part of controlling the capture and use of one or more image performing the steps of:
controlling a first camera to capture a first image of the illuminated area using an exposure time which is different from said combined duration, the captured first image including a light pattern due to the illumination of the illuminated area; and
making a depth determination based on the first image.
