# US 2024/0233602 A1 · Estimating a delay from a monitor output to a sensor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0233602 A1
- Document ID: US20240233602A1
- Status: Published application
- Kind: A1
- Application number: 18/404,045
- Filed: 2024-01-04
- Published: 2024-07-11
- Earliest claimed: 2023-01-05
- Assignees: NeuraLight Ltd.
- Applicants: NeuraLight Ltd.
- Inventors: Israel ROSSET; Eran HARPAZ; John Michael ROZMUS; Vladimir ANISIMOV
- Web page: https://patentgrep.com/patent/US20240233602A1

## CPC

- G09G 3/2011: {by amplitude modulation}
- G09G 3/2018: {by time modulation using two or more time intervals}
- H04N 23/74: by influencing the scene brightness using illuminating means
- G09G 2320/0633: by amplitude modulation of the brightness of the illumination source
- G09G 2320/064: by time modulation of the brightness of the illumination source
- G09G 2320/0646: Modulation of illumination source brightness and image signal correlated to each other
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are system, method, and computer program product embodiments, and/or combinations and sub-combinations thereof, for determining a time delay for synchronizing one or more parameters. In an embodiment, a plurality of frames is presented on a display device. A brightness level is modulated in one or more frames of the plurality of frames. A plurality of image frames of a face of a user is received. The plurality of image frames are obtained from a video stream recorded by an image sensor during the presentation of the plurality of frames on the display device. The plurality of image frames are processed to determine the time delay between when the modulating the brightness level is performed in the one or more frames and when the modulating the brightness level in the one or more frames is reported by the image sensor.

## Claims

### Claim 1

A computer-implemented method for estimating a time delay for synchronizing one or more parameters, comprising:
presenting, by at least one computer processor, a plurality of frames on a display device;
modulating a brightness level in one or more frames of the plurality of frames;
receiving a plurality of image frames of a face of a user, wherein the plurality of image frames are obtained from a video stream recorded by an image sensor during the presenting of the plurality of frames on the display device; and
processing the plurality of image frames to determine the time delay between when the modulating the brightness level is performed in the one or more frames of the plurality of frames and when the modulating the brightness level in the one or more frames of the plurality of frames is reported by the image sensor.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the processing comprises:
identifying a set of pixels in an image frame of the plurality of image frames, wherein the set of pixels corresponds to the face of the user; and
determining a brightness measurement for the set of pixels.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the brightness measurement corresponds to a mean of brightness values of each pixel of the set of pixels.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the processing comprises:
determining a brightness measurement for each frame of the plurality of image frames, wherein each brightness measurement is determined at a respective brightness measurement time;
identifying a first set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the first set exceeds an upper threshold;
identifying a second set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the second set is less than a lower threshold;
determining a transition detection time based on at least respective brightness measurement times for frames of the first set of image frames and the second set of image frames; and
determining the time delay as a function of the transition detection time and a modulation time, wherein the modulation time corresponds to a time at which the modulating the brightness level is performed in the one or more frames of the plurality of frames.

### Claim 5 (depends on 4)

The computer-implement method of claim 4, wherein the time delay is a difference between the transition detection time and the modulation time.

### Claim 6 (depends on 4)

The computer-implemented method of claim 4,
wherein the first set of image frames corresponds to a first set of frames in which the brightness level is changed to a first brightness level;
wherein the second set of image frames corresponds to a second set of frames in which the brightness level is changed to a second brightness level; and
wherein the transition detection time corresponds to a time at which a change in the brightness level from the first brightness level to the second brightness level is detected by the image sensor.

### Claim 7 (depends on 4)

The computer-implemented method of claim 4, wherein the brightness measurement time is determined based on at least one of a receive timestamp of an image frame, an overlap of frame period, an exposure value of the image sensor, or a duration of the image frame.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein the time delay includes at least a network delay.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein the display device includes an array of individually controllable pixels associated with a plurality of colors, and wherein the modulating the brightness level comprises:
controlling a brightness of pixels corresponding to a first color of the plurality of colors.

### Claim 10 (depends on 1)

The computer-implemented method of claim 1, further comprising:
adjusting a parameter based on the time delay, wherein the parameter is associated with a response of the user to a stimulus presented in the plurality of frames.

### Claim 11

A system for estimating a time delay for synchronizing one or more parameters, comprising:
one or more memories; and
at least one processor each coupled to a least one of the memories and configured to:
present a plurality of frames on a display device;
modulate a brightness level in one or more frames of the plurality of frames;
receive a plurality of image frames of a face of a user, wherein the plurality of image frames are obtained from a video stream recorded by an image sensor during the presentation of the plurality of frames on the display device; and
process the plurality of image frames to determine the time delay between when the modulating the brightness level is performed in the one or more frames of the plurality of frames and when the modulating the brightness level in the one or more frames of the plurality of frames is reported by the image sensor.

### Claim 12 (depends on 11)

The system of claim 11, wherein to process the plurality of image frames, the at least one processor is configured to:
identify a set of pixels in an image frame of the plurality of image frames, wherein the set of pixels corresponds to the face of the user; and
determine a brightness measurement for the set of pixels.

### Claim 13 (depends on 11)

The system of claim 11, wherein to process the plurality of image frames, the at least one processor is configured to:
determine a brightness measurement for each frame of the plurality of image frames, wherein each brightness measurement is determined at a respective brightness measurement time;
identify a first set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the first set exceeds an upper threshold;
identify a second set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the second set is less than a lower threshold;
determine a transition detection time based on at least respective brightness measurement times for frames of the first set of image frames and the second set of image frames; and
determine the time delay as a function of the transition detection time and a modulation time, wherein the modulation time corresponds to a time at which the modulating the brightness level is performed in the one or more frames of the plurality of frames.

### Claim 14 (depends on 13)

The system of claim 13, wherein the time delay is a difference between the transition detection time and the modulation time.

### Claim 15 (depends on 13)

The system of claim 13, wherein the first set of image frames corresponds to a first set of frames in which the brightness level is changed to a first brightness level;
wherein the second set of image frames corresponds to a second set of frames in which the brightness level is changed to a second brightness level; and
wherein the transition detection time corresponds to a time at which a change in the brightness level from the first brightness level to the second brightness level is detected by the image sensor.

### Claim 16 (depends on 11)

The system of claim 11, wherein the display device includes an array of individually controllable pixels associated with a plurality of colors, and wherein to modulate the brightness level, the at least one processor is configured to:
control a brightness of pixels corresponding to a first color of the plurality of colors.

### Claim 17 (depends on 11)

The system of claim 11, wherein the at least one processor is further configured to:
adjust a parameter based on the time delay, wherein the parameter is associated with a response of the user to a stimulus presented in the plurality of frames.

### Claim 18

A non-transitory computer-readable medium having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
presenting a plurality of frames on a display device;
modulating a brightness level in one or more frames of the plurality of frames;
receiving a plurality of image frames of a face of a user, wherein the plurality of image frames are obtained from a video stream recorded by an image sensor during the presentation of the plurality of frames on the display device; and
processing the plurality of image frames to determine a time delay between when the modulating the brightness level is performed in the one or more frames of the plurality of frames and when the modulating the brightness level in the one or more frames of the plurality of frames is reported by the image sensor.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the processing comprises:
determining a brightness measurement for each frame of the plurality of image frames, wherein each brightness measurement is determined at a respective brightness measurement time;
identifying a first set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the first set exceeds an upper threshold;
identifying a second set of image frames from the plurality of image frames, wherein the brightness measurement corresponding to each image frame of the second set is less than a lower threshold;
determining a transition detection time based on at least respective brightness measurement times for frames of the first set of image frames and the second set of image frames; and
determining the time delay as a function of the transition detection time and a modulation time, wherein the modulation time corresponds to a time at which the modulating the brightness level is performed in the one or more frames of the plurality of frames.

### Claim 20 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the operations further comprise:
adjusting a parameter based on the time delay, wherein the parameter is associated with a response of the user to a stimulus presented in the plurality of frames.
