# US 2023/0022782 A1 · Glasses-Free Determination of Absolute Motion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0022782 A1
- Document ID: US20230022782A1
- Status: Published application
- Kind: A1
- Application number: 17/952,235
- Filed: 2022-09-24
- Published: 2023-01-26
- Earliest claimed: 2019-02-15
- Assignees: EchoPixel, Inc.
- Applicants: EchoPixel, Inc.
- Inventors: Sergio Aguirre-Valencia; Janet H. Goldenstein
- Web page: https://patentgrep.com/patent/US20230022782A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 7/292: Multi-camera tracking
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06T 7/0014: {using an image reference approach}
- G06T 7/11: Region-based segmentation
- G06T 7/187: involving region growing; involving region merging; involving connected component labelling
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/122: Improving the three-dimensional [3D] impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues (H04N13/128 takes precedence)
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/376: for tracking left-right translational head movements, i.e. lateral movements
- H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
- G06T 2200/04: involving 3D image data
- G06T 2207/10012: Stereo images
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T 2207/20156: Automatic seed setting
- G06T 2207/30028: Colon; Small intestine
- G06T 2207/30041: Eye; Retina; Ophthalmic
- H04N 2013/0085: {Motion estimation from stereoscopic image signals}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

During operation, an electronic device may capture images using multiple image sensors having different fields of view and positions. Then, the electronic device may determine, based at least in part on an apparent size of an anatomical feature in the images (such as an interpupillary distance) and a predefined or predetermined size of the anatomical feature, absolute motion of at least a portion of the individual along a direction between at least the portion of the individual and the electronic device. Moreover, the electronic device may compute based at least in part on an estimated distance along the direction corresponding to the apparent size and the predefined or predetermined size and angular information associated with one or more objects in the images relative to the positions, absolute motion of at least the portion of the individual in a plane that is perpendicular to the direction.

## Claims

### Claim 1

An electronic device, comprising:
multiple image sensors, having different fields of view and positions, configured to capture images, wherein the electronic device is configured to:
capture the images using the image sensors;
determine, based at least in part on apparent sizes of an object in the images and a predefined or predetermined size of the object, absolute motion of at least a portion of an individual along a direction between at least the portion of the individual and the electronic device;
estimate a distance along the direction based at least in part on at least one of the apparent sizes of the object in at least one of the images and the predefined or predetermined size of the object; and
compute, based at least in part on the estimated distance and angular information associated with one or more objects in the images relative to the positions, absolute motion of at least the portion of the individual in a plane that is perpendicular to the direction.

### Claim 2 (depends on 1)

The electronic device of claim 1, wherein the at least the portion of the individual comprises eyes of the individual.

### Claim 3 (depends on 1)

The electronic device of claim 1, wherein the one or more objects comprise pupils of the individual.

### Claim 4 (depends on 1)

The electronic device of claim 1, wherein the electronic device comprises second image sensors, having different second fields of view, configured to capture second images; and
wherein the capturing, determining, estimating and computing operations are repeated for the second images to determine absolution motion of a second portion of the individual.

### Claim 5 (depends on 4)

The electronic device of claim 4, wherein the second portion of the individual comprises one of: a hand of the individual or a finger of the individual.

### Claim 6 (depends on 4)

The electronic device of claim 4, wherein the electronic device is configured to infer interaction with an object by the individual based at least in part on the determined absolute motion in the direction, the determined absolute motion in the plane or both of at least the second portion of the individual.

### Claim 7 (depends on 1)

The electronic device of claim 1, wherein the object comprises one of: an interpupillary distance, a hand of the individual, a finger of the individual or another anatomical feature of the individual.

### Claim 8 (depends on 1)

The electronic device of claim 1, wherein the object is associated with the individual or a group of individuals that have one or more characteristics in common with the individual.

### Claim 9 (depends on 8)

The electronic device of claim 8, wherein the object is an average or mean interpupillary distance.

### Claim 10 (depends on 1)

The electronic device of claim 1, wherein the electronic device comprises a time-of-flight (tof) sensor configured to capture tof information; and
wherein the absolute motion along the direction and in the plane is determined based at least in part on the tof information.

### Claim 11 (depends on 1)

The electronic device of claim 1, wherein the electronic device comprises a display; and
wherein the electronic device is configured to:
generate stereoscopic images that comprise image parallax based at least in part on the determined absolute motion along the direction and in the plane and a viewing geometry that matches or corresponds to the absolute motion along the direction and in the plane; and
provide the stereoscopic images on the display.

### Claim 12 (depends on 11)

The electronic device of claim 11, wherein the determined absolute motion in the direction, the determined absolute motion in the plane or both of at least the portion of the individual corresponds to positions of eyes or pupils of the individual; and
wherein the stereoscopic images are generated based at least in part on the positions of the eyes or pupils of the individual.

### Claim 13 (depends on 11)

The electronic device of claim 11, wherein the determined absolute motion in the direction, the determined absolute motion in the plane or both of at least the portion of the individual corresponds to a focal point of the individual, and the stereoscopic images are generated based at least in part on the focal point.

### Claim 14 (depends on 13)

The method of claim 13, wherein an intensity of a given voxel in a given one of the stereoscopic images is based at least in part on a transfer function that specifies a transparency of the given voxel and the focal point, so that the stereoscopic images comprise foveated imaging.

### Claim 15 (depends on 11)

The electronic device of claim 11, wherein the image sensors capture images that comprise eyes of the individual, a hand or finger of the individual, and the display in which the stereoscopic images are displayed; and
wherein image parallax and motion parallax of the stereoscopic images within the viewing geometry is based at least in part on the images.

### Claim 16 (depends on 1)

The electronic device of claim 1, wherein the absolute motion of at least the portion of the individual along the direction and in the plane is determined without using information associated with glasses worn by the individual or a glove worn by the individual.

### Claim 17

A non-transitory computer-readable storage medium for use in conjunction with an electronic device, the computer-readable storage medium storing program instructions, wherein, when executed by the electronic device, the program instructions cause the electronic device to perform one or more operations comprising:
capturing images using image sensors;
determining, based at least in part on apparent sizes of an object in the images and a predefined or predetermined size of the object, absolute motion of at least a portion of an individual along a direction between at least the portion of the individual and the electronic device;
estimating a distance along the direction based at least in part on at least one of the apparent sizes of the object in at least one of the images and the predefined or predetermined size of the object; and
computing, based at least in part on the estimated distance and angular information associated with one or more objects in the images relative to positions of the image sensors, absolute motion of at least the portion of the individual in a plane that is perpendicular to the direction.

### Claim 18 (depends on 17)

The computer-readable storage medium of claim 17, wherein the object comprises: an interpupillary distance, a hand of the individual, a finger of the individual, or another anatomical feature of the individual.

### Claim 19

A method for determining absolute motion, comprising:
by an electronic device:
capturing images using image sensors;
determining, based at least in part on apparent sizes of an object in the images and a predefined or predetermined size of the object, absolute motion of at least a portion of an individual along a direction between at least the portion of the individual and the electronic device;
estimating a distance along the direction based at least in part on at least one of the apparent sizes of the object in at least one of the images and the predefined or predetermined size of the object; and
computing, based at least in part on the estimated distance and angular information associated with one or more objects in the images relative to positions of the image sensors, absolute motion of at least the portion of the individual in a plane that is perpendicular to the direction.

### Claim 20 (depends on 19)

The method of claim 19, wherein the object comprises: an interpupillary distance, a hand of the individual, a finger of the individual, or another anatomical feature of the individual.
