# US 2024/0004479 A1 · Differentiating a detected object from a background using a gaussian brightness falloff pattern

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004479 A1
- Document ID: US20240004479A1
- Status: Published application
- Kind: A1
- Application number: 18/369,768
- Filed: 2023-09-18
- Published: 2024-01-04
- Earliest claimed: 2012-01-17
- Assignees: Ultrahaptics IP Two Limited
- Applicants: Ultrahaptics IP Two Limited
- Inventors: David S. HOLZ; Hua YANG
- Web page: https://patentgrep.com/patent/US20240004479A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/11: Region-based segmentation
- G06T 7/194: involving foreground-background segmentation
- G06T 7/215: Motion-based segmentation
- G06T 7/248: {involving reference images or patches}
- G06T 7/251: {involving models}
- G06T 7/254: involving subtraction of images
- G06T 7/262: using transform domain methods, e.g. Fourier domain methods
- G06T 7/344: {involving models}
- G06T 7/37: using transform domain methods
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/90: Determination of colour characteristics
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/107: {Static hand or arm}
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- G06T 2200/04: involving 3D image data
- G06T 2207/10012: Stereo images
- G06T 2207/10016: Video; Image sequence
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method for detecting a finger is provided. The method includes obtaining a plurality of digital images including a first digital image captured by a camera from a field of view containing a background and a hand including at least one finger, and obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger that is visible in the plurality of digital images rather than to the background, the pixels being identified by: obtaining, from the digital images, a Gaussian brightness falloff pattern indicative of at least one finger, identifying an axis of the at least one finger based on the obtained Gaussian brightness falloff pattern indicative of the at least one finger without identifying edges of the at least one finger, and identifying the pixels that correspond to the at least one finger based on the identified axis.

## Claims

### Claim 1

A wearable goggle comprising one or more processors configured to:
obtain a plurality of digital images captured by a camera coupled to a holographic diffraction grating;
obtain an identification of pixels of the plurality of digital images that correspond to at least one finger of a hand that is visible in the plurality of digital images rather than to a background in the plurality of digital images, the pixels being identified by:
obtaining, from the holographic diffraction grating, a fringe pattern comprising an interference distribution of the holographic diffraction grating, wherein the fringe pattern provides a high contrast differential between the at least one finger and the background;
identifying at least one of (i) a ghost silhouette and (ii) a tangent of the at least one finger of the hand based on the obtained fringe pattern indicative of the at least one finger; and
identifying the pixels that correspond to the at least one finger based on at least one of the ghost silhouette and the tangent; and
track motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

### Claim 2 (depends on 1)

The wearable goggle of claim 1, wherein the processor is further configured to:
compare the tracked motion to a library of gestures;
identify a particular gesture from the library of gestures that corresponds to the tracked motion; and
enable the particular gesture that corresponds to the tracked motion.

### Claim 3 (depends on 1)

The wearable goggle of claim 1, wherein the processor is further configured to:
construct a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger,
wherein the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest, and
wherein at least one light source is positioned such that objects of interest are located within a proximal zone of a field of view of the camera, the proximal zone extending from the camera to a distance less than twice an expected maximum distance between the objects of interest and the camera.

### Claim 4 (depends on 1)

The wearable goggle of claim 1, wherein the holographic diffraction grating is one of a classical grating, a first generation holographic grating, or a Sheridon grating.

### Claim 5 (depends on 1)

The wearable goggle of claim 1, wherein the fringe pattern includes a sinusoidal wave.

### Claim 6 (depends on 1)

The wearable goggle of claim 1, wherein the processor is further configured to:
construct a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger,
wherein the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest; and
wherein at least one light source is positioned such that objects of interest are located within a proximal zone of the field of view, the proximal zone extending from the camera to a distance that is half or less than a distance to the background.

### Claim 7 (depends on 6)

The wearable goggle of claim 6, wherein the holographic diffraction grating is associated with a holographic virtual reality/augmented reality (VR/AR) optics logic.

### Claim 8 (depends on 7)

The wearable goggle of claim 7, wherein the holographic VR/AR optics logic is configured to:
generate a holographic image including, at least, the 3D model of the at least one finger; and
present, towards a user, the holographic image via a display of the wearable goggle.

### Claim 9 (depends on 8)

The wearable goggle of claim 8, wherein the holographic VR/AR optics logic is further configured to:
generate a holographic image including at least one transparent region within the holographic image, wherein a transparency of a region is based on at least one of (i) a wavelength and (ii) an angle associated with the interference distribution of the holographic diffraction grating; and
present, towards the user, an AR scene via the display of the wearable goggle, the AR scene including, at least, the holographic image including at least one transparent region within the holographic image.

### Claim 10

A method comprising:
obtaining a plurality of digital images captured by a camera coupled to a holographic diffraction grating;
obtaining an identification of pixels of the plurality of digital images that correspond to at least one finger of a hand that is visible in the plurality of digital images rather than to a background of the plurality of digital images, the pixels being identified by:
obtaining, from the holographic diffraction grating, a fringe pattern comprising an interference distribution of the holographic diffraction grating, wherein the fringe pattern provides a high contrast differential between the at least one finger and the background;
identifying at least one of (i) a ghost silhouette and (ii) a tangent of the at least one finger of the hand based on the obtained fringe pattern indicative of the at least one finger; and
identifying the pixels that correspond to the at least one finger based on at least one of the ghost silhouette and tangent; and
tracking motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

### Claim 11 (depends on 10)

The method of claim 10, wherein the method further includes:
constructing a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger,
wherein the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest, and
wherein at least one light source is positioned such that objects of interest are located within a proximal zone of a field of view of the camera, the proximal zone extending from the camera to a distance less than twice an expected maximum distance between the objects of interest and the camera.

### Claim 12 (depends on 11)

The method of claim 11, wherein the method further includes:
generating a holographic image including, at least, the 3D model of the at least one finger; and
presenting, towards a user, the holographic image via a display of a user device.

### Claim 13 (depends on 12)

The method of claim 12, further including presenting, towards the user and via the display of the user device, a VR scene based on the holographic image.

### Claim 14 (depends on 12)

The method of claim 12, further including presenting, towards the user and via the display of the user device, an AR scene based on the holographic image, wherein:
the holographic image includes at least one transparent region within the holographic image, and
a transparency of a region is based on at least one of (i) a wavelength and (ii) an angle associated with the interference distribution of the holographic diffraction grating.

### Claim 15

An image capture and analysis system comprising an image analyzer configured to:
obtain a plurality of digital images captured by a camera coupled to a holographic diffraction grating;
obtain an identification of pixels of the plurality of digital images that correspond to at least one finger of a hand that is visible in the plurality of digital images rather than to a background of the plurality of digital images, the pixels being identified by:
obtaining, from the holographic diffraction grating, a fringe pattern comprising an interference distribution of the holographic diffraction grating, wherein the fringe pattern provides a high contrast differential between the at least one finger and the background;
identifying at least one of (i) a ghost silhouette and (ii) a tangent of the at least one finger of the hand based on the obtained fringe pattern indicative of the at least one finger; and
identifying the pixels that correspond to the at least one finger based on at least one of the ghost silhouette and the tangent; and
track motion of the identified pixels that correspond to the at least one finger through the plurality of digital images.

### Claim 16 (depends on 15)

The image capture and analysis system of claim 15, wherein the image analyzer is further configured to:
construct a model of the at least one finger based on the identified pixels that correspond to the at least one finger and the tracked motion of the identified pixels that correspond to the at least one finger,
wherein the constructing of the model includes constructing a 3D model of the at least one finger, including a position and a shape of the at least one finger, to geometrically determine whether the at least one finger corresponds to an object of interest, and
wherein at least one light source is positioned such that objects of interest are located within a proximal zone of a field of view of the camera, the proximal zone extending from the camera to a distance less than twice an expected maximum distance between the objects of interest and the camera.

### Claim 17 (depends on 16)

The image capture and analysis system of claim 16, further including a holographic virtual reality/augmented reality (VR/AR) optics logic, wherein the holographic VR/AR optics logic is configured to process data associated with the fringe pattern obtained from the holographic diffraction grating.

### Claim 18 (depends on 17)

The image capture and analysis system of claim 17, wherein the holographic VR/AR optics logic is configured to:
generate a holographic image including, at least, the 3D model of the at least one finger; and
present, towards a user, the holographic image via a display of a user device.

### Claim 19 (depends on 18)

The image capture and analysis system of claim 18, wherein the holographic VR/AR optics logic is further configured to:
generate a holographic image including at least one transparent region within the holographic image, wherein a transparency of a region is based on at least one of (i) a wavelength and (ii) an angle associated with the interference distribution of the holographic diffraction grating; and
present, towards the user, an AR scene via the display of the user device, the AR scene including, at least, the holographic image including at least one transparent region within the holographic image.

### Claim 20 (depends on 18)

The image capture and analysis system of claim 18, wherein the holographic VR/AR optics logic is further configured to present, towards the user and via the display of the user device, a VR scene based on the holographic image.
