# US 2025/0165079 A1 · Systems and methods for machine control

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0165079 A1
- Document ID: US20250165079A1
- Status: Published application
- Kind: A1
- Application number: 19/026,259
- Filed: 2025-01-16
- Published: 2025-05-22
- Earliest claimed: 2012-01-17
- Assignees: Ultrahaptics IP Two Limited
- Applicants: Ultrahaptics IP Two Limited
- Inventors: David S. HOLZ
- Web page: https://patentgrep.com/patent/US20250165079A1

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G06V 40/107: {Static hand or arm}
- G06V 40/113: {Recognition of static hand signs}
- G06F 2218/08: Feature extraction
- G06T 2207/10152: Varying illumination
- G06T 2207/30196: Human being; Person
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A region of space may be monitored for the presence or absence of one or more control objects, and object attributes and changes thereto may be interpreted as control information provided as input to a machine or application. In some embodiments, the region is monitored using a combination of scanning and image-based sensing.

## Claims

### Claim 1

A computer-implemented method for conducting machine control, the method comprising:
coordinating (i) directing an emission cycle to a region of interest in accordance with a scan pattern, (ii) detecting a time-variable reflection signal indicative of a reflection of the emission cycle, and (iii) acquiring images of the region of interest, the directing, the detecting and the acquiring being coordinated by controlling a variance of the scan pattern according to a detected attribute of an object, wherein the varied scan pattern varies intensities of the emission cycle according to the detected attribute of the object; and
processing the time-variable reflection signal and the images to (i) determine a presence of the object and object attributes and (ii) infer machine-control information from the object attributes.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the acquiring the images implements one or more cameras to acquire the images of the region of interest.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the detecting the time-variable reflection signal indicative of the reflection implements a photosensitive element to detect the reflection.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein the detecting the time-variable reflection signal indicative of the reflection extracts the time-variable reflection signal based at least in part upon the reflection.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein the detected attribute of the object is at least one of a color of the object, a translucence of the object, an opacity of the object, a reflectivity of the object and an absorptivity of the object.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein the detected attribute of the object dictates whether a finer or coarser scan pattern is required.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, further comprising:
detecting that the object is of a certain minimum size; and
responsive to the detection that the object is of the certain minimum size, varying the scan pattern to cover only a fraction of the region of interest.

### Claim 8

A non-transitory computer-readable recording medium having a program recorded thereon, the program, when executed by a computer, causes the computer to perform a method comprising:
coordinating (i) directing an emission cycle to a region of interest in accordance with a scan pattern, (ii) detecting a time-variable reflection signal indicative of a reflection of the emission cycle and (iii) acquiring images of the region of interest, the directing, detecting and acquiring being coordinated by controlling a variance of the scan pattern according to a detected attribute of an object, wherein the varied scan pattern varies intensities of the emission cycle according to the detected attribute of the object; and
processing the time-variable reflection signal and the images to (i) determine a presence of the object and object attributes and (ii) infer machine-control information from the object attributes.

### Claim 9 (depends on 8)

The non-transitory computer-readable recording medium of claim 8, wherein the acquiring the images implements one or more cameras to acquire the images of the region of interest.

### Claim 10 (depends on 8)

The non-transitory computer-readable recording medium of claim 8, wherein the detecting the time-variable reflection signal indicative of the reflection implements a photosensitive element to detect the reflection.

### Claim 11 (depends on 8)

The non-transitory computer-readable recording medium of claim 8, wherein the detecting the time-variable reflection signal indicative of the reflection extracts the time-variable reflection signal based at least in part upon the reflection.

### Claim 12 (depends on 8)

The non-transitory computer-readable recording medium of claim 8, wherein the detected attribute of the object is at least one of a color of the object, a translucence of the object, an opacity of the object, a reflectivity of the object and an absorptivity of the object.

### Claim 13 (depends on 12)

The non-transitory computer-readable recording medium of claim 12, wherein the detected attribute of the object dictates whether a finer or coarser scan pattern is required.

### Claim 14 (depends on 8)

The non-transitory computer-readable recording medium of claim 8, further comprising:
detecting that the object is of a certain minimum size; and
responsive to the detection that the object is of the certain minimum size, varying the scan pattern to cover only a fraction of the region of interest.

### Claim 15

A system for conducting machine control, the system comprising:
a controller including a processor configured to coordinate:
(i) directing an emission cycle to a region of interest in accordance with a scan pattern;
(ii) detecting a time-variable reflection signal indicative of a reflection of the emission cycle; and
(iii) acquiring images of the region of interest;
the directing, the detecting and the acquiring being coordinated by controlling a variance of the scan pattern according to a detected attribute of an object, wherein the varied scan pattern varies intensities of the emission cycle according to the detected attribute of the object; and
a computational facility including a processor configured to (i) process the time-variable reflection signal and the images to determine a presence of the object and object attributes and (ii) infer machine-control information from the object attributes.

### Claim 16 (depends on 15)

The system according to claim 15, wherein the acquiring the images implements one or more cameras configured to acquire the images of the region of interest.

### Claim 17 (depends on 15)

The system according to claim 15, wherein the detecting the time-variable reflection signal indicative of the reflection comprises a photosensitive element configured to detect the reflection.

### Claim 18 (depends on 15)

The system according to claim 15, wherein the detecting the time-variable reflection signal indicative of the reflection extracts the time-variable reflection signal based at least in part upon the reflection.

### Claim 19 (depends on 15)

The system of claim 15, wherein the processor configuration of the controller includes the detected attribute of the object is at least one of a color of the object, a translucence of the object, an opacity of the object, a reflectivity of the object and an absorptivity of the object.

### Claim 20 (depends on 15)

The system of claim 15, the processor configuration of the controller further comprising:
detecting that the object is of a certain minimum size; and
responsive to the detection that the object is of the certain minimum size, varying the scan pattern to cover only a fraction of the region of interest.
