# US 2024/0201845 A1 · Contactless human-machine interface for displays

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0201845 A1
- Document ID: US20240201845A1
- Status: Published application
- Kind: A1
- Application number: 18/323,712
- Filed: 2023-05-25
- Published: 2024-06-20
- Earliest claimed: 2022-12-14
- Assignees: NXP B.V.
- Applicants: NXP B.V.
- Inventors: Phani Pavan Kishore Uppuluri
- Web page: https://patentgrep.com/patent/US20240201845A1

## CPC

- G01S 13/0209: {Systems with very large relative bandwidth, i.e. larger than 10 %, e.g. baseband, pulse, carrier-free, ultrawideband}
- G06F 3/04892: Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key (arrangements for controlling cursor position based on coordinate signals G06F3/038)
- G01S 13/06: Systems determining position data of a target
- G01S 13/44: Monopulse radar, i.e. simultaneous lobing
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0485: Scrolling or panning
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An apparatus including a processor and an object detector is provided. The object detector detects a position of an object inside a field of view (FOV) of the object detector. The processor splits the FOV into one or more FOV sectors based on one or more options on a display. Further, the processor maps each of the one or more options uniquely to an FOV sector of the one or more FOV sectors. The processor further controls a movement of a pointer on the display to point to an option of the one or more options of which the mapped FOV sector includes the detected position of the object, thereby enabling contactless control of the display.

## Claims

### Claim 1

An apparatus, comprising:
an object detector configured to detect a position of an object with respect to the object detector; and
a processor that is coupled to the object detector, and configured to:
split a field of view (FOV) of the object detector into one or more FOV sectors based on one or more options on a display;
map each of the one or more options uniquely to an FOV sector of the one or more FOV sectors; and
control a movement of a pointer on the display to point to a first option of the one or more options of which the mapped FOV sector includes the detected position of the object.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the object detector includes at least one of a group consisting of (i) one or more ultra-wideband (UWB) radio detection and ranging (RADAR) transceivers, (ii) one or more moving target indication RADAR transceivers, (iii) one or more continuous wave RADAR transceivers, (iv) one or more frequency modulated wave RADAR transceivers, (v) one or more pulsed RADAR transceivers, and (vi) one or more Doppler effect RADAR transceivers.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the detected position corresponds to a horizontal angle and a vertical angle of the object with respect to the object detector.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the FOV comprises a horizontal angle range and a vertical angle range of the object detector, wherein to split the FOV into the one or more FOV sectors, the processor is further configured to split the horizontal angle range into one or more horizontal angle sub-ranges and the vertical angle range into one or more vertical angle sub-ranges, based on the one or more options, and wherein each FOV sector of the one or more FOV sectors comprises a unique combination of a horizontal angle sub-range of the one or more horizontal angle sub-ranges and a vertical angle sub-range of the one or more vertical angle sub-ranges.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the one or more options are arranged on the display in one or more rows and one or more columns.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the processor splits (i) the horizontal angle range into the one or more horizontal angle sub-ranges based on a count of the one or more columns in which the one or more options are arranged on the display, and (ii) the vertical angle range into the one or more vertical angle sub-ranges based on a count of the one or more rows in which the one or more options are arranged on the display.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to control the movement of the pointer on the display to shift the pointer from the first option to a second option of the one or more options based on a change in the position of the object in at least one of a group consisting of a horizontal plane and a vertical plane.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the one or more options include one or more graphical user interface (GUI) elements.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the one or more options include at least one of a group consisting of a left scroll option, a right scroll option, an upward scroll option, and a downward scroll option, and wherein the processor is further configured to perform one of a group consisting of (i) a left scroll action on the display when the first option corresponds to the left scroll option, (ii) a right scroll action on the display when the first option corresponds to the right scroll option, (iii) an upward scroll action on the display when the first option corresponds to the upward scroll option, and (iv) a downward scroll action on the display when the first option corresponds to the downward scroll option.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the object detector is further configured to initiate the detection of the position of the object based on the object being within a threshold distance from the object detector.

### Claim 11 (depends on 10)

The apparatus of claim 10, wherein the object detector is further configured to initiate the detection of the position of the object based on a time duration for which the object is within the threshold distance, exceeding a threshold time duration.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the object detector is further configured to detect a forward movement and a backward movement of the object with respect to the object detector based on a change of distance between the object and the object detector, and wherein the forward movement and the backward movement are detected after the pointer points to the first option.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein the processor is further configured to perform a select action for the first option based on the detection of the forward movement and the backward movement within a defined time duration.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the object detector is further configured to select the object from a plurality of objects that are within the FOV of the object detector based on the object being nearest to the object detector among the plurality of objects.

### Claim 15 (depends on 1)

The apparatus of claim 1, wherein the apparatus is a plug-and-play apparatus that interfaces with the display and functions as a contactless human-machine interface for the display.

### Claim 16

A method, comprising:
detecting, by an object detector of an apparatus, a position of an object with respect to the object detector;
splitting, by a processor of the apparatus, a field of view (FOV) of the object detector into one or more FOV sectors based on one or more options on a display;
mapping, by the processor, each of the one or more options uniquely to an FOV sector of the one or more FOV sectors; and
controlling, by the processor, a movement of a pointer on the display to point to a first option of the one or more options of which the mapped FOV sector includes the detected position of the object.

### Claim 17 (depends on 16)

The method of claim 16, further comprising controlling, by the processor, the movement of the pointer on the display to shift the pointer from the first option to a second option of the one or more options based on a change in the position of the object in at least one of a group consisting of a horizontal plane and a vertical plane.

### Claim 18 (depends on 16)

The method of claim 16, further comprising:
detecting, by the object detector, a forward movement and a backward movement of the object with respect to the object detector based on a change of distance between the object and the object detector, wherein the forward movement and the backward movement are detected after the pointer points to the first option; and
performing, by the processor, a select action for the first option based on the detection of the forward movement and the backward movement within a defined time duration.

### Claim 19 (depends on 16)

The method of claim 16, wherein the FOV is split into the one or more FOV sectors further based on at least one of a group consisting of (i) a count of one or more columns in which the one or more options are arranged on the display and (ii) a count of one or more rows in which the one or more options are arranged on the display.

### Claim 20

An apparatus, comprising:
a display configured to display one or more options;
an object detector configured to detect a position of an object with respect to the object detector; and
a processor that is coupled to the object detector and the display, and configured to:
split a field of view (FOV) of the object detector into one or more FOV sectors based on the one or more options on the display;
map each of the one or more options uniquely to an FOV sector of the one or more FOV sectors; and
control a movement of a pointer on the display to point to a first option of the one or more options of which the mapped FOV sector includes the detected position of the object.
