# US 2021/0232303 A1 · Control-Article-Based Control of a User Interface

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0232303 A1
- Document ID: US20210232303A1
- Status: Published application
- Kind: A1
- Application number: 17/227,964
- Filed: 2021-04-12
- Published: 2021-07-29
- Earliest claimed: 2016-05-16
- Assignees: Google Inc.
- Applicants: Google LLC
- Inventors: Ivan Poupyrev; Carsten C. Schwesig; Jack Schulze; Timo Arnall
- Web page: https://patentgrep.com/patent/US20210232303A1

## CPC

- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0485: Scrolling or panning
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods of providing gesture-based control of a user interface are provided. For instance, a presence of a control article can be detected in a first proximity zone proximate a user device. Responsive to detecting the presence of the control article, presentation data corresponding to a presentation mode of a user interface associated with the user computing device can be provided for display. A presence of the control article can be detected in a second proximity zone proximate the user computing device. The second proximity zone can define a separate physical area than the first proximity zone. Responsive to detecting the presence of the control article in the second proximity zone, interactive data corresponding to an interactive mode of the user interface can be provided for display.

## Claims

### Claim 1

A computing device comprising:
a radar module configured to detect a presence of a control article in first and second proximity zones proximate the computing system, the second proximity zone:
defining a separate physical area than the first proximity zone;
being adjacent to the first proximity zone; and
separating the first proximity zone and the computing system;
at least one processor; and
at least one memory device storing computer-readable instructions that, when executed by the processor causes the processor to perform operations comprising:
responsive to receiving an indication from the radar module that the control article is in the first proximity zone, causing display of a presentation mode of the user interface, the presentation mode comprising one or more presentation user interface elements; and
responsive to receiving an indication from the radar module that the control article is in the second proximity zone, causing display of an interactive mode of the user interface, the interactive mode comprising one or more interactive user interface elements without at least one of the presentation user interface elements.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein the non-interactive user interface elements are determined based on a location of the control article within the first proximity zone.

### Claim 3 (depends on 1)

The computing device of claim 1, wherein the user interface elements are determined based at least in part on a currently running application associated with the computing device.

### Claim 4 (depends on 1)

The computing device of claim 1, wherein the operations further comprise, responsive to not detecting the presence of the control article in the first or second proximity zone, causing display of a standby mode of the user interface, the standby mode comprising one or more standby user interface elements without at least one of the non-interactive user interface elements and without at least one of the interactive user interface elements.

### Claim 5 (depends on 4)

The computing device of claim 4, wherein at least one of the standby user interface elements is a clock face or time display.

### Claim 6 (depends on 1)

The computing device of claim 1, wherein the operations further comprise, responsive to detecting the presence of the control article in the second proximity zone, monitoring, via the radar module, for a performance of a control gesture by the control article.

### Claim 7 (depends on 6)

The computing device of claim 6, wherein the monitoring comprises:
determining, via the radar module, movement patterns associated with the control article; and
comparing the movement patterns to one or more predetermined control gestures.

### Claim 8 (depends on 7)

The computing device of claim 7, wherein the operations further comprise:
determining, via the radar module, a control gesture performed by the control article while the control article is located in the second proximity zone; and
performing at least one action based at least in part on the determined control gesture.

### Claim 9 (depends on 8)

The computing device of claim 8, wherein the at least one action comprises a control action associated with at least one of the interactive user interface elements.

### Claim 10 (depends on 9)

The computing device of claim 9, wherein:
the at least one interactive user interface element is one of a plurality of interactive user interface elements corresponding to respective applications; and
the control action scrolls through the interactive user interface elements.

### Claim 11

A computer-implemented method comprising:
detecting, via a radar module of a computing device, a presence of a control article in a first proximity zone proximate the computing device;
responsive to detecting the presence of the control article in the first proximity zone, causing display, by the computing device, of a presentation mode of a user interface, the presentation mode comprising one or more non-interactive user interface elements;
detecting, via the radar module of the computing device, a presence of the control article in a second proximity zone proximate the computing device, the second proximity zone defining a separate physical area than the first proximity zone, the first proximity zone being adjacent to the second proximity zone and the second proximity zone separating the first proximity zone and the computing device; and
responsive to detecting the presence of the control article in the second proximity zone, causing display, by the computing device, of an interactive mode of the user interface, the interactive mode comprising one or more interactive user interface elements without at least one of the non-interactive user interface elements.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the non-interactive user interface elements are determined based on a location of the control article within the first proximity zone.

### Claim 13 (depends on 11)

The computer-implemented method of claim 11, wherein the user interface elements are determined based at least in part on a currently running application associated with the computing device.

### Claim 14 (depends on 11)

The computer-implemented method of claim 11, further comprising, responsive to not detecting the presence of the control article in the first or second proximity zone, causing display, by the computing device, of a standby mode of the user interface, the standby mode comprising one or more standby user interface elements without at least one of the non-interactive user interface elements and without at least one of the interactive user interface elements.

### Claim 15 (depends on 14)

The computer-implemented method of claim 14, wherein at least one of the standby user interface elements is a clock face or time display.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, further comprising, responsive to detecting the presence of the control article in the second proximity zone, monitoring, via the radar module of the computing device, for a performance of a control gesture by the control article.

### Claim 17 (depends on 16)

The computer-implemented method of claim 16, wherein the monitoring comprises:
determining, via the radar module of the computing device, movement patterns associated with the control article; and
comparing, by the computing device, the movement patterns to one or more predetermined control gestures.

### Claim 18 (depends on 17)

The computer-implemented method of claim 17, further comprising:
determining, via the radar module of the computing device, a control gesture performed by the control article while the control article is located in the second proximity zone; and
performing, by the computing device, at least one action based at least in part on the determined control gesture.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, wherein the at least one action comprises a control action associated with at least one of the interactive user interface elements.

### Claim 20 (depends on 19)

The computer-implemented method of claim 19, wherein:
the at least one interactive user interface element is one of a plurality of interactive user interface elements corresponding to respective applications; and
the control action scrolls through the interactive user interface elements.
