# US 12,001,612 B2 · Air gesture-based interaction method and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,001,612 B2
- Document ID: US12001612B2
- Status: Granted
- Kind: B2
- Application number: 17/636,529
- Filed: 2020-08-18
- Published: 2022-08-25
- Granted: 2024-06-04
- Earliest claimed: 2019-08-19
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Yizhen Wu; Junwei Gou
- Web page: https://patentgrep.com/patent/US12001612B2

## CPC

- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0485: Scrolling or panning
- G06F 3/04855: Interaction with scrollbars
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An air gesture-based interaction method includes displaying, by an electronic device, a first display interface of a first application; detecting, by the electronic device by using a camera, a first air gesture input by a user; moving, by the electronic device, an indication icon on the first display interface along a moving trajectory of the first air gesture in a preset direction in response to the first air gesture; and displaying, by the electronic device, a second display interface of the first application in response to the first air gesture.

## Claims

### Claim 1

A method, comprising:
displaying a first display interface of a first application;
detecting a first air gesture from a user;
in response to detecting the first air gesture from the user:
displaying a first indication icon on a top or a bottom of the first display interface for sliding left or right;
moving the first indication icon in a first preset direction on the first display interface along a first moving trajectory of the first air gesture; and
sliding the first display interface of the first application to turn to a first page;
displaying a second display interface of a second application;
detecting a second air gesture from the user; and
in response to detecting the second air gesture from the user:
displaying a second indication icon on a side edge of the second display interface for sliding upward or downward;
moving the second indication icon in a second preset direction on the second display interface along a second moving trajectory of the second air gesture; and
sliding the second display interface of the second application to turn to a second page.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first moving trajectory is in a direction of an x-axis of a rectangular coordinate system, wherein the x-axis is a horizontal direction in which the first display interface displays content, and wherein the method further comprises:
obtaining a first moving distance of the first air gesture in the direction of the x-axis; and
moving, based on the first moving distance, the first indication icon in the direction of the x-axis on the first display interface.

### Claim 3 (depends on 1)

The method of claim 1, wherein the second moving trajectory is in a direction of a y-axis of a rectangular coordinate system, wherein the y-axis is a vertical direction in which the first display interface displays content, and wherein the method further comprises:
obtaining a first moving distance of the second air gesture in the direction of the y-axis; and
moving, based on the first moving distance, the second indication icon in the direction of the y-axis on the first display interface.

### Claim 4 (depends on 1)

The method of claim 1, wherein before detecting the first air gesture or the second air gesture from the user, the method further comprises:
detecting a preset gesture from the user for entering an air gesture operation mode; and
displaying, in response to the preset gesture, the first indication icon or the second indication icon at a preset position of the first display interface.

### Claim 5 (depends on 4)

The method of claim 4, wherein the preset position comprises the top, the bottom, or the side edge of the first display interface.

### Claim 6 (depends on 4)

The method of claim 4, wherein the preset gesture is a hover gesture, and wherein the method comprises detecting, using an image, that the user inputs the hover gesture.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
detecting a position at which the hover gesture hovers;
using the position as a start position; and
detecting the first air gesture based on the start position and the image.

### Claim 8 (depends on 4)

The method of claim 4, further comprising restoring displaying the first indication icon or the second indication icon at the preset position after the first air gesture or the second air gesture ends.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
reporting a sliding event to the first application based on a moving distance of the first air gesture along the first moving trajectory; and
displaying a third display interface corresponding to the sliding event.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
detecting a preset gesture from the user for exiting an air gesture operation mode; and
hiding, in response to the preset gesture, the first indication icon or the second indication icon.

### Claim 11 (depends on 1)

The method of claim 1, wherein the first indication icon or the second indication icon comprises a progress bar, a slider, a line segment, or an arc, and wherein the method further comprises sliding, extending, or enlarging the first indication icon or the second indication icon.

### Claim 12 (depends on 1)

The method of claim 1, wherein detecting the first air gesture and the second air gesture from the user comprises detecting, using an artificial intelligence (AI) engine, a first type of the first air gesture and a second type of the second air gesture.

### Claim 13

An apparatus, comprising:
a memory configured to store instructions; and
one or more processors coupled to the memory and configured to execute the instructions to:
display a first display interface of a first application;
detect a first air gesture from a user;
in response to detecting the first air gesture from the user:
display a first indication icon on a top or a bottom of the first display interface for sliding left or right;
move the first indication icon in a first preset direction on the first display interface along a first moving trajectory of the first air gesture; and
slide the first display interface of the first application to turn to a first page;
display a second display interface of a second application;
detect a second air gesture from the user; and
in response to detecting the second air gesture from the user:
display a second indication icon on a side edge of the second display interface for sliding upward or downward;
move the second indication icon in a second preset direction on the second display interface along a second moving trajectory of the second air gesture; and
slide the second display interface of the second application to turn to a second page.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the first moving trajectory is in a direction of an x-axis of a rectangular coordinate system, wherein the x-axis is a horizontal direction in which the first display interface displays content, and wherein the instructions further cause the one or more processors to:
obtain a first moving distance of the first air gesture in the direction of the x-axis; and
move, based on the first moving distance, the first indication icon in the direction of the x-axis on the first display interface.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein the second moving trajectory is in a direction of a y-axis of a rectangular coordinate system, wherein the y-axis is a vertical direction in which the first display interface displays content, and wherein the instructions further cause the one or more processors to:
obtain a first moving distance of the second air gesture in the direction of the y-axis; and
move, based on the first moving distance, the second indication icon in the direction of the y-axis on the first display interface.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein before detecting the first air gesture or the second air gesture from the user, the instructions further cause the one or more processors to:
detect a preset gesture from the user for entering an air gesture operation mode; and
display, in response to the preset gesture, the first indication icon or the second indication icon at a preset position of the first display interface.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the preset position comprises the top, the bottom, or the side edge of the first display interface.

### Claim 18 (depends on 16)

The apparatus of claim 16, wherein the preset gesture is a hover gesture, and wherein the instructions further cause the one or more processors to detect, using an image, that the user inputs the hover gesture.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the instructions further cause the one or more processors to:
detect a position at which the hover gesture hovers;
use the position as a start position; and
detect the first air gesture based on the start position and the image.

### Claim 20

A computer program product comprising computer-executable instructions stored on a non-transitory computer-readable medium that, when executed by one or more processors, cause an apparatus to:
display a first display interface of a first application;
detect a first air gesture from a user;
in response to detecting the first air gesture from the user:
display a first indication icon on a top or a bottom of the first display interface for sliding left or right;
move the first indication icon in a first preset direction on the first display interface along a first moving trajectory of the first air gesture; and
slide the first display interface of the first application to turn to a first page;
display a second display interface of a second application;
detect a second air gesture from the user; and
in response to detecting the second air gesture from the user:
display a second indication icon on a side edge of the second display interface for sliding upward or downward;
move the second indication icon in a second preset direction on the second display interface along a second moving trajectory of the second air gesture; and
slide the second display interface of the second application to turn to a second page.