# US 2024/0004603 A1 · Projection method and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004603 A1
- Document ID: US20240004603A1
- Status: Published application
- Kind: A1
- Application number: 18/254,998
- Filed: 2021-11-29
- Published: 2024-01-04
- Earliest claimed: 2020-11-30
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Kai QIAN; Weisong NIE; Manjie WANG
- Web page: https://patentgrep.com/patent/US20240004603A1

## CPC

- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- H04N 21/4122: {additional display device, e.g. video projector (digital output for controlling a plurality of local displays G06F3/1423)}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0485: Scrolling or panning
- H04N 21/41407: {embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop (constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57)}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- H04N 21/43637: {involving a wireless protocol, e.g. Bluetooth®, RF or wireless LAN [IEEE 802.11] (arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/485: End-user interface for client configuration
- G09G 2354/00: Aspects of interface with display user
- H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

Projection methods and systems are disclosed in this disclosure. In an implementation, a method includes: A first device that displays first content, detects a first gesture operation, and recognizes the detected first gesture operation, where the first gesture operation is a continuous and moving gesture operation; a second device detects the first gesture operation, and recognizes the detected first gesture operation, where the second device establishes a communication connection to the first device; if recognizing that the first gesture operation is a projecting gesture, the first device projects, to the second device, the first content displayed by the first device; and if recognizing that the first gesture operation is a projected gesture, the second device receives the first content projected by the first device, and displays the first content on the second device.

## Claims

### Claim at position 1

1-22. (canceled)

### Claim 23

A projection method comprising:
displaying, by a first device of a projection system, first content;
detecting, by the first device, a first gesture operation; recognizing, by the first device, the detected first gesture operation, wherein the first gesture operation is a continuous and moving gesture operation;
detecting, by a second device, the first gesture operation;
establishing, by the second device, a communication connection to the first device;
recognizing, by the second device, whether the detected first gesture operation is a projected gesture or a projecting gesture;
if the first gesture operation is a projected gesture:
receiving, by the second device, the first content projected by the first device; and
displaying the first content on the second device;
if the first gesture operation is a projecting gesture:
sending, by the first device, a handshake request to the second device to request to establish a communication connection to the second device;
receiving, by the second device, the handshake request sent by the first device, and sending a handshake confirmation message to the first device based on the handshake request to indicate that the communication connection between the first device and the second device is successfully established;
receiving, by the first device, the handshake confirmation message sent by the second device; and
projecting, by the first device to the second device through the communication connection, the first content displayed by the first device.

### Claim 24 (depends on 23)

The method according to claim 23, wherein the projecting, to the second device, the first content displayed by the first device comprises:
moving out, by the first device, the first content from a side of a display screen of the first device in a moving process of the first gesture operation, wherein a proportion of the first content that moves out from the display screen of the first device is associated with a movement distance of the first gesture operation relative to the first device.

### Claim 25 (depends on 23)

The method according to claim 23, wherein the receiving the first content projected by the first device, and displaying the first content on the second device comprises:
moving in, by the second device, the first content from a side of a display screen of the second device in a moving process of the first gesture operation, wherein a proportion of the first content to the display screen of the second device is associated with a movement distance of the first gesture operation relative to the second device.

### Claim 26 (depends on 24)

The method according to claim 24, wherein the moving out, by the first device, the first content from a side of a display screen of the first device in a moving process of the first gesture operation comprises:
determining, by the first device in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the first device; and
determining, by the first device based on the movement distance of the first gesture operation relative to the first device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the first device and a proportion of the first content that moves out from the display screen of the first device, the proportion of the first content that moves out from the display screen of the first device.

### Claim 27 (depends on 25)

The method according to claim 25, wherein the moving in, by the second device, the first content from a side of a display screen of the second device in a moving process of the first gesture operation comprises:
determining, by the second device in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the second device; and
determining, by the second device based on the movement distance of the first gesture operation relative to the second device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the second device and a proportion of the first content that moves in to the display screen of the second device, the proportion of the first content that moves in to the display screen of the second device.

### Claim 28 (depends on 23)

The method according to claim 23, wherein after recognizing the detected first gesture operation, the method further comprises:
sending, by the first device, a recognition result of the first gesture operation to the second device; and
receiving, by the second device, the recognition result of the first gesture operation sent by the first device.

### Claim 29 (depends on 24)

The method according to claim 24, wherein before the moving out the first content from a side of a display screen of the first device, the method further comprises:
determining, by the first device, a movement direction of the first gesture operation; and
determining, by the first device based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the first device, the side of the display screen of the first device and from which the first content is moved out.

### Claim 30 (depends on 25)

The method according to claim 25, wherein before the moving in the first content from a side of a display screen of the second device, the method further comprises:
determining, by the second device, a movement direction of the first gesture operation; and
determining, by the second device based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the second device, the side of the display screen of the second device and from which the first content is moved in.

### Claim 31 (depends on 23)

The method according to claim 23, wherein the projecting, to the second device, the first content displayed by the first device comprises one of:
performing, by the first device, screen recording on the first content displayed by the first device, and sending screen recording data to the second device;
obtaining, by the first device, streaming media data of the first content displayed by the first device, and sending the streaming media data to the second device; or
obtaining, by the first device, content-related information of the first content displayed by the first device, and sending the content-related information to the second device.

### Claim 32 (depends on 23)

The method according to claim 23, wherein the detecting, by the first device, a first gesture operation, and recognizing the detected first gesture operation comprises:
capturing, by the first device by using a photographing assembly, an image comprising the first gesture operation, and performing image analysis on the captured image to obtain a gesture recognition result; and
the detecting, by the second device, the first gesture operation, and recognizing the detected first gesture operation comprises:
capturing, by the second device by using a photographing assembly, an image comprising the first gesture operation, and performing image analysis on the captured image to obtain a gesture recognition result.

### Claim 33

A projection system, wherein the projection system comprises a first device and a second device;
the first device is configured to:
display first content;
detect a first gesture operation; and
recognize the detected first gesture operation, wherein the first gesture operation is a continuous and moving gesture operation;
the second device is configured to:
detect the first gesture operation;
establish a communication connection to the first device;
recognize whether the detected first gesture operation is a projected gesture or a projecting gesture, wherein the second device establishes a communication connection to the first device;
if recognizing that the first gesture operation is a projected gesture, the second device is further configured to:
receive the first content projected by the first device, and display the first content on the second device;
if recognizing that the first gesture operation is a projecting gesture:
the first device is configured to:
project, to the second device, the first content displayed by the first device; and
send a handshake request to the second device, wherein the handshake request is used to request to establish a communication connection to the second device;
the second device is further configured to:
receive the handshake request sent by the first device, and send a handshake confirmation message to the first device based on the handshake request, wherein the handshake confirmation message indicates that the communication connection between the first device and the second device is successfully established;
the first device is further configured to:
receive the handshake confirmation message sent by the second device; and
project, to the second device through the communication connection, the first content displayed by the first device.

### Claim 34 (depends on 33)

The projection system according to claim 33, wherein
the first device is configured to move out the first content from a side of a display screen of the first device in a moving process of the first gesture operation, wherein a proportion of the first content that moves out from the display screen of the first device is associated with a movement distance of the first gesture operation relative to the first device.

### Claim 35 (depends on 33)

The projection system according to claim 33, wherein
the second device is configured to move in the first content from a side of a display screen of the second device in a moving process of the first gesture operation, wherein a proportion of the first content to the display screen of the second device is associated with a movement distance of the first gesture operation relative to the second device.

### Claim 36 (depends on 34)

The projection system according to claim 34, wherein
the first device is configured to: determine, in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the first device; and determine, based on the movement distance of the first gesture operation relative to the first device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the first device and a proportion of the first content that moves out from the display screen of the first device, the proportion of the first content that moves out from the display screen of the first device.

### Claim 37 (depends on 35)

The projection system according to claim 35, wherein
the second device is configured to: determine, in the moving process of the first gesture operation, the movement distance of the first gesture operation relative to the second device; and determine, based on the movement distance of the first gesture operation relative to the second device, and a prestored mapping relationship between a movement distance of the first gesture operation relative to the second device and a proportion of the first content that moves in to the display screen of the second device, the proportion of the first content that moves in to the display screen of the second device.

### Claim 38 (depends on 33)

The projection system according to claim 33, wherein
the first device is further configured to send a recognition result of the first gesture operation to the second device; and
the second device is further configured to receive the recognition result that is of the first gesture operation sent by the first device.

### Claim 39 (depends on 34)

The projection system according to claim 34, wherein
the first device is further configured to: determine a movement direction of the first gesture operation; and determine, based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the first device, the side that is of the display screen of the first device and from which the first content is moved out.

### Claim 40 (depends on 35)

The projection system according to claim 35, wherein
the second device is further configured to: determine a movement direction of the first gesture operation; and determine, based on the movement direction of the first gesture operation and a prestored mapping relationship between a movement direction of the first gesture operation and each side of the display screen of the second device, the side of the display screen of the second device and from which the first content is moved in.

### Claim 41 (depends on 33)

The projection system according to claim 33, wherein
the first device is configured to:
perform screen recording on the first content displayed by the first device, and send screen recording data to the second device;
obtain streaming media data of the first content displayed by the first device, and send the streaming media data to the second device; or
obtain content-related information of the first content displayed by the first device, and send the content-related information to the second device.

### Claim 42 (depends on 33)

The projection system according to claim 33, wherein
the first device is configured to: capture, by using a photographing assembly, an image comprising the first gesture operation, and perform image analysis on the captured image to obtain a gesture recognition result; and
the second device is configured to: capture, by using a photographing assembly, an image comprising the first gesture operation, and perform image analysis on the captured image to obtain a gesture recognition result.
