# US 2022/0284738 A1 · Target user locking method and electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284738 A1
- Document ID: US20220284738A1
- Status: Published application
- Kind: A1
- Application number: 17/636,725
- Filed: 2020-08-04
- Published: 2022-09-08
- Earliest claimed: 2019-08-30
- Assignees: Huawei Technologies Co., Ltd.
- Applicants: Huawei Technologies Co., Ltd.
- Inventors: Lei HUANG; Xiaohan CHEN; Jie ZHAO; Jiejing HUANG; Yue LI
- Web page: https://patentgrep.com/patent/US20220284738A1

## CPC

- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/44: involving timing of operations, e.g. performing an action within a time slot
- A63F 13/79: involving player-related data, e.g. identities, accounts, preferences or play histories
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/251: {involving models}
- G06V 10/62: relating to a temporal dimension, e.g. time-based feature extraction; Pattern tracking
- G06V 40/172: {Classification, e.g. identification}
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G06V 40/50: Maintenance of biometric data or enrolment thereof
- A63F 13/814: Musical performances, e.g. by evaluating the player's ability to follow a notation
- A63F 13/816: Athletics, e.g. track-and-field sports
- G06T 2207/30196: Human being; Person
- G06T 2207/30201: Face
- G06T 2207/30221: Sports video; Sports image
- G06V 2201/07: Target detection
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Embodiments of this application provide a target user locking method and an electronic device, and relate to the field of electronic devices. The method provided in this application may be applied to an artificial intelligence (artificial intelligence, AI) fitness scenario, and can ensure accuracy of locking a target user. The electronic device may recognize the target user and track the target user in a fitness process by using a method such as recognizing a user feature, recognizing the user with reference to data collected by a wearable device worn by the user, or recognizing a motion mode of the user.

## Claims

### Claim 1

A target user locking method, wherein the method is applied to an electronic device comprising a camera, and the method comprises:
determining, by the electronic device, a target user, and tracking the target user through the camera;
tracking the target user, by the electronic device, user image data collected through the camera;
when determining, based on the collected user image data, that an interfering user exists in a frame, collecting, by the electronic device, human poses of all users in the frame through the camera, wherein the frame comprises at least some of a field of view FOV of the camera;
determining, by the electronic device, a motion mode of each user in the frame based on the human poses of all of the users in the frame; and
determining, by the electronic device based on the motion mode of each user in the frame, that a user whose motion mode matches a known motion mode is the target user, and continuing to track the target user through the camera.

### Claim 2 (depends on 1)

The method according to claim 1, wherein determining, by the electronic device based on the motion mode of each user in the frame, that the user whose motion mode matches a known motion mode is the target user, and continuing to track the target user through the camera comprises:
removing, by the electronic device based on the motion mode of each user in the frame, the interfering user whose motion mode is an interfering motion mode from the frame, wherein the interfering motion mode comprises at least one of a static mode and a quasi-linear motion mode; and
determining, by the electronic device, that a user whose motion mode matches the known motion mode is the target user, and continuing to track the target user through the camera.

### Claim 3 (depends on 1)

The method according to claim 1, wherein determining, based on the collected user image data, that the interfering user exists in the frame comprises:
determining, by the electronic device based on the collected user image data, that the interfering user exists in the frame.

### Claim 4 (depends on 1)

The method according to claim 1, wherein determining, by the electronic device, the target user comprises:
collecting, by the electronic device, the user image data through the camera; and
determining that only one user exists in the frame, and determining, by the electronic device based on the collected user image data, that the one user in the frame is the target user; or
determining that a plurality of users exist in the frame, and prompting, by the electronic device, the users in the frame to complete a target action, collecting human poses of the users in the frame through the camera, and determining that a user of the users in the frame whose human pose matches the target action in the frame is the target user.

### Claim 5 (depends on 1)

The method according to claim 1, wherein determining, by the electronic device, the target user comprises:
collecting, by the electronic device, the user image data through the camera; and
determining that only one user exists in the frame, and determining, by the electronic device based on the collected user image data, that the user in the frame is the target user; or
determining that a plurality of users exist in the frame, collecting, by the electronic device through the camera, face images of the users in the frame, and determining that a user of the users in the frame whose face image matches a stored face image is the target user.

### Claim 6 (depends on 5)

The method according to claim 5, wherein the method further comprises:
collecting, by the electronic device, the face image of the target user, and storing the face image of the target user in association with an account; and
determining that the user whose face image matches the stored face image in the frame is the target user comprises:
determining, by the electronic device, that the user whose face image matches the face image stored in association with the account in the frame is the target user.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the known motion mode comprises one or more of the following modes: cross-legged jump, left-right leg jump, hand-assisted squat, side-point punch, lateral knee lift, alternate lunge squat, lunge over-head high-five jump, semi-squat jump, standing with backward leg extension, squat lateral knee lift.

### Claim at position 8

8-13. (canceled)

### Claim 14

A target user locking method, wherein the method is applied to an electronic device comprising a camera, and the method comprises:
determining, by the electronic device, a target user;
determining, by the electronic device, a first wearable device of the target user, wherein the first wearable device of the target user establishes a wireless connection to the electronic device;
tracking the target user, by the electronic device and through the camera, wherein tracking the user includes collecting user image data;
determining, based on the user image data, an interfering user exists in a frame, and collecting, by the electronic device, human poses of all users in the frame through the camera, wherein the frame comprises at least some of a field of view (FOV) of the camera;
determining, by the electronic device, motion data of each user in the frame based on the human poses of the users in the frame; and
determining, by the electronic device based on the motion data of each user in the frame, that a user whose motion data matches motion data received from the first wearable device of the target user is the target user, and continuing to track the target user through the camera.

### Claim 15 (depends on 14)

The method according to claim 14, wherein determining, based on the collected user image data, that an interfering user exists in the frame comprises:
determining, by the electronic device based on the collected user image data, that the interfering user exists in the frame.

### Claim 16 (depends on 14)

The method according to claim 14, wherein before determining, by the electronic device, the target user, the method further comprises:
pairing, by the electronic device, with a second first wearable device and establishing a wireless connection, so that the second wearable device transmits the collected motion data of the user to the electronic device; and
the determining, by the electronic device, a target user comprises:
prompting, by the electronic device, the users to complete a target action, and collecting human poses of all the users in the frame through the camera; and
determining, by the electronic device based on the human poses of all the users in the frame, that a user whose human pose matches the target action in the frame is the target user; and
the determining, by the electronic device, the first wearable device of the target user comprises:
determining, by the electronic device based on the human pose of the target user, the motion data of the target user, and when the received motion data from the second wearable device matches the motion data of the target user, determining that the second wearable device is the first wearable device of the target user.

### Claim 17 (depends on 14)

The method according to claim 14, wherein determining, by the electronic device, the target user comprises:
collecting, by the electronic device, the user image data through the camera; and
determining that only one user exists in the frame, and determining, by the electronic device based on the collected user image data, that the one user in the frame is the target user; or
determining that a plurality of users exist in the frame, and collecting, by the electronic device through the camera, face images of the users in the frame, and determining that a user of the users in the frame whose face image matches a stored face image is the target user.

### Claim 18 (depends on 17)

The method according to claim 17, wherein the method further comprises:
collecting, by the electronic device, the face image of the target user, and storing the face image of the target user in association with an account; and
determining that the user whose face image matches the stored face image in the frame is the target user comprises:
determining, by the electronic device, that the user whose face image matches the face image stored in association with the account in the frame is the target user.

### Claim 19 (depends on 14)

The method according to claim 14, wherein determining, by the electronic device, the target user comprises:
collecting, by the electronic device, the user image data through the camera; and
determining that only one user exists in the frame, and determining, by the electronic device based on the collected user image data, that the user in the frame is the target user; or
determining that a plurality of users exist in the frame, prompting, by the electronic device, the users in the frame to complete a target action, collecting human poses of all the users in the frame through the camera, and determining that a user whose human pose matches the target action in the frame is the target user.

### Claim 20 (depends on 17)

The method according to claim 17, wherein determining, by the electronic device, the wearable device of the target user comprises:
determining, by the electronic device, that a wearable device associated with the electronic device is the wearable device of the target user, wherein
the wearable device is associated with the electronic device comprises: the wearable device and the electronic device log in to a same login account.

### Claim at position 16

21-23. (canceled)

### Claim 24

An electronic device, wherein the electronic device comprises a processor and a memory, the processor is coupled to the memory, the memory is configured to store computer program code, the computer program code comprises computer software instructions, and when the computer software instructions are executed by the electronic device, the electronic device is enabled to perform a method comprising:
collecting a first user image data;
determining human poses of users in a second user image data, wherein the second user image data comprises at least part of the first user image data;
determining a motion mode of each user of the users in the second user image data based on the human poses of the users;
determining, based on the motion mode of each user in the second user image data, that a user, of the users in the second user image data, whose motion mode matches a known motion mode is a first target user, and
tracking the first target user.

### Claim 25 (depends on 24)

The electronic device according to claim 24, the electronic device enabled to perform the method further comprising:
collecting a third user image data when tracking the first target user;
determining motion modes of users except the first target user in the third user image data;
determining, based on the motion modes in the third user image data, that a user whose motion mode matches a known motion mode is a second target user; and
tracking the first target user and the second target user.

### Claim 26 (depends on 24)

The electronic device according to claim 24, the electronic device enabled to perform the method further comprising, before collecting the first user image data:
displaying a first information, the first information used to prompt the first user to complete an action corresponding to the known motion mode.

### Claim 27 (depends on 26)

The electronic device according to claim 26, the electronic device enabled to perform the method further comprising:
collecting a fourth image data;
determining a number of users in the third image data is greater than one based on the fourth image data.

### Claim 28 (depends on 24)

The electronic device according to claim 24, wherein, the tracking the first target user further comprises:
collecting a third image data;
determining an action of the first target user based on the third image data; and
displaying a second information corresponding to the action of the first target user.

### Claim 29 (depends on 28)

The electronic device according to claim 28, the electronic device enabled to perform the method further comprising, before displaying the second information:
comparing the action and a known action corresponding to the action to generate a comparison result;
the second information comprising the comparison result.
