# US 12,183,029 B2 · Device position correction method and device position correction system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,029 B2
- Document ID: US12183029B2
- Status: Granted
- Kind: B2
- Application number: 17/898,724
- Filed: 2022-08-30
- Published: 2023-08-24
- Granted: 2024-12-31
- Earliest claimed: 2022-02-18
- Assignees: HTC Corporation
- Applicants: HTC Corporation
- Inventors: Ting-Wei Lin; Min-Chia Wei
- Web page: https://patentgrep.com/patent/US12183029B2

## CPC

- G06T 7/73: using feature-based methods
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06V 10/34: Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
- G06V 40/11: {Hand-related biometrics; Hand pose recognition}
- G06V 10/40: Extraction of image or video features
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A device position correction method applicable to a wearable device is provided. The device position correction method includes the following steps. A wearable device image is received. An object detector detects the wearable device position, which is the position in the wearable device image. A limb detection model detects a plurality of skeleton points and a limb position, which is the position of a limb in the wearable device image, in order to determine which body part corresponds to the limb. According to the skeleton points and the limb position, correction information related to the wearable device position is generated.

## Claims

### Claim 1

A device position correction method, applicable to a wearable device, the device position correction method comprising:
receiving a wearable device image;
detecting a wearable device position in the wearable device image with an object detector;
detecting a plurality of skeleton points and a limb position of a limb in the wearable device image with a limb detection model to determine a body part corresponding to the limb; and
according to the skeleton points and the limb position, generating a correction information related to the wearable device position.

### Claim 2 (depends on 1)

The device position correction method of claim 1, further comprising:
accessing the object detector and the limb detection model stored in a storage device to execute the object detector and the limb detection model by a processor in a head-mounted display device.

### Claim 3 (depends on 1)

The device position correction method of claim 1, wherein a processor calculates a separation distance according to limb size and limb root;
wherein when a distance between the wearable device position and the limb root is equal to the separation distance, and the body part is within the preset range, the wearable device is being worn properly.

### Claim 4 (depends on 3)

The device position correction method of claim 3, wherein when the distance between the wearable device position and the limb root is shorter than the separation distance, the processor sends a message to calibrate the wearable device downward through an audio prompt or an image prompt.

### Claim 5 (depends on 3)

The device position correction method of claim 3, wherein when the distance between the wearable device position and the limb root is greater than the separation distance, the processor sends a message to calibrate the wearable device upward through an audio prompt or an image prompt.

### Claim 6 (depends on 1)

The device position correction method of claim 1, wherein when the limb detection model determines that the body part corresponding to the limb is a left limb, and a processor determines whether a position of a left limb wearable device is located on the left limb;
wherein when the processor determines that the position of the left limb wearable device is located on the left limb, and the left limb is within the preset range, a message indicating that it is being worn correctly is sent;
wherein when the processor determines that the position of the left limb wearable device is not located on the left limb, a message indicating that it is being worn incorrectly is sent.

### Claim 7 (depends on 6)

The device position correction method of claim 6, wherein when the processor determines that the position of the left limb wearable device is located on a right limb, the processor exchanges a first identification code corresponding to a left body wearable device with a second identification code corresponding to a right body wearable device in a replacement program.

### Claim 8 (depends on 6)

The device position correction method of claim 6, wherein when the processor determines that a position of a left body wearable device is located on a right limb, the processor exchanges a first feature code corresponding to the left body wearable device with a second feature code corresponding to a right body wearable device in a replacement program, to make sure that the first feature code records a right limb feature and the second feature code records a left limb feature.

### Claim 9 (depends on 6)

The device position correction method of claim 6, wherein when the processor determines that the position of a left body wearable device is located on a right limb, the processor sends out a device-being-worn-incorrectly left-to-right error audio prompt or a device being worn incorrectly left-to-right error image prompt.

### Claim 10 (depends on 6)

The device position correction method of claim 6, wherein when the processor determines that the position of the left body wearable device is located on a left limb, but the position of the left body wearable device is inverted, the processor sends out a device-being-worn-inverted audio prompt or a device-being-worn-inverted image prompt.

### Claim 11 (depends on 1)

The device position correction method of claim 1, wherein after the limb detection model detects the skeleton points of the limb in the wearable device image, a processor determines whether a distance between the wearable device position and a specific skeleton point is less than a specific distance;
wherein when the processor determines that the distance between the wearable device position and the specific skeleton point is not less than the specific distance, the processor sends a wearing error audio prompt or a wear error image prompt.

### Claim 12

A device position correction system, suitable for a wearable device, the device position correction system comprising:
a head-mounted display device (HMD), comprising:
a camera, configured to capture a wearable device image;
a storage device; and
a processor, configured to access an object detector and a limb detection model stored in the storage device to execute the object detector and the limb detection model; wherein the processor executes the following actions:
detect a wearable device position in the wearable device image using the object detector;
detect a plurality of skeleton points and a limb position of a limb in the wearable device image using the limb detection model to determine the body part corresponding to the limb; and
generate calibration information related the wearable device position according to the skeleton points and the limb position.

### Claim 13 (depends on 12)

The device position correction system of claim 12, wherein the processor calculates the separation distance according to limb size and limb root;
wherein when the distance between the wearable device position and the limb root is equal to the separation distance, and the body part is within the preset range, the wearable device is being worn properly.

### Claim 14 (depends on 13)

The device position correction system of claim 13, wherein when the distance between the wearable device position and the limb root is shorter than the separation distance, the processor sends a message to calibrate the wearable device downward through an audio prompt or an image prompt.

### Claim 15 (depends on 13)

The device position correction system of claim 13, wherein when the distance between the wearable device position and the limb root is greater than the separation distance, the processor sends a message to calibrate the wearable device upward through an audio prompt or an image prompt.

### Claim 16 (depends on 12)

The device position correction system of claim 12, wherein the limb detection model determines that the body part corresponding to the limb is a left limb, and a processor determines whether the position of a left limb wearable device is located on the left limb;
wherein when the processor determines that the position of the left limb wearable device is located on the left limb, and the left limb is within the preset range, a message indicating that it is being worn correctly is sent;
wherein when the processor determines that the position of the left limb wearable device is not located on the left limb, a message indicating that it is being worn incorrectly is sent.

### Claim 17 (depends on 16)

The device position correction system of claim 16, wherein when the processor determines that the position of the left limb wearable device is located on a right limb, the processor exchanges a first identification code corresponding to a left body wearable device with a second identification code corresponding to a right body wearable device in a replacement program.

### Claim 18 (depends on 16)

The device position correction system of claim 16, wherein when the processor determines that the position of a left body wearable device is located on a right limb, the processor exchanges a first feature code corresponding to the left body wearable device with a second feature code corresponding to a right body wearable device in a replacement program, to ensure the first feature code records a right limb feature and the second feature code records a left limb feature.

### Claim 19 (depends on 16)

The device position correction system of claim 16, wherein when the processor determines that the position of a left body wearable device is located on a right limb, the processor sends out a device-being-worn-incorrectly left-to-right error audio prompt or a device-being-worn-incorrectly left-to-right error image prompt.

### Claim 20 (depends on 16)

The device position correction system of claim 16, wherein when the processor determines that the position of the left body wearable device is located on a left limb, but the position of the left body wearable device is inverted, the processor sends out a device-being-worn-inverted audio prompt or a device-being-worn-inverted image prompt.

### Claim 21 (depends on 12)

The device position correction system of claim 12, wherein after the limb detection model detects the skeleton points of the limb in the wearable device image, a processor determines whether the distance between the wearable device position of the wearable device and a specific skeleton point is less than a specific distance;
wherein when the processor determines that the distance between the wearable device position and the specific skeleton point is not less than the specific distance, the processor sends a wearing error audio prompt or a wear error image prompt.
