# US 2023/0067564 A1 · Virtual image display system and calibration method for pointing direction of controller thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0067564 A1
- Document ID: US20230067564A1
- Status: Published application
- Kind: A1
- Application number: 17/707,958
- Filed: 2022-03-30
- Published: 2023-03-02
- Earliest claimed: 2021-08-31
- Assignees: HTC Corporation
- Applicants: HTC Corporation
- Inventors: Chia-Chu Ho; Ching-Hao Lee
- Web page: https://patentgrep.com/patent/US20230067564A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/033: Pointing devices displaced or positioned by the user {, e.g. mice, trackballs, pens or joysticks}; Accessories therefor (digitisers characterised by the transducing means G06F3/041)
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A virtual image display system includes a virtual image display device and a hand-held control device. The virtual image display device is coupled to the hand-held control device. The hand-held control device is configured to capture image information of the virtual image display device and analyze the image information to obtain relative angle information between the virtual image display device and the hand-held control device. The virtual image display device adjusts a pointing direction of a displayed virtual hand-held control device image according to the relative angle information.

## Claims

### Claim 1

A virtual image display system, comprising:
a virtual image display device; and
a hand-held control device, coupled to the virtual image display device, wherein the hand-held control device is configured to:
capture image information of the virtual image display device; and
analyze the image information to obtain relative angle information between the virtual image display device and the hand-held control device,
wherein the virtual image display device adjusts a pointing direction of a virtual hand-held control device image that is displayed according to the relative angle information.

### Claim 2 (depends on 1)

The virtual image display system according to claim 1, wherein the hand-held control device analyzes the image information to obtain a first pointing direction of the hand-held control device and a second pointing direction of the virtual image display device, and the hand-held control device calculates an angle difference between the first pointing direction and the second pointing direction to obtain the relative angle information.

### Claim 3 (depends on 1)

The virtual image display system according to claim 1, wherein the relative angle information comprises a first included angle with a first axis of a spherical coordinate system and a second included angle with a second axis of the spherical coordinate system, and the first axis and the second axis are different.

### Claim 4 (depends on 1)

The virtual image display system according to claim 1, wherein the virtual image display device sets an initial pointing direction of the virtual hand-held control device image that is displayed according to first angle information.

### Claim 5 (depends on 4)

The virtual image display system according to claim 4, wherein the virtual image display device generates a current pointing direction of the virtual hand-held control device image according to control cursor movement generated by the hand-held control device.

### Claim 6 (depends on 5)

The virtual image display system according to claim 5, wherein the virtual image display device calculates a pointing angle offset value according to a relative relationship between the relative angle information and the first angle information, and adjusts the current pointing direction of the virtual hand-held control device image that is displayed to a calibrated pointing direction according to the pointing angle offset value.

### Claim 7

A calibration method for a pointing direction of a controller, adapted for a virtual image display system, comprising:
capturing image information of a virtual image display device by a hand-held control device as the controller;
analyzing the image information by the hand-held control device to obtain relative angle information between the virtual image display device and the hand-held control device; and
adjusting the pointing direction of a virtual hand-held control device image that is displayed according to the relative angle information by the virtual image display device.

### Claim 8 (depends on 7)

The calibration method for the pointing direction according to claim 7, wherein the step of analyzing the image information to obtain the relative angle information between the virtual image display device and the hand-held control device comprises:
analyzing the image information by the hand-held control device to obtain a first pointing direction of the hand-held control device and a second pointing direction of the virtual image display device; and
calculating an angle difference between the first pointing direction and the second pointing direction by the hand-held control device to obtain the relative angle information.

### Claim 9 (depends on 7)

The calibration method for the pointing direction according to claim 7, wherein the relative angle information comprises a first included angle with a first axis of a spherical coordinate system and a second included angle with a second axis of the spherical coordinate system, and the first axis and the second axis are different.

### Claim 10 (depends on 7)

The calibration method for the pointing direction according to claim 7, further comprising:
setting an initial pointing direction of the virtual hand-held control device image that is displayed according to first angle information by the virtual image display device.

### Claim 11 (depends on 7)

The calibration method for the pointing direction according to claim 7, further comprising:
generating a current pointing direction of the virtual hand-held control device image according to control cursor movement generated by the hand-held control device.

### Claim 12 (depends on 10)

The calibration method for the pointing direction according to claim 10, wherein the step of adjusting a pointing direction of the virtual hand-held control device image that is displayed according to the relative angle information by the virtual image display device comprises:
calculating a pointing angle offset value according to a relative relationship between the related angle information and the first angle information by the virtual image display device;
adjusting the current pointing direction of the virtual hand-held control device image that is displayed to a calibrated pointing direction according to the pointing angle offset value by the virtual image display device.
