# US 2025/0028383 A1 · Information processing apparatus for achieving cross reality, control method therefor, and storage medium storing control program therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0028383 A1
- Document ID: US20250028383A1
- Status: Published application
- Kind: A1
- Application number: 18/758,752
- Filed: 2024-06-28
- Published: 2025-01-23
- Earliest claimed: 2023-07-20
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: KOHEI SHOGOME
- Web page: https://patentgrep.com/patent/US20250028383A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An information processing apparatus capable of promoting utilization of an input device used for operations in the XR. The information processing apparatus includes a memory device that stores a set of instructions, and at least one processor that executes the set of instructions to: detect an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality, and determine the holding hand based on the re-holding action detected.

## Claims

### Claim 1

An information processing apparatus comprising:
a memory device that stores a set of instructions; and
at least one processor that executes the set of instructions to:
detect an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality; and
determine the holding hand based on the re-holding action detected.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, wherein detection of the re-holding action and determination of the holding hand are performed based on a position of the input device and a position of a user's hand tracked by image recognition using a reality image from a user's viewpoint or a third person's viewpoint.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the detection of the re-holding action and the determination of the holding hand are performed by comparing a distance from the input device to the user's hand with a threshold.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3, wherein the at least one processor executes instructions in the memory device to determine that a hand having a shorter distance from the input device is the holding hand in a case where both user's hands can be determined to be the holding hand.

### Claim 5 (depends on 2)

The information processing apparatus according to claim 2, wherein the at least one processor executes instructions in the memory device to use a position of a gravity center of the user's hand or a position of a joint of the user's hand as the position of the user's hand tracked by the image recognition.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2, wherein the image recognition is performed by using infrared light.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1, wherein detection of the re-holding action and determination of the holding hand are performed based on an obtained result of an acceleration or a speed of the input device.

### Claim 8 (depends on 7)

The information processing apparatus according to claim 7, wherein the detection of the re-holding action and the determination of the holding hand are performed by detecting a characteristic of an acceleration change or a speed change occurred when the input device collides with a palm or a finger of the user from the obtained result of the acceleration or the speed of the input device.

### Claim 9 (depends on 8)

The information processing apparatus according to claim 8, wherein the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user is detected using machine learning or deep learning.

### Claim 10 (depends on 8)

The information processing apparatus according to claim 8, wherein the at least one processor executes instructions in the memory device to treat an acceleration change or a speed change of the input device in end of holding of the input device by the user as the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user.

### Claim 11 (depends on 8)

The information processing apparatus according to claim 8, wherein the at least one processor executes instructions in the memory device to treat an acceleration change or a speed change of the input device from start of holding to end of holding of the input device by the user as the characteristic of the acceleration change or the speed change of the input device occurred when the input device collides with the palm or the finger of the user.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1, wherein detection of the re-holding action and determination of the holding hand are performed based on an obtained result of an angular speed or an angle of the input device.

### Claim 13 (depends on 12)

The information processing apparatus according to claim 12, wherein the detection of the re-holding action and the determination of the holding hand are performed by detecting a characteristic of an angular speed change or an angular change of the input device occurred when the input device is rotated by the user from an obtained result of the angular speed or the angle.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13, wherein the at least one processor executes instructions in the memory device to detect the characteristic of the angular speed change or the angular change of the input device occurred when the user rotates the input device using machine learning or deep learning.

### Claim 15 (depends on 1)

The information processing apparatus according to claim 1, wherein the at least one processor executes instructions in the memory device to:
determine a use status of the input device; and
allocate input functions to input members of the input device according to the holding hand determined and the use status determined.

### Claim 16 (depends on 15)

The information processing apparatus according to claim 15, wherein the use status includes information regarding to a use form of the input device in the cross reality.

### Claim 17

A control method for an information processing apparatus, comprising:
detecting an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality; and
determining the holding hand based on the re-holding action detected.

### Claim 18 (depends on 17)

The control method for the information processing apparatus according to claim 17, further comprising:
determining a use status of the input device; and
allocating input functions to input members of the input device in accordance with the holding hand determined and the use status determined.

### Claim 19

A non-transitory computer-readable storage medium storing a control program causing a computer to execute a control method for an image processing apparatus, the control method comprising:
detecting an action of a user to change a holding hand that holds an input device as a re-holding action when the user holds the input device that allows a one-hand operation in cross reality; and
determining the holding hand based on the re-holding action detected.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium according to claim 19, wherein the control method further comprises:
determining a use status of the input device; and
allocating input functions to input members of the input device in accordance with the holding hand determined and the use status determined.
