# US 2023/0409126 A1 · Information processing device, information processing method, non-transitory computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0409126 A1
- Document ID: US20230409126A1
- Status: Published application
- Kind: A1
- Application number: 18/317,202
- Filed: 2023-05-15
- Published: 2023-12-21
- Earliest claimed: 2022-05-20
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Yu OKANO
- Web page: https://patentgrep.com/patent/US20230409126A1

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 9/453: {Help systems}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing device controls a display for displaying a guide that instructs a user to perform each of a plurality of patterns of motions including translational motions or rotational motions of an inertial sensor that correspond to a first axis and a second axis, which are perpendicular to each other. Based on inertial information and position and orientation information acquired by causing the inertial sensor to perform the plurality of patterns of motions, the information processing device acquires parameters including a degree of correlation between actual inertial values of the inertial sensor corresponding to the first axis and the inertial information corresponding to the second axis.

## Claims

### Claim 1

An information processing device comprising at least one memory and at least one processor which function as:
a first acquisition unit configured to acquire inertial information indicating inertial values, which are accelerations or angular velocities of an inertial sensor, from the inertial sensor;
a second acquisition unit configured to acquire position and orientation information indicating at least one of a position and an orientation of the inertial sensor;
a control unit for configured to control a display for displaying a guide that instructs a user to perform each of a plurality of patterns of motions including two translational motions or two rotational motions, the two translational motions including a translational motion of the inertial sensor corresponding to a first axis and a translational motion of the inertial sensor corresponding to a second axis perpendicular to the first axis, and the two rotational motions including a rotational motion of the inertial sensor corresponding to the first axis and a rotational motion of the inertial sensor corresponding to the second axis; and
a parameter acquisition unit configured to acquire parameters including a degree of correlation between actual inertial values of the inertial sensor corresponding to the first axis and the inertial information corresponding to the second axis, based on the inertial information and the position and orientation information acquired when the plurality of patterns of motions of the inertial sensor are performed.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the inertial sensor is mounted on a hand of the user,
the display displays a composite image in which a virtual object is placed in an image obtained by capturing a real space, and
the control unit controls the display to display the guide with which a guide point indicating a position to which the hand is to be moved is superimposed on the virtual object in the composite image.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the parameter acquisition unit acquires the parameters further including at least any of biases and gains of the inertial values of the inertial sensor, based on the inertial information and the position and orientation information acquired when the plurality of patterns of motions of the inertial sensor are performed.

### Claim 4 (depends on 1)

The information processing device according to claim 1, wherein
the second acquisition unit acquires the position and orientation information of the inertial sensor, based on an image obtained by capturing the inertial sensor.

### Claim 5 (depends on 1)

The information processing device according to claim 1, wherein
the plurality of patterns of motions includes a motion of drawing a loop, and
in a case where the second acquisition unit detects the motion of drawing a loop, the second acquisition unit adjusts the position and orientation information of the inertial sensor such that a trajectory of the position and orientation of the inertial sensor corresponding to the motion of drawing a loop draws a loop.

### Claim 6 (depends on 1)

The information processing device according to claim 1, wherein
the plurality of patterns of motions includes a first translational motion that translates the inertial sensor in a vertical direction and a second translational motion that translates the inertial sensor in a direction perpendicular to the vertical direction, and
the control unit controls the display to display a guide that instructs the user to perform the first translational motion and subsequently controls the display to display a guide that instructs the user to perform the second translational motion.

### Claim 7 (depends on 1)

The information processing device according to claim 1, wherein
the plurality of patterns of motions do not include a motion that translates the inertial sensor to a front-back direction of the user.

### Claim 8 (depends on 1)

The information processing device according to claim 1, wherein
the inertial sensor is worn by the user, and
the plurality of patterns of motions includes a rotational motion that rotates the inertial sensor by the user's rotation around a fixed position that is more than a specific distance away from the user.

### Claim 9 (depends on 1)

The information processing device according to claim 1, wherein
the at least one memory and the at least one processor further function as a monitoring unit configured to determine whether an environment, in which the inertial sensor is provided when the plurality of patterns of motions of the inertial sensor are performed, is a specific environment,
in a case where the environment is the specific environment, the control unit controls the display to display the guide again, and
the parameter acquisition unit acquires the parameters, based on the inertial information and the position and orientation information acquired when the plurality of patterns of motions instructed by the guide displayed again are performed.

### Claim 10

An information processing method, comprising:
a first acquiring step of acquiring inertial information indicating inertial values, which are accelerations or angular velocities of an inertial sensor, from the inertial sensor;
a second acquiring step of acquiring position and orientation information indicating at least one of a position and an orientation of the inertial sensor;
a controlling step of controlling a display for displaying a guide that instructs a user to perform each of a plurality of patterns of motions including two translational motions or two rotational motions, the two translational motions including a translational motion of the inertial sensor corresponding to a first axis and a translational motion of the inertial sensor corresponding to a second axis perpendicular to the first axis, and the two rotational motions including a rotational motion of the inertial sensor corresponding to the first axis and a rotational motion of the inertial sensor corresponding to the second axis; and
a parameter acquiring step of acquiring parameters including a degree of correlation between actual inertial values of the inertial sensor corresponding to the first axis and the inertial information corresponding to the second axis, based on the inertial information and the position and orientation information acquired when the plurality of patterns of motions of the inertial sensor are performed.

### Claim 11

A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute an information processing method,
wherein the information processing method includes:
a first acquiring step of acquiring inertial information indicating inertial values, which are accelerations or angular velocities of an inertial sensor, from the inertial sensor;
a second acquiring step of acquiring position and orientation information indicating at least one of a position and an orientation of the inertial sensor;
a controlling step of controlling a display for displaying a guide that instructs a user to perform each of a plurality of patterns of motions including two translational motions or two rotational motions, the two translational motions including a translational motion of the inertial sensor corresponding to a first axis and a translational motion of the inertial sensor corresponding to a second axis perpendicular to the first axis, and the two rotational motions including a rotational motion of the inertial sensor corresponding to the first axis and a rotational motion of the inertial sensor corresponding to the second axis; and
a parameter acquiring step of acquiring parameters including a degree of correlation between actual inertial values of the inertial sensor corresponding to the first axis and the inertial information corresponding to the second axis, based on the inertial information and the position and orientation information acquired when the plurality of patterns of motions of the inertial sensor are performed.
