# US 2022/0284620 A1 · Information terminal apparatus and position recognition sharing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284620 A1
- Document ID: US20220284620A1
- Status: Published application
- Kind: A1
- Application number: 17/634,582
- Filed: 2019-09-20
- Published: 2022-09-08
- Earliest claimed: 2019-09-20
- Assignees: Maxell, Ltd.
- Applicants: Maxell, Ltd.
- Inventors: Yasunobu HASHIMOTO; Naohisa TAKAMIZAWA
- Web page: https://patentgrep.com/patent/US20220284620A1

## CPC

- G02B 27/0172: {characterised by optical features}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G02B 27/0176: {characterised by mechanical features}
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- H04W 4/026: {using orientation information, e.g. compass}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

An information terminal apparatus is capable of realizing position recognition sharing among terminals even where there is no suitable real object that becomes an anchor in a real space. An information terminal apparatus to be carried or worn by a user has a function of displaying an image and is configured to execute sharing of position recognition with another terminal in a real space. Sharing of the position information is executed by conversion between coordinate systems (WA) and (WB) of the terminals by using data containing specific direction information (NA, NB) in the real space of the own terminal and the other terminal and terminal position information (dA, dB, PBA, PAB) that is information regarding positions in the real space as data containing a relationship of relative orientation between the coordinate systems of the terminals and information regarding a relative positional relationship between origins of the coordinate systems.

## Claims

### Claim 1

An information terminal apparatus to be carried or worn by a user, the information terminal apparatus having a function of displaying an image on a display surface,
wherein the information terminal apparatus is used as a first terminal, and at least one other information terminal apparatus is used as a second terminal,
wherein, in a case where sharing of position recognition is to be executed between the first terminal and the second terminal in a real space, the sharing of the position recognition is executed by conversion between a first coordinate system of the first terminal and a second coordinate system of the second terminal by using data containing information regarding a relationship of relative orientation between the first coordinate system of the first terminal and the second coordinate system of the second terminal and information regarding a relative positional relationship between origins of the first and second coordinate systems.

### Claim 2 (depends on 1)

The information terminal apparatus according to claim 1,
wherein the information on the relative positional relationship between the origins of the first and second coordinate systems contains terminal position information that is information regarding positions of the first and second terminals.

### Claim 3 (depends on 1)

The information terminal apparatus according to claim 1,
wherein the information regarding the relationship relative orientation between the first and second coordinate systems contains specific direction information that is information regarding two specific directions of different orientations in the real space for the first and second terminals.

### Claim 4 (depends on 2)

The information terminal apparatus according to claim 2,
wherein the terminal position information contains information representing the position of the second terminal with respect to the first coordinate system and information representing the position of the first terminal with respect to the second coordinate system.

### Claim 5 (depends on 1)

The information terminal apparatus according to claim 1,
wherein the data contain information on a direction and a distance from a position of the first terminal to a position of the second terminal or information on a direction and a distance from the position of the second terminal to the position of the first terminal.

### Claim 6 (depends on 3)

The information terminal apparatus according to claim 3,
wherein the specific directions include a vertical downward direction or gravitational acceleration direction, or a terrestrial magnetism direction.

### Claim 7 (depends on 3)

The information terminal apparatus according to claim 3,
wherein the specific direction information contains information on a vertical downward direction or gravitational acceleration direction and information on a terrestrial magnetism direction.

### Claim 8 (depends on 1)

The information terminal apparatus according to claim 1,
wherein on the basis of the sharing of the position recognition, information for specifying a position in the real space is transmitted from the first terminal to the second terminal, or information for specifying a position in the real space is transmitted from the second terminal to the first terminal.

### Claim 9 (depends on 8)

The information terminal apparatus according to claim 8,
wherein the first terminal and the second terminal display a specified image at the specified position.

### Claim 10 (depends on 1)

The information terminal apparatus according to claim 1,
wherein the data are measured at timing that is matched between the first terminal and the second terminal,
wherein first data of the first terminal and second data of the second terminal are obtained, and a conversion parameter between the first coordinate system and the second coordinate system is generated using the first data and the second data, and
wherein with respect to positions in the real space, conversion is executed between a positional coordinate of the first coordinate system and a positional coordinate of the second coordinate system by using the conversion parameter.

### Claim 11 (depends on 5)

The information terminal apparatus according to claim 5,
wherein the information terminal apparatus comprises a distance measuring sensor,
wherein the direction and the distance from the position of the first terminal to the position of the second terminal are measured using the distance measuring sensor.

### Claim 12 (depends on 1)

The information terminal apparatus according to claim 1,
wherein, when the position recognition is to be shared, a coordinate system of the first terminal is reset, and the first coordinate system is newly set at a position of the first terminal, and
wherein a coordinate system of the second terminal is reset, and the second coordinate system is newly set at a position of the second terminal.

### Claim 13 (depends on 1)

The information terminal apparatus according to claim 1,
wherein, in a case where there are the first terminal, and the second terminal and a third terminal that are the other information terminal apparatuses as a plurality of information terminal apparatuses constituting a group that executes the sharing of the position recognition,
the sharing of the position recognition is executed between the second terminal and the third terminal, and the third terminal obtains first conversion parameter information regarding first conversion with the second terminal,
the sharing of the position recognition is executed between the first terminal and the third terminal, and the first terminal obtains second conversion parameter information regarding second conversion with the third terminal, and
the first terminal obtains third conversion parameter information for third conversion with the second terminal by using the first conversion parameter information obtained from the third terminal and the second conversion parameter information.

### Claim 14 (depends on 1)

The information terminal apparatus according to claim 1,
wherein, in a case where there are the first terminal, and the second terminal and a third terminal that are the other information terminal apparatuses as a plurality of information terminal apparatuses constituting a group that executes the sharing of the position recognition,
the first terminal is used as a representative terminal, and the first coordinate system is used as a reference for sharing the position recognition in the group,
the representative terminal or the second terminal obtains first conversion parameter information for first conversion between the representative terminal and the second terminal, and
the representative terminal or the third terminal obtains second conversion parameter information for second conversion between the representative terminal and the third terminal.

### Claim 15

A position recognition sharing method by an information terminal apparatus to be carried or worn by a user, the information terminal apparatus having a function of displaying an image on a display surface,
wherein the information terminal apparatus is used as a first terminal, and at least one other information terminal apparatus is used as a second terminal,
the position recognition sharing method comprising:
in a case where sharing of position recognition is to be executed between the first terminal and the second terminal in a real space, executing the sharing of the position recognition by conversion between a first coordinate system of the first terminal and a second coordinate system of the second terminal by using data containing information regarding a relationship of relative orientation between the first coordinate system of the first terminal and the second coordinate system of the second terminal and information regarding a relative positional relationship between origins of the first and second coordinate systems.
