# US 10,455,351 B1 · Sharing geo-located information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,455,351 B1
- Document ID: US10455351B1
- Status: Granted
- Kind: B1
- Application number: 15/972,062
- Filed: 2018-05-04
- Published: 2019-11-07
- Granted: 2019-10-22
- Earliest claimed: 2018-05-04
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Kenneth Liam Kiemele; Donna Katherine Long; Bryant Daniel Hawthorne; Anthony Ernst; Kendall Clark York; Jeffrey Sipko; Janet Lynn Schneider; Christian Michael Sadak; Stephen G. Latta
- Web page: https://patentgrep.com/patent/US10455351B1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- H04W 4/02: Services making use of location information
- G02B 27/017: {Head mounted}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04W 4/029: Location-based management or tracking services
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- H04W 4/185: {by embedding added-value information into content, e.g. geo-tagging}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Examples are disclosed that relate to devices and methods for sharing geo-located information between different devices. In one example, a method comprises receiving the geo-located information from a first user device having a first data type compatible with a first output component of the device, receiving first sensor data from the first device, determining a location of the geo-located information within a coordinate system in a physical environment, determining that a second user device is located in the physical environment, determining that the second device does not comprise an output component that is compatible with the first data type, transforming the geo-located information into a second data type compatible with a second output component of the second device, determining that the second device is proximate to the location of the geo-located information, and sending the geo-located information to the second device for output by the second output component.

## Claims

### Claim 1

At a computing device, a method for sharing geo-located information in a physical environment between different devices, the method comprising:
receiving the geo-located information from a first user device in the physical environment, the geo-located information having a first data type that is compatible with a first output component of the first user device;
receiving first sensor data from a sensor of the first user device in the physical environment;
using at least the first sensor data, determining a location of the geo-located information within a coordinate system in the physical environment;
determining that a second user device is located in the physical environment;
determining that the second user device does not comprise an output component that is compatible with the first data type;
based on determining that the second user device does not comprise an output component compatible with the first data type, transforming the geo-located information from the first data type into a second data type that is compatible with a second output component of the second user device;
using data from a sensor of the second user device, determining that the second user device is located proximate to the location of the geo-located information in the physical environment; and
based on determining that the second user device is located proximate to the location of the geo-located information, sending the geo-located information in the second data type to the second user device for output by the second output component.

### Claim 2 (depends on 1)

The method of claim 1, wherein the coordinate system is a first coordinate system, the method further comprising:
using the data from the sensor of the second user device, determining a location of the second user device in a second coordinate system; and
wherein determining that the second user device is located proximate to the location of the geo-located information comprises mapping the location of the second user device in the second coordinate system to a location within the first coordinate system.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
using data from the sensor of the second user device, generating guidance data that guides a user of the second user device to the location of the geo-located information; and
sending the guidance data to the second user device for output by the second output component or a third output component of the second user device.

### Claim 4 (depends on 3)

The method of claim 3, wherein generating the guidance data comprises generating the guidance data in a third data type different from the first data type and the second data type.

### Claim 5 (depends on 4)

The method of claim 4, wherein the third data type comprises haptic signals and the third output component is a haptic component, and the haptic signals drive the haptic component to guide the user to the location of the geo-located information.

### Claim 6 (depends on 1)

The method of claim 1, wherein the data from the sensor of the second user device comprises temperature data, the location of the geo-located information is associated with a temperature range, and determining that the second user device is located proximate to the location of the geo-located information comprises determining that the temperature data falls within the temperature range.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
maintaining a database of temperatures at the location of the geo-located information; and
based on determining that the second user device is located proximate to the location of the geo-located information, using the temperature data from the second user device to update the database of temperatures.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first user device and the second user device are wearable devices.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first user device is a head-mounted display device, the first data type is holographic image data, and the second data type is either non-holographic image data or audio data.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first sensor data comprises one or more of depth images and stereo camera images, and the data from the sensor of the second user device comprises inertial data.

### Claim 11

A computing device for sharing geo-located information in a physical environment between different devices, comprising:
a processor; and
a memory holding instructions executable by the processor to,
receive the geo-located information from a first user device in the physical environment, the geo-located information having a first data type that is compatible with a first output component of the first user device;
receive first sensor data from a sensor of the first user device in the physical environment;
using at least the first sensor data, determine a location of the geo-located information within a coordinate system in the physical environment;
determine that a second user device is located in the physical environment;
determine that the second user device does not comprise an output component that is compatible with the first data type;
based on determining that the second user device does not comprise an output component that is compatible with the first data type, transform the geo-located information from the first data type into a second data type that is compatible with a second output component of the second user device;
using data from a sensor of the second user device, determine that the second user device is located proximate to the location of the geo-located information in the physical environment; and
based on determining that the second user device is located proximate to the location of the geo-located information, send the geo-located information in the second data type to the second user device for output by the second output component.

### Claim 12 (depends on 11)

The computing device of claim 11, wherein the coordinate system is a first coordinate system, and the instructions are further executable by the processor to:
using the data from the sensor of the second user device, determine a location of the second user device in a second coordinate system; and
wherein determining that the second user device is located proximate to the location of the geo-located information comprises mapping the location of the second user device in the second coordinate system to a location within the first coordinate system.

### Claim 13 (depends on 11)

The computing device of claim 11, wherein the instructions are further executable by the processor to:
using data from the sensor of the second user device, generate guidance data that guides a user of the second user device to the location of the geo-located information; and
send the guidance data to the second user device for output by the second output component or a third output component of the second user device.

### Claim 14 (depends on 13)

The computing device of claim 13, wherein generating the guidance data comprises generating the guidance data in a third data type different from the first data type and the second data type.

### Claim 15 (depends on 14)

The computing device of claim 14, wherein the third data type comprises haptic signals and the third output component is a haptic component, and the haptic signals drive the haptic component to guide the user to the location of the geo-located information.

### Claim 16 (depends on 11)

The computing device of claim 11, wherein the data from the sensor of the second user device comprises temperature data, the location of the geo-located information is associated with a temperature range, and determining that the second user device is located proximate to the location of the geo-located information comprises determining that the temperature data falls within the temperature range.

### Claim 17 (depends on 16)

The computing device of claim 16, wherein the instructions are further executable by the processor to:
maintain a database of temperatures at the location of the geo-located information; and
based on determining that the second user device is located proximate to the location of the geo-located information, use the temperature data from the second user device to update the database of temperatures.

### Claim 18 (depends on 11)

The computing device of claim 11, wherein the first user device and the second user device are wearable devices.

### Claim 19 (depends on 11)

The computing device of claim 11, wherein the first user device is a head-mounted display device, the first data type is holographic image data, and the second data type is either non-holographic image data or audio data.

### Claim 20

A head mounted display device, comprising:
a holographic display;
a processor; and
a memory holding instructions executable by the processor to,
generate geo-located information at a location within a coordinate system in a physical environment, the geo-located information having a first data type that is compatible with the holographic display;
determine that another device is located in the physical environment;
determine that the other device does not comprise an output component that is compatible with the first data type;
based on determining that the other device does not comprise an output component that is compatible with the first data type, transform the geo-located information from the first data type into a second data type that is compatible with an output component of the other device;
using data from a sensor of the other device, determine that the other device is located proximate to the location of the geo-located information in the physical environment; and
based on determining that the other device is located proximate to the location of the geo-located information, send the geo-located information in the second data type to the other device for output by the output component.
