# US 11,113,528 B2 · System and method for validating geospatial data collection with mediated reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,113,528 B2
- Document ID: US11113528B2
- Status: Granted
- Kind: B2
- Application number: 16/583,767
- Filed: 2019-09-26
- Published: 2021-04-01
- Granted: 2021-09-07
- Earliest claimed: 2019-09-26
- Applicants: Vgis Inc.
- Inventors: Alexandre Pestov
- Web page: https://patentgrep.com/patent/US11113528B2

## CPC

- G06V 20/20: in augmented reality scenes
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
- G06N 5/02: Knowledge representation; Symbolic representation
- G06T 1/0014: {Image feed-back for automatic industrial control, e.g. robot with camera (robots B25J19/023)}
- G06F 16/29: Geographical information databases
- G06V 2201/10: Recognition assisted with metadata
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There is provided a system and method of validating geospatial object data with mediated reality. The method including: receiving an object definition associated with a geospatial object, the object definition comprising a type of object and a position; displaying a visual representation of the geospatial object to a user relative to a corresponding geospatial object located in a physical scene; and receiving input validating a placement of the visual representation relative to the corresponding geospatial object located in the physical scene.

## Claims

### Claim 1

A computer-implemented method of positioning a geospatial object with a mediated reality device, the method comprising:
collecting a geospatial object comprising:
receiving, from a global navigation satellite systems (GNSS) receiver, GNSS position data based on wireless signals received from a GNSS satellite;
determining, based on the GNSS position data, a position of a geospatial object;
generating an object definition associated with the geospatial object, the object definition comprising the position of the geospatial object and a type of the geospatial object; and
storing the object definition in a data storage; and
immediately after collecting the geospatial object, displaying and verifying the position of the geospatial object, by:
determining an orientation of the mediated reality device in a physical scene;
determining relative positioning of the geospatial object in the physical scene based on the position of the geospatial object relative to the orientation of the mediated reality device;
displaying a visual representation of the geospatial object to a user on the mediated reality device using the relative positioning of the geospatial object in the physical scene for the user to verify positioning of the geospatial object; and
receiving input confirming a placement of the visual representation relative to the corresponding geospatial object located in the physical scene.

### Claim 2 (depends on 1)

The method of claim 1, wherein the position of the geospatial object in the object definition comprises latitude, longitude, and elevation.

### Claim 3 (depends on 2)

The method of claim 2, wherein the position of the geospatial object in the object definition comprises a point associated with the geospatial object.

### Claim 4 (depends on 3)

The method of claim 3, wherein the position of the geospatial object is determined using both global navigation satellite systems (GNSS) and real-time kinematic (RTK) positioning.

### Claim 5 (depends on 2)

The method of claim 2, wherein the orientation of the mediated reality device in the physical scene comprises latitude, longitude, elevation, and direction.

### Claim 6 (depends on 1)

The method of claim 1, wherein receiving input confirming the placement of the visual representation of the geospatial object comprises receiving a confirmatory input from a user.

### Claim 7 (depends on 1)

The method of claim 1, wherein receiving input confirming the placement of the visual representation of the geospatial object comprises receiving a confirmatory output from machine vision and artificial intelligence techniques.

### Claim 8 (depends on 1)

The method of claim 1, further comprising recording, in the object definition, the confirmed position associated with the geospatial object.

### Claim 9 (depends on 1)

The method of claim 1, wherein the visual representation comprises a virtual model of the geospatial object based on the type of object in the objection definition.

### Claim 10

A system of positioning a geospatial object with a mediated reality device, the system comprising one or more processors and data storage memory in communication with the one or more processors, the one or more processors configured to execute:
a recordation module to collect a geospatial object by receiving, from a global navigation satellite systems (GNSS) receiver, GNSS position data based on wireless signals received from a GNSS satellite and determine, based on the GNSS position data, a position of a geospatial object;
an object module to generate and store an object definition associated with the collected geospatial object in a data storage, the object definition comprising the position of the geospatial object and a type of the geospatial object;
a position module to determine an orientation of the mediated reality device in a physical scene and to determine relative positioning of the geospatial object in the physical scene based on the position of the geospatial object relative to the orientation of the mediated reality device;
a display module to, immediately after collecting the geospatial object, display a visual representation of the geospatial object to a user on the mediated reality device using the relative positioning of the geospatial object in the physical scene for the user to verify positioning of the geospatial object; and
a validation module to receive input confirming a placement of the visual representation relative to the corresponding geospatial object located in the physical scene.

### Claim 11 (depends on 10)

The system of claim 10, wherein the position of the geospatial object in the object definition comprises latitude, longitude, and elevation.

### Claim 12 (depends on 11)

The system of claim 11, wherein the position of the geospatial object in the object definition comprises a point associated with the geospatial object.

### Claim 13 (depends on 12)

The system of claim 12, wherein the position of the geospatial object is determined using both global navigation satellite systems (GNSS) and real-time kinematic (RTK) positioning.

### Claim 14 (depends on 11)

The system of claim 11, wherein the orientation of the mediated reality device in the physical scene comprises latitude, longitude, elevation, and direction.

### Claim 15 (depends on 10)

The system of claim 10, wherein receiving input confirming the placement of the visual representation of the geospatial object comprises receiving a confirmatory input from a user via an input device.

### Claim 16 (depends on 10)

The system of claim 10, wherein receiving input confirming the placement of the visual representation of the geospatial object comprises receiving a confirmatory output from machine vision and artificial intelligence techniques.

### Claim 17 (depends on 10)

The method of claim 10, wherein the recordation module further records, in the object definition, the confirmed position associated with the geospatial object.

### Claim 18 (depends on 10)

The system of claim 10, wherein the visual representation comprises a virtual model of the geospatial object based on the type of object in the objection definition.
