# US 2025/0093163 A1 · Mapping in autonomous and non-autonomous platforms

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0093163 A1
- Document ID: US20250093163A1
- Status: Published application
- Kind: A1
- Application number: 18/965,927
- Filed: 2024-12-02
- Published: 2025-03-20
- Earliest claimed: 2016-08-29
- Assignees: Trifo, Inc.
- Applicants: Trifo, Inc.
- Inventors: Zhe ZHANG; Grace TSAI; Shaoshan LIU
- Web page: https://patentgrep.com/patent/US20250093163A1

## CPC

- G01C 21/206: {specially adapted for indoor navigation}
- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G05D 1/0246: {using a video camera in combination with image processing means}
- G05D 1/0274: {using mapping information stored in a memory device (navigation using map-matching G01C21/30)}
- G05D 1/246: using environment maps, e.g. simultaneous localisation and mapping [SLAM]
- G05D 1/249: from positioning sensors located off-board the vehicle, e.g. from cameras
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/579: from motion
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G01P 15/18: in two or more dimensions
- G06T 2207/30244: Camera pose
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01P: MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT (measuring or recording blood flow A61B5/02, A61B8/06; monitoring speed or deceleration of electrically-propelled vehicles B60L3/00; vehicle lighting systems adapted to indicate speed B60Q1/54; determining position or course in navigation, measuring ground distance in geodesy or surveying G01C; combined measuring devices for measuring two or more variables of movement G01C23/00; measuring velocity of sound G01H; measuring velocity of light G01J7/00; measuring direction or velocity of solid objects by reception or emission of radiowaves or other waves and based on propagation effects, e.g. Doppler effect, propagation time, direction of propagation, G01S; measuring speed of nuclear radiation G01T; measuring acceleration of gravity G01V; {measuring or recording the speed of trains B61L23/00; speed indicators incorporated in motor vehicles B60K35/00; measuring frequency or phase G01R; traffic control G08G})

## Abstract

The described positional awareness techniques employing visual-inertial sensory data gathering and analysis hardware with reference to specific example implementations implement improvements in the use of sensors, techniques and hardware design that can enable specific embodiments to provide positional awareness to machines with improved speed and accuracy.

## Claims

### Claim 1

A method for correcting at least some estimated poses and locations of at least some 3D points that define a map, the map used to provide guidance to a mobile platform, the method comprising:
determining for select 3D points in the map and within a field of view of a camera that captured at least one image data and location information and view information, a group identity selected from a set of: (i) a free point that is available to be refined; and (ii) a point that is not available to be refined; and
refining the map to correct at least some estimated poses and locations of at least some of the free points to provide guidance to the mobile platform.

### Claim 2 (depends on 1)

The method of claim 1, further comprising refining the map defined from 3D points corresponding to 2D features by:
selecting sets of at least some of image data and pose information of the map defined from 3D points;
reprojecting 3D points from the map into reprojected points on a 2D image plane using the pose information;
calculating image coordinates for the reprojected points on the 2D image plane and comparing the image coordinates calculated for the reprojected points on the 2D image plane to actual coordinates of corresponding observed points obtained directly from image data selected to compute a plurality of re-projection errors; and
minimizing a weighted sum of the re-projection errors for the sets of at least some of image data and pose information selected.

### Claim 3 (depends on 1)

The method of claim 1, wherein at least one instance of image data and location information and view information that is fixed maintains a global coordinate system for the map.

### Claim 4 (depends on 1)

The method of claim 1, further comprising apportioning freedom among instances of image data and location information and view information into “fixed” and “free” subsets whenever a new refinement process is applied to adjust at least some portion of the map.

### Claim 5 (depends on 1)

The method of claim 1, further comprising triggering refining the map at intervals of N seconds.

### Claim 6 (depends on 1)

The method of claim 1, further comprising selecting, from among a set comprised of image data and location information and view information for a camera that captured the image data, a first subset chosen at random and a second subset that (i) includes location information within a radius of at least one of the first subset and (ii) shares a field of view with the at least one of the first subset; wherein image data and location information and view information not selected comprise a set that are not available to be refined.

### Claim 7 (depends on 1)

The method of claim 1, wherein sufficiently distinct includes comprising triggering refining the map when a current pose is at least one of greater than 0.5 meter and greater than 40 degrees in comparison to a plurality of instances of image data and location information and view information in the map.

### Claim 8 (depends on 6)

The method of claim 6, wherein a 3D point that is within more than two instances of the image data and location information and view information, including at least one instance that is a member of the second subset free is a free point.

### Claim 9 (depends on 1)

The method of claim 1, wherein a 3D point that is within at most one instance of image data and location information and view information that is free is a semi-free point.

### Claim 10 (depends on 1)

The method of claim 1, wherein a 3D point that is within an instance of image data and location information and view information that is fixed is a fixed point.

### Claim 11

A non-transitory computer readable storage medium, storing instructions to correct at least some estimated poses and locations of at least some 3D points that define a map, the map used to provide guidance to a mobile platform, which instructions, when executed on one or more processors, implement actions comprising:
determining for select 3D points in the map and within a field of view of a camera that captured at least one instance of image data and location information and view information, a group identity selected from a set of: (i) a free point that is available to be refined; and (ii) a point that is not available to be refined; and
refining the map to correct at least some estimated poses and locations of at least some of the free points to provide guidance to the mobile platform.

### Claim 12 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further implementing actions comprising refining the map defined from 3D points corresponding to 2D features by:
selecting sets of at least some of image data and pose information of the map defined from 3D points;
reprojecting 3D points from the map into reprojected points on a 2D image plane using the pose information;
calculating image coordinates for the reprojected points on the 2D image plane and comparing the image coordinates calculated for the reprojected points on the 2D image plane to actual coordinates of corresponding observed points obtained directly from image data selected to compute a plurality of re-projection errors; and
minimizing a weighted sum of the re-projection errors for the sets of at least some of image data and pose information selected.

### Claim 13 (depends on 11)

The non-transitory computer readable storage medium of claim 11, wherein at least one instance of image data and location information and view information that is fixed maintains a global coordinate system for the map.

### Claim 14 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further implementing actions comprising apportioning freedom among instances of image data and location information and view information into “fixed” and “free” subsets whenever a new refinement process is applied to adjust at least some portion of the map.

### Claim 15 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further implementing actions comprising triggering refining the map at intervals of N seconds.

### Claim 16 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further including selecting, from among a set comprised of image data and location information and view information for a camera that captured the image data, a first subset chosen at random and a second subset that (i) includes location information within a radius of at least one of the first subset and (ii) shares a field of view with the at least one of the first subset; wherein image data and location information and view information not selected comprise a set that are not available to be refined.

### Claim 17 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further implementing actions comprising triggering refining the map when a current location or orientation and a last triggering pose is larger than a threshold that includes a movement of more than X meter or has changed orientation direction more than Y degree.

### Claim 18 (depends on 11)

The non-transitory computer readable storage medium of claim 11, further implementing actions comprising triggering refining the map when a current pose is at least one of greater than 0.5 meter and greater than 40 degrees in comparison to a plurality of instances of image data and location information and view information in the map.

### Claim 19 (depends on 16)

The non-transitory computer readable storage medium of claim 16,
wherein a 3D point that is within more than two instances of the image data and location information and view information, including at least one instance that is a member of the second subset free is a free point;
wherein a 3D point that is within at most one instance of image data and location information and view information that is free is a semi-free point; and
wherein a 3D point that is within an instance of image data and location information and view information that is fixed is a fixed point.

### Claim 20

A system, including:
one or more processors coupled to memory storing computer instructions for correcting at least some estimated poses and locations of at least some 3D points that define a map, the map used to provide guidance to a mobile platform, which computer instructions, when executed on the processors, implement actions comprising:
determining for select 3D points in the map and within a field of view of a camera that captured at least one instance of image data and location information and view information, a group identity selected from a set of: (i) a free point that is available to be refined; and (ii) a point that is not available to be refined; and
refining the map to correct at least some estimated poses and locations of at least some of the free points to provide guidance to the mobile platform.
