# US 2025/0220151 A1 · System and method for correcting a mapping drift in an electronic device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0220151 A1
- Document ID: US20250220151A1
- Status: Published application
- Kind: A1
- Application number: 18/999,276
- Filed: 2024-12-23
- Published: 2025-07-03
- Earliest claimed: 2023-12-28
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Sujoy SAHA; Srikanth SRIDHAR; Rajas Jayant JOSHI; Sarthak SENGUPTA; Rajat Kumar JAIN
- Web page: https://patentgrep.com/patent/US20250220151A1

## CPC

- G06V 10/757: {Matching configurations of points or features}
- H04N 13/327: Calibration thereof
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06T 7/73: using feature-based methods
- G06T 7/75: {involving models}
- G06V 20/20: in augmented reality scenes
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 13/128: Adjusting depth or disparity
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method performed by an electronic device for correcting a mapping drift is provided. The method includes receiving, by the electronic device via one or more primary cameras of the electronic device, a first plurality of images associated with a scene, extracting, by the electronic device, a plurality of first feature points from each of the received first plurality of images, receiving, by the electronic device via one or more secondary cameras of the electronic device, a second plurality of images, extracting, by the electronic device, a plurality of second feature points from each of the received second plurality of images, wherein a field of view of the one or more secondary cameras overlaps with a field of view of the one or more primary cameras, computing, by the electronic device, a mapping drift in a primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points, and correcting, by the electronic device, the mapping drift in the primary map based on the computed mapping drift.

## Claims

### Claim 1

A method performed by an electronic device for correcting a mapping drift, the method comprising:
receiving, by the electronic device via one or more primary cameras of the electronic device, a first plurality of images associated with a scene;
extracting, by the electronic device, a plurality of first feature points from each of the received first plurality of images;
receiving, by the electronic device via one or more secondary cameras of the electronic device, a second plurality of images upon extracting the plurality of first feature points;
extracting, by the electronic device, a plurality of second feature points from each of the received second plurality of images, wherein a field of view of the one or more secondary cameras overlaps with a field of view of the one or more primary cameras;
computing, by the electronic device, a mapping drift in a primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points; and
correcting, by the electronic device, the mapping drift in the primary map based on the computed mapping drift.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
generating the primary map based on the received first plurality of images.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
generating a secondary map based on the received second plurality of images.

### Claim 4 (depends on 1)

The method of claim 1, wherein computing the mapping drift in the primary map comprises:
identifying a first relation based on comparison of a first set of two-dimensional (2D) position coordinates of the extracted plurality of first feature points with a second set of 2D position coordinates of the extracted plurality of second feature points;
identifying a second relation between a first set of three-dimensional (3D) position coordinates of the extracted plurality of first feature points and a second set of 3D position coordinates of the extracted plurality of second feature points based on the first relation;
calculating a difference between the first set of 3D position coordinates and the second set of 3D position coordinates based on the second relation; and
computing the mapping drift in the primary map based on the calculated difference between the first set of 3D position coordinates and the second set of 3D position coordinates.

### Claim 5 (depends on 4)

The method of claim 4,
wherein correcting the mapping drift in the primary map comprises:
updating, for correcting the mapping drift in the primary map, the position of the first set of 3D position coordinates based on the position of the second set of 3D position coordinates and the computed mapping drift in the primary map, and
wherein the mapping drift is corrected for each of the first plurality of images.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
receiving, via the one or more secondary cameras, a plurality of additional images associated with the scene, wherein the plurality of additional images are other than the first plurality of images associated with the scene;
extracting a plurality of additional feature points from each of the received plurality of additional images; and
computing a mapping drift in the primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points and the extracted plurality of additional images.

### Claim 7

An electronic device for correcting a mapping drift, the electronic device comprising:
one or more primary cameras;
memory storing one or more computer programs; and
one or more processors communicably coupled to the one or more primary cameras and the memory,
wherein the one or more computer programs include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
receive, via the one or more primary cameras, a first plurality of images associated with a scene,
extract a plurality of first feature points from each of the received first plurality of images,
receive, via one or more secondary cameras, a second plurality of images upon extracting the plurality of first feature points,
extract a plurality of second feature points from each of the received second plurality of images, a field of view of the one or more secondary cameras overlaps with a field of view of the one or more primary cameras,
compute a mapping drift in a primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points, and
correct the mapping drift in the primary map based on the computed mapping drift.

### Claim 8 (depends on 7)

The electronic device of claim 7, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
generate the primary map based on the received first plurality of images.

### Claim 9 (depends on 7)

The electronic device of claim 7, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
generate a secondary map based on the received second plurality of images.

### Claim 10 (depends on 7)

The electronic device of claim 7, wherein in computing the mapping drift in the primary map, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
identify a first relation based on comparison of a first set of two-dimensional (2D) position coordinates of the extracted plurality of first feature points with a second set of 2D position coordinates of the extracted plurality of second feature points;
identify a second relation between a first set of three-dimensional (3D) position coordinates of the extracted plurality of first feature points and a second set of 3D position coordinates of the extracted plurality of second feature points based on the first relation;
calculate a difference between the first set of 3D position coordinates and the second set of 3D position coordinates based on the second relation; and
compute the mapping drift in the primary map based on the calculated difference between the first set of 3D position coordinates and the second set of 3D position coordinates.

### Claim 11 (depends on 10)

The electronic device of claim 10,
wherein in correcting the mapping drift in the primary map, the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
update, for correcting the mapping drift in the primary map, the position of the first set of 3D position coordinates based on the position of the second set of 3D position coordinates and the computed mapping drift in the primary map, and
wherein the mapping drift is corrected for each of the first plurality of images.

### Claim 12 (depends on 7)

The electronic device of claim 7, wherein the one or more secondary cameras are reinitialized periodically for the scene.

### Claim 13 (depends on 7)

The electronic device of claim 7, wherein the one or more primary cameras are one or more simultaneous localization and mapping (SLAM) cameras.

### Claim 14 (depends on 7)

The electronic device of claim 7, wherein the one or more secondary cameras are one or more hand tracking cameras.

### Claim 15 (depends on 7)

The electronic device of claim 7, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
receive, via the one or more secondary cameras, a plurality of additional images associated with the scene, wherein the plurality of additional images are other than the first plurality of images associated with the scene;
extract a plurality of additional feature points from each of the received plurality of additional images; and
compute a mapping drift in the primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points and the extracted plurality of additional images.

### Claim 16 (depends on 7)

The electronic device of claim 7, wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:
before receiving the first plurality of images and the second plurality of images, estimate an initial state of a pair of visual inertial sensors.

### Claim 17 (depends on 16)

The electronic device of claim 16, wherein the estimation of the initial state of the pair of visual inertial sensors estimate velocity, gravity and bias of a gyroscope and an accelerometer.

### Claim 18 (depends on 17)

The electronic device of claim 17, wherein an inertial measurement unit (IMU) provides instantaneous angular velocity and linear acceleration of the electronic device.

### Claim 19

One or more non-transitory computer-readable storage media storing one or more computer programs including computer-executable instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to perform operations, the operations comprising:
receiving, by the electronic device via one or more primary cameras, a first plurality of images associated with a scene;
extracting, by the electronic device, a plurality of first feature points from each of the received first plurality of images;
receiving by the electronic device, via one or more secondary cameras of the electronic device, a second plurality of images upon extracting the plurality of first feature points;
extracting, by the electronic device, a plurality of second feature points from each of the received second plurality of images, wherein a field of view of the one or more secondary cameras overlaps with a field of view of the one or more primary cameras;
computing, by the electronic device, a mapping drift in a primary map associated with the first plurality of images by comparing position coordinates of the extracted plurality of first feature points with position coordinates of the extracted plurality of second feature points; and
correcting, by the electronic device, the mapping drift in the primary map based on the computed mapping drift.

### Claim 20 (depends on 19)

The one or more non-transitory computer-readable storage media of claim 19, the operations further comprising:
generating the primary map based on the received first plurality of images; and
generating a secondary map based on the received second plurality of images.
