# US 2023/0410342 A1 · Systems and methods for reconstructing objects using transitional images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410342 A1
- Document ID: US20230410342A1
- Status: Published application
- Kind: A1
- Application number: 18/459,332
- Filed: 2023-08-31
- Published: 2023-12-21
- Earliest claimed: 2020-06-30
- Assignees: BNSF Railway Company
- Applicants: BNSF Railway Company
- Inventors: Rachel Kohler
- Web page: https://patentgrep.com/patent/US20230410342A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/55: from multiple images
- G06T 7/12: Edge-based segmentation
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06T 2207/30236: Traffic on road, railway or crossing
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In one embodiment, a method includes receiving, by an object reconstruction module, a first image and a second image. The first image includes a first region of an object and the second image comprises a second region of the object. The method also includes identifying, by the object reconstruction module, a transitional image. The transitional image includes the first region of the object and the second region of the object. The method further includes determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are equivalent regions and generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image. The reconstruction of the object includes the first region of the object and the second region of the object and excludes equivalent regions.

## Claims

### Claim 1

A system for reconstructing objects using transitional images, comprising:
one or more processors; and
one or more computer-readable non-transitory storage media coupled to the one or more processors and comprising instructions that, when executed by the one or more processors, cause the apparatus to perform operations comprising:
capturing one or more images of an object, via a sensor, wherein the object is a transportation infrastructure component, a railway environment component, or a railroad track component;
detecting, via an object detection algorithm, an object within the images;
identifying at least a first portion of the object in a first image and construct a bounding box around the at least first portion of object in the first image;
identifying at least a second portion of the object in a second image and construct a bounding box around the at least second portion of object in the first image;
generating, via the one or more processors, transitional images from the images, wherein the transitional images share at least some pixels with at least some of the images and include one or more regions of the object;
determining equivalent regions between the images and one or more transitional images;
reconstructing the object, via the one or more processors, from at least some of the images and at least some of the transitional images; and
excluding the equivalent regions from the object reconstruction.

### Claim 2 (depends on 1)

The system of claim 1, wherein the object is a road, railway, airway, waterway, canal, pipeline, terminal component, railroad track, debris, pedestrian, animal, vegetation, joint, switch, frog, rail head, anchor, fastener, gage plate, ballast, or tie.

### Claim 3 (depends on 1)

The system of claim 1, wherein the images include one or more at least portions of the object.

### Claim 4 (depends on 1)

The system of claim 1, wherein the bounding box is an outline identifying the object.

### Claim 5 (depends on 1)

The system of claim 1, wherein at least one of the transitional images shares a predetermined percentage of pixels with at least one of the images.

### Claim 6 (depends on 1)

The system of claim 1, wherein the transitional images are generated by overlapping two or more images.

### Claim 7 (depends on 1)

The system of claim 1, wherein the equivalent region is a region within the images and the transitional image that share the same pixels.

### Claim 8 (depends on 1)

The method of claim 1, further comprising determining that at least one image and at least one transitional image both include a shared region of the object.

### Claim 9 (depends on 1)

The system of claim 1, wherein detection label equivalency or confidence score thresholds are used to determine that a first region of the object in a first transitional image and a first region of the object in the first image are equivalent regions.

### Claim 10 (depends on 1)

The system of claim 1, wherein the object reconstruction is a representation of the object in its entirety.

### Claim 11

A method for reconstructing objects using transitional images, comprising:
capturing one or more images of an object, via a sensor, wherein the object is a transportation infrastructure component, a railway environment component, or a railroad track component;
detecting, via an object detection algorithm, an object within the images;
identifying at least a first portion of the object in a first image and construct a bounding box around the at least first portion of object in the first image;
identifying at least a second portion of the object in a second image and construct a bounding box around the at least second portion of object in the first image;
generating transitional images from the images, wherein the transitional images share at least some pixels with at least some of the images and include one or more regions of the object;
determining equivalent regions between the images and one or more transitional images;
reconstructing the object from at least some of the images and at least some of the transitional images; and
excluding the equivalent regions from the object reconstruction.

### Claim 12 (depends on 11)

The method of claim 11, wherein the object is a road, railway, airway, waterway, canal, pipeline, terminal component, railroad track, debris, pedestrian, animal, vegetation, joint, switch, frog, rail head, anchor, fastener, gage plate, ballast, or tie.

### Claim 13 (depends on 11)

The method of claim 11, wherein the images include one or more at least portions of the object.

### Claim 14 (depends on 11)

The method of claim 11, wherein the bounding box is an outline identifying the object.

### Claim 15 (depends on 11)

The method of claim 11, wherein at least one of the transitional images shares a predetermined percentage of pixels with at least one of the images.

### Claim 16 (depends on 11)

The method of claim 11, wherein the transitional images are generated by overlapping two or more images.

### Claim 17 (depends on 11)

The method of claim 11, wherein the equivalent region is a region within the images and the transitional image that share the same pixels.

### Claim 18 (depends on 11)

The method of claim 11, further comprising determining that at least one image and at least one transitional image both include a shared region of the object.

### Claim 19 (depends on 11)

The method of claim 11, wherein detection label equivalency or confidence score thresholds are used to determine that a first region of the object in a first transitional image and a first region of the object in the first image are equivalent regions.

### Claim 20 (depends on 11)

The method of claim 11, wherein the object reconstruction is a representation of the object in its entirety.
