# US 2023/0069019 A1 · Reality model object recognition using cross-sections

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0069019 A1
- Document ID: US20230069019A1
- Status: Published application
- Kind: A1
- Application number: 17/887,436
- Filed: 2022-08-13
- Published: 2023-03-02
- Earliest claimed: 2021-08-13
- Assignees: Skyyfish, LLC
- Applicants: Skyyfish LLC
- Inventors: Orest Jacob Pilskalns
- Web page: https://patentgrep.com/patent/US20230069019A1

## CPC

- G06T 7/0004: {Industrial image inspection}
- G06T 7/50: Depth or shape recovery
- G01B 11/2545: {with one projection direction and several detection directions, e.g. stereo}
- G01S 17/89: for mapping or imaging
- G06T 7/73: using feature-based methods
- G06V 20/64: Three-dimensional [3D] objects
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A reality-based model object recognition system using cross-sections includes using photogrammetry to obtain various views of a 3-dimensional (3D) object (e.g. 3D model, 3D reality model, mesh, etc.). The process then generates 2-dimensional (2D) slices, i.e. cross-sections, of the 3D object at various elevations and angles. The relation between the slices is critical for identification. The 2D slices are used as building blocks for automatic recognition and identification and location (e.g. x,y,z+angle) of a real-world equipment mounted on the 3D object and identifying any anomaly in the equipment so that remedial action may be ordered, if needed.

## Claims

### Claim 1

An object recognition method using reality-based modelling comprising:
locating a 3-Dimensional (3D) model generated by photogrammetry, lidar or other scanning techniques that generate 3D models including point clouds, meshes and reality models);
defining one or more reference points or planes in said 3D model;
generating outputs comprising a plurality of 2-Dimensional (2D) slices of the 3D model at various elevations;
adding said plurality of 2D slices at various angles to a library;
identifying one or more dense centers with critical components on the 3D model;
applying pattern matching to identify the critical components from said library;
identifying one or more pieces of equipment in said 3D model by correlating said identified one or more critical components with real world standard objects; and
generating a report of said 3D model comprising said one or more pieces of equipment.

### Claim 2 (depends on 1)

The object recognition method of claim 1, wherein said one or more reference points comprises a base metal or some well-known reference point or plane, center of top and the bottom of said 3D object.

### Claim 3 (depends on 1)

The object recognition method of claim 1, wherein said library comprises 2D cross section snapshots of computer aided design (CAD) outputs of various real-world objects, the reality outputs, and/or original photographs of said 3D model.

### Claim 4 (depends on 1)

The object recognition method of claim 1, wherein said 3D model is a cellular tower or other piece of infrastructure.

### Claim 5 (depends on 1)

The object recognition method of claim 1, wherein said report comprises real-world identity, dimensional information, material of said one or more mounted equipment and their location on said 3D model.

### Claim 6 (depends on 1)

The object recognition method of claim 1, further comprising recognizing anomaly in at least one of said one or more mounted equipment and ordering remedial action.

### Claim 7 (depends on 1)

The object recognition method of claim 1, wherein said photogrammetry, lidar scan, or other capture technique (or a combination of techniques) is performed by one or more drones.

### Claim 8

A computer program product for reality-based object recognition, the computer program product comprising non-transitory computer-readable media encoded with instructions for execution by a processor to perform a method comprising:
locating a 3-Dimensional (3D) objects within a 3D model generated by photogrammetry or other scanning techniques such as lidar or combinations thereof;
defining one or more reference points in said 3D object;
generating a plurality of 2-Dimensional (2D) slices from within the 3D model at various elevations;
adding said plurality of 2D slices at various angles to a library identifying one or more dense centers with critical components on the 3D model;
applying pattern matching to identify the critical components from said library;
identifying one or more mounted equipment in said 3D model by correlating said identified one or more critical components with real-world standard objects; and
generating a report of said 3D model comprising said one or more pieces of equipment and spatial information using a CAD model.

### Claim 9 (depends on 8)

The computer program product for reality-based object recognition of claim 8, wherein said one or more reference points comprises a base metal, center of top and the bottom of said 3D model. Spatial points or planes are dependent on the use-case and industry.

### Claim 10 (depends on 8)

The computer program product for reality-based object recognition of claim 8, wherein said library comprises 2D snapshots of computer aided design (CAD) outputs of various real-world objects, the reality outputs, and/or original photographs of said 3D model.

### Claim 11 (depends on 8)

The computer program product for reality-based object recognition of claim 8, wherein said 3D model is a cellular tower.

### Claim 12 (depends on 8)

The computer program product for reality-based object recognition of claim 8, wherein said report comprises real-world identity of said one or more mounted equipment and their location (x, y, z) and angle on said 3D object and all dimensional information.

### Claim 13 (depends on 8)

The computer program product for reality-based object recognition of claim 8, wherein said method further comprises recognizing anomaly in at least one of said one or more mounted equipment and ordering remedial action.

### Claim 14 (depends on 8)

The computer program product for reality-based object/model recognition of claim 8, wherein said model is generated from photogrammetry, lidar, or combinations thereof performed by one or more drones.
