# US 2024/0202962 A1 · Systems and methods for location triangulation based on time based panoramic frames

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0202962 A1
- Document ID: US20240202962A1
- Status: Published application
- Kind: A1
- Application number: 18/590,828
- Filed: 2024-02-28
- Published: 2024-06-20
- Earliest claimed: 2022-05-07
- Assignees: Pano AI, Inc.
- Applicants: Pano AI, Inc.
- Inventors: Sonia Kastner; Seva Safris; Kira Greco
- Web page: https://patentgrep.com/patent/US20240202962A1

## CPC

- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G06V 10/25: Determination of region of interest [ROI] or a volume of interest [VOI]
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04N 5/265: Mixing
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- H04N 23/69: Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T 2207/30181: Earth observation
- G06T 2207/30244: Camera pose
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method includes identifying an image captured by an image capture device set at a first angle about an axis, the image corresponding to a time at which the image was captured, identifying within the image, a region of interest including an object to be used for calibration, determining, an image coordinate at which the object is displayed within the image, determining a camera angle corresponding to a position of the image capture system relative to the axis when the image was captured, identifying a bearing of the object relative to the reference direction, the bearing of the object determined using a geolocation of the image capture system and the time at which the image was captured, and determining, using the image coordinate, the camera angle, and the bearing of the object, an angular offset between the first angle and the reference direction to determine a second angle.

## Claims

### Claim 1

A system comprising:
one or more processors communicably coupled to one or more image capture systems, the one or more processors to:
identify, in a first image obtained from a first image capture system located at a first set of geographic coordinates, responsive to a machine learning model applied to the first image, an incident at a first angle within a first range of angles about a first axis of rotation of the first image capture system, the first range of angles of the first image relative to a first reference direction;
identify, responsive to the machine learning model applied to a second image obtained from a second image capture system at a second set of geographic coordinates, in the second image, the incident at a second angle within a second range of angles about a second axis of rotation of the second image capture system, the second range of angles of the second image relative to a second reference direction;
determine a third set of geographic coordinates for a geolocation of the incident based on the first set of geographic coordinates, the first angle, the second set of geographic coordinates, and the second angle; and
provide an output indicating the set of geographic coordinates.

### Claim 2 (depends on 1)

The system of claim 1, comprising the one or more processors to maintain, in one or more data structures, the first set of geographic coordinates for a first station comprising the first image capture system and the second set of geographic coordinates for a second station comprising the second image capture system.

### Claim 3 (depends on 1)

The system of claim 1, comprising the one or more processors to:
select a first group of constituent images comprising the first image, each constituent image of the first group corresponding to the first range of angles about the first axis; and
select a second group of constituent images comprising the second image, each constituent image of the second group corresponding to the second range of angles about the second axis.

### Claim 4 (depends on 3)

The system of claim 3, comprising the one or more processors to:
generate a first composite image using the first group of constituent images including a location of the incident; and
generate a second composite image using the second group of constituent images including the location of the incident.

### Claim 5 (depends on 1)

The system of claim 1, comprising the one or more processors to:
identify, in the first image, a first indicator of the geolocation of the incident, the first indicator corresponding to a first one or more pixel coordinates within the first image; and
determine the first angle using one or more data structures maintaining association between the first one or more pixel coordinates and the first range of angles.

### Claim 6 (depends on 5)

The system of claim 5, comprising the one or more processors to:
identify, in the second image, a second indicator of the geolocation of the incident, the second indicator corresponding to a second one or more pixel coordinates within the second image; and
determine the second angle using the one or more data structures maintaining association between the second one or more pixel coordinates and the second range of angles.

### Claim 7 (depends on 1)

The system of claim 1, comprising the one or more processors to:
determine the third set of geographic coordinates based at least on an intersection of a first line extending away from the first set of geographic coordinates along the first angle and a second line extending away from the second set of geographic coordinates along the second angle.

### Claim 8 (depends on 1)

The system of claim 1, wherein the first reference direction is different from the second reference direction.

### Claim 9 (depends on 1)

The system of claim 1, wherein the first reference direction is North and the second reference direction is North.

### Claim 10 (depends on 1)

The system of claim 1, wherein the machine learning model is trained using a training set of images, each image included in the training set corresponding to a label indicating that the respective image includes one or more visual features indicative of the incident.

### Claim 11 (depends on 1)

The system of claim 1, wherein the incident corresponds to a fire and the one or more visual features include a feature of a smoke corresponding to the fire.

### Claim 12 (depends on 1)

The system of claim 1, wherein the one or more processors are to present, for display, a user interface including one or more interface elements to selectively display at least one of a portion of the first image comprising the incident or a portion of the second image comprising the incident.

### Claim 13

A method comprising:
identifying, by one or more processors coupled with memory, in a first image obtained from a first image capture system located at a first set of geographic coordinates, responsive to a machine learning model applied to the first image, an incident at a first angle within a first range of angles about a first axis of rotation of the first image capture system, the first range of angles of the first image relative to a first reference direction;
identifying, by the one or more processors, responsive to the machine learning model applied to a second image obtained from a second image capture system at a second set of geographic coordinates, in the second image, the incident at a second angle within a second range of angles about a second axis of rotation of the second image capture system, the second range of angles of the second image relative to a second reference direction;
determining, by the one or more processors, a third set of geographic coordinates for a geolocation of the incident based on the first set of geographic coordinates, the first angle, the second set of geographic coordinates, and the second angle; and
providing, by the one or more processors, an output indicating the set of geographic coordinates.

### Claim 14 (depends on 13)

The method of claim 13, comprising:
maintaining, by the one or more processors, in one or more data structures, the first set of geographic coordinates for a first station comprising the first image capture system and the second set of geographic coordinates for a second station comprising the second image capture system.

### Claim 15 (depends on 13)

The method of claim 13, comprising:
selecting, by the one or more processors, a first group of constituent images comprising the first image, each constituent image of the first group corresponding to the first range of angles about the first axis;
selecting, by the one or more processors, a second group of constituent images comprising the second image, each constituent image of the second group corresponding to the second range of angles about the second axis;
generating, by the one or more processors, a first composite image using the first group of constituent images including a location of the incident; and
generating, by the one or more processors, a second composite image using the second group of constituent images including the location of the incident.

### Claim 16 (depends on 13)

The method of claim 13, comprising:
identifying, by the one or more processors, in the first image, a first indicator of the geolocation of the incident, the first indicator corresponding to a first one or more pixel coordinates within the first image;
determining, by the one or more processors, the first angle using one or more data structures maintaining association between the first one or more pixel coordinates and the first range of angles;
identifying, by the one or more processors, in the second image, a second indicator of the geolocation of the incident, the second indicator corresponding to a second one or more pixel coordinates within the second image; and
determining, by the one or more processors, the second angle using the one or more data structures maintaining association between the second one or more pixel coordinates and the second range of angles.

### Claim 17 (depends on 13)

The method of claim 13, comprising:
determining, by the one or more processors, the third set of geographic coordinates based at least on an intersection of a first line extending away from the first set of geographic coordinates along the first angle and a second line extending away from the second set of geographic coordinates along the second angle, and wherein the first reference direction is North and the second reference direction is North.

### Claim 18 (depends on 13)

The method of claim 13, wherein the machine learning model is trained using a training set of images, each image included in the training set corresponding to a label indicating that the respective image includes one or more visual features indicative of the incident.

### Claim 19 (depends on 13)

The method of claim 13, wherein the incident corresponds to a fire and the one or more visual features include a feature of a smoke corresponding to the fire.

### Claim 20 (depends on 13)

The method of claim 13, comprising:
presenting, by the one or more processors, for display, a user interface including one or more interface elements to selectively display at least one of a portion of the first image comprising the incident or a portion of the second image comprising the incident.
