# US 2026/0099539 A1 · System and method of frame localized artificial intelligence retrieval

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0099539 A1
- Document ID: US20260099539A1
- Status: Published application
- Kind: A1
- Application number: 19/091,288
- Filed: 2025-03-26
- Published: 2026-04-09
- Earliest claimed: 2024-10-04
- Applicants: Visual Defence Inc.
- Inventors: Royi TAL
- Web page: https://patentgrep.com/patent/US20260099539A1

## CPC

- G06F 16/538: Presentation of query results
- G06F 16/5854: {using shape and object relationship}
- G06F 16/29: Geographical information databases
- G06F 16/55: Clustering; Classification
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods provide localization and framed analysis of location referenced image data and related data thereof. The system/method can be used in a variety of applications which can be related to governmental operations, asset management, surveying, provision of public services, maintenance, compliance, issue management, and/or other applications. A user, interacting with the system through an interface, is able to access one or more datasets obtained from one or more platforms, localize it using various criteria such as defined in the frame localized retrieval instructions, and/or frame analysis which can be applied to the dataset(s) and/or portion(s) thereof. The analysis can use artificial intelligence and intake and output the data in one or more modalities. The results can then be used for creation and/or updates of records in relation to a variety of governmental, municipal, and/or organizational applications.

## Claims

### Claim 1

A geospatial multi-modal system for intelligent retrieval and/or generation of data from one or more dataset(s) containing image(s) by framing and/or localizing of request(s) which leverage artificial intelligence; said system, applied with one or more digital government application(s), comprising of:
a platform for collecting and/or storing a data set containing at least image data;
at least one client for facilitating a user to interact with the system through a user interface; and
a computing component for executing software instructions to:
operate an artificial intelligence module including a multi-modal artificial intelligence component;
receive from the user interface via a network interface a query, the query framing and/or localizing a request for retrieval and/or generation of data from the data set; and
a server responsible for executing the software instructions and the artificial intelligence module in order to process the query and generate a result data for sending in response to the received query.

### Claim 2 (depends on 1)

The system of claim 1, wherein the server processes the data set of geo-referenced image(s) contained within the jurisdiction of a local government and obtained from one or more platforms and wherein the data set represents a digital twin of the governmental jurisdiction; said one or more platforms being comprised of at least one vehicle and at least one camera.

### Claim 3 (depends on 1)

The system of claim 1, wherein the platform includes at least one camera.

### Claim 4 (depends on 3)

The system of claim 3, wherein the camera is used for obtaining images is selected from camera type consisting of: digital camera(s), CCTV camera(s), image camera(s), device camera(s), video camera(s), webcam(s), smart phone camera(s), tablet camera(s), action camera(s), 360 camera(s), dashcam(s), surveillance camera(s), body camera(s), panoramic camera(s), DLSR camera(s), thermal camera(s), time of flight camera(s), infrared camera(s), night camera(s), multi-focal camera(s), multi-spectral camera(s),, wide angle camera(s), stereoscopic camera(s), multi-view camera(s), pan-tilt-zoom camera(s), near infrared camera(s), satellite camera(s), aerial camera(s), and/or vehicle camera(s).

### Claim 5 (depends on 1)

The system of claim 1, wherein the platform data set is retrieved from an intermediate server other than the server.

### Claim 6 (depends on 1)

The system of claim 1, wherein the data set is obtained from the platform and further includes at least one of: videos; location coordinates; metadata; audio; file; and databases.

### Claim 7 (depends on 1)

The system of claim 1, wherein the server is integrated with and further comprising of one or more of the following systems: Geospatial Systems; Customer Relationship Management system(s), Asset Management System(s), Service Request System(s), Citizen Request Portal(s), 311 System(s), Enterprise Resource Planning System(s), Facility Management System(s), Customer Service System(s), Customer Support System(s), Field Service Management System(s), Document Management System(s), Dispatch System(s), Telematics(s) System(s), Community Portal(s), Ticket System(s), Chat System(s), Help Desk System(s), Road Patrol System(s), Incident Reporting System(s), Police System(s), Fire System(s), Municipal System(s), Land Registry System(s), Surveillance System(s), CCTV System(s), Security System(s), Surveying System(s), Fleet Tracking System(s), and/or Video Surveillance System(s).

### Claim 8 (depends on 1)

The system of claim 1, wherein the software instructions provide at least one of the following functions selected from the group consisting of: Geospatial Systems function(s); Customer Relationship Management system(s) function(s), Asset Management System(s) function(s), Service Request System(s) function(s), Citizen Request Portal(s) function(s), 311 System(s) function(s), Enterprise Resource Planning System(s) function(s), Facility Management System(s) function(s), Customer Service System(s) function(s), Customer Support System(s) function(s), Field Service Management System(s) function(s), Document Management System(s) function(s), Dispatch System(s) function(s), Telematics(s) System(s) function(s), Community Portal(s) function(s), Ticket System(s) function(s), Chat System(s) function(s), Help Desk System(s) function(s), Road Patrol System(s) function(s), Incident Reporting System(s) function(s), Police System(s) function(s), Fire System(s) function(s), Municipal System(s) function(s), Land Registry System(s) function(s), Surveillance System(s) function(s), CCTV System(s) function(s), Security System(s) function(s), Surveying System(s) function(s), Fleet Tracking System(s) function(s), and/or Video Surveillance System(s) function(s).

### Claim 9 (depends on 1)

The system of claim 1, wherein the artificial intelligence module also uses a single modality AI model for one or more image processing operations such as: object detection, image classification, image segmentation, instance segmentation, key point extraction, pose estimation, and/or image generation.

### Claim 10 (depends on 1)

The system of claim 1, wherein the server and/or the platform transfer image data and related data from the data set to the server from one or more of the following network entities: platform(s), server(s), device(s), 3rd party server(s), data storage(s), cloud system(s), app(s), web system(s), municipal system(s), business system(s), government system(s), and/or integration(s).

### Claim 11 (depends on 1)

The system of claim 1, wherein the artificial intelligence module comprises at least one multi-modal architecture, wherein multi-modal input data is encoded onto a unified embeddings space, and whereas output can be decoded onto one or more output modalities.

### Claim 12 (depends on 1)

The system of claim 1, wherein the artificial intelligence module is further comprised of one or more AI models, where the output of the one or more AI models is verified by one or more further AI models.

### Claim 13 (depends on 1)

The system of claim 1, wherein the software instructions further redact personal information from the image data automatically using at least one of: image processing operations, single-modal operations, multi-modal operations, and/or artificial intelligence operations.

### Claim 14 (depends on 1)

The system of claim 1, wherein the software instructions process the query to localize a portion of the data set as defined by frame localized retrieval instructions present in the query.

### Claim 15 (depends on 1)

The system of claim 1, wherein the software instructions generate data from the system by framing the query received from the user interface.

### Claim 16 (depends on 1)

The system of claim 1, wherein the query processed by the software instructions includes both framing and localization operations as defined in frame localized retrieval instructions.

### Claim 17 (depends on 1)

The system of claim 1, wherein the software instructions execute a user defined programmable workflow; said workflow comprising of at least framing, localization, and/or retrieval operations, which occur automatically when programmed conditions are met.

### Claim 18 (depends on 1)

The system of claim 1, wherein the software instructions execute frame and/or localize one or more request(s) with one or more of the following technical outcome(s): to inventory assets present in geo-referenced images; to inspect geo-referenced images of assets; to inspect geo-referenced image(s) for deficiencies;
to inspect geo-referenced image(s) for hazard(s); to inspect geo-referenced image(s) for bylaw infraction(s); to inspect geo-referenced image(s) for code violation(s); to inspect geo-referenced image(s) for compliance issue(s); to inspect geo-referenced image(s) for risk(s); and/or obtain insights and/or ratings in relation to a framed criteria; to inspect images in service requests and generate geo-referenced coordinates from related data such as an address and/or name; and/or a combination thereof.

### Claim 19 (depends on 18)

The system of claim 18 wherein the user interface generates from the system result data, using one action such as a click or a button push, one or more of the following: service request, infraction ticket, and/or work order.

### Claim 20

A method for geospatial multi-modal intelligent retrieval and/or generation of data from a digital government dataset containing images using artificial intelligence instructions comprising the steps of:
making one or more queries to server using a client interface;
receiving the one or more queries, such that the one or more queries frames the dataset, localizes the dataset, generates data and/or retrieves data from the dataset;
processing the one or more queries using the artificial intelligence instructions to generate result data;
presenting the result data to the user through the user interface; and
receiving interaction instructions from the user for further manipulation of the result data, the interaction instructions received from the user interface.
