# US 2018/0025458 A1 · Self-customizing, multi-tenanted mobile system and method for digitally gathering and disseminating real-time visual intelligence on utility asset damage enabling automated priority analysis and enhanced utility outage response

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0025458 A1
- Document ID: US20180025458A1
- Status: Published application
- Kind: A1
- Application number: 15/659,201
- Filed: 2017-07-25
- Published: 2018-01-25
- Earliest claimed: 2016-07-25
- Assignees: Bossanova Systems, Inc.
- Applicants: Bossanova Systems, Inc.
- Inventors: Deepak Swamy
- Web page: https://patentgrep.com/patent/US20180025458A1

## CPC

- G06Q 50/265: {Personal security, identity or safety}
- G01S 5/0027: {of actual mobile position, i.e. position determined on mobile}
- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area
- G01S 19/17: Emergency applications
- G01S 19/42: Determining position
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L 51/224: providing notification on incoming messages, e.g. pushed notifications of received messages
- H04L 51/42: Mailbox-related aspects, e.g. synchronisation of mailboxes
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A self-customizing, multi-tenanted mobile system includes digitally gathering and disseminating real-time visual intelligence on utility asset damage enabling automated priority analysis and enhanced utility outage response. A preferred embodiment may be made up of, for example, communication module (102) to transfer geo-coded damage imaging and associated metadata simultaneously from multiple outage-causing damage locations to dispatchers and operations personnel in the utility control room and in the field. A mobile application (101) is installed onto the first responder's Global Positioning System (GPS) enabled mobile device (104) to send metadata to a multi-tenanted intelligent platform (MTIP) (106). MTIP (106) determines which utility tenant receives the damage report and customizes all aspects of the technical solution: the first responder mobile application (101), the central web portal (103) and the damage viewing application for utility field personnel (110). A central web portal (103) running on a control room personal computer running a Javascript capable browser or similar environment (105) receives geo-coded damage imaging and associated metadata from mobile application (101) via the MTIP (106) which automatically analyzes event location, relevance and severity to compute, recommend and communicate event priority. MTIP (106) further analyzes inbound images using computer vision technology and wire geometry algorithms to determine relative risk and event priority of downed wires. The multi-tenanted intelligent platform (106) is used to store outage-causing damage information and perform damage assessment enabling dispatchers to respond appropriately. A preferred embodiment enables external users—specifically municipal first responders (fire, police and municipal workers) to report outage-causing damage to the electric grid and provides a simple, easily deployable and secure system. The system then uses location, severity and role-based rules to dynamically notify appropriate utility personnel (112) via text message, email notification or within the damage viewing application on the field personnel's mobile device (110) so they are best able to respond and repair the damage. A preferred embodiment also speeds and improves communication between municipalities and utilities, and enhances the transparency of utility damage repair leading to outage resolution.

## Claims

### Claim 1

A system for digitally gathering and disseminating real-time visual intelligence on utility asset damage enabling automated priority analysis and enhanced utility outage response, the system comprising:
a first responder mobile application installed onto a Global Positioning System (GPS) enabled first responder mobile device having an image capturing device, said first responder mobile application configured to operate the image capturing device to capture an image of the utility damage event and automatically determine a damage event location based on a location of the first responder mobile device when the image is captured, said first responder mobile application further configured to generate a first responder damage report of the utility damage event that includes the captured image and damage event location and transmit the first responder damage report;
a multi-tenanted intelligent platform (MTIP) configured to receive the first responder damage report from the first responder mobile device, and dynamically determine which utility tenant the report must be automatically assigned to based on report location and damage type, and automatically customize the first responder app, the utility central portal and the damage viewing mobile application for that utility tenant, the MTIP configured to compute a priority for the damage report by pattern-matching, relevance analysis and image processing of the captured image;
a central web portal for utility dispatchers and utility control room personnel to view and manage damage reports in multiple formats including map-based views, event management list views and an administrative capability allowing the utility tenant and their admin(s) to manage users, privileges and notification rules and jurisdictions; and
a selective notification module featuring contextual notification based on geo-location both of the damage report and of the utility field personnel or their dispatch location.

### Claim 2 (depends on 1)

The system of claim 1, wherein said selective notification is based on user relevance defined in the form of utility users' or crews' organizational role or department, geographic jurisdiction, type of service required and shift timings.

### Claim 3 (depends on 1)

The system of claim 1, wherein said selective notification module configured to transmit images and metadata from first responder damage report directly to relevant utility users including utility crews and local crew supervisors.

### Claim 4 (depends on 1)

The system of claim 1, wherein notifications can be personalized and include any combination of text messages, emails and in-app notifications, the latter option requiring utility field users to download and install the damage viewing mobile applivation.

### Claim 5 (depends on 1)

The system of claim 1, wherein the multi-tenanted intelligent platform is further configured to store the first responder damage report associating it with the location-appropriate utility tenant and to enable the utility dispatcher to assign various dispositions to the damage report using the central web portal, a town/county delimited version of which may be accessed by municipalities to provide response and repair assistance; and
a central web portal with interfaces to an external geographic information system (GIS), wherein said central web portal can group, sort, catalogue and organize the damage assessment reports for the display on the control room PC and on the mobile device of the utility field personnel in the damage viewing mobile application.

### Claim 6 (depends on 1)

The system as claimed in claim 1, wherein said first responder is one or more individual such as firefighter, police, field workers or any external source primarily reaching the outage location.

### Claim 7 (depends on 1)

The system as claimed in claim 1, wherein said system further disseminates visual intelligence on utility asset damage with plurality of organizations from the multi-tenanted intelligent platform via the central web portal, via the location-based self-configuring damage viewing mobile application and via the town portals, wherein the shared information is used to form a strategy by the organizations to respond to address outage-causing damage rapidly and with the needed resources in the correct sequence at the required locations so that repairs may be effected in shorter times.

### Claim 8 (depends on 1)

The system as claimed in claim 1, wherein the first responder damage report includes data pertaining to outage but not limited to the GPS-encoded pictures, videos, text, digital imagery etc.

### Claim 9

A method for digitally gathering and disseminating real-time visual intelligence on utility asset damage enabling automated priority analysis and enhanced utility outage response, the method comprising the steps of:
sending the geo-coded damage imaging and event meta-data to the multi-tenanted intelligent platform by the first responder using a location-based self-configuring mobile application at the utility damage location;
selecting the appropriate utility tenant and creating the utility damage event, time-stamping and storing in the multi-tenanted intelligent platform;
sending notifications via email, text message and app push to relevant utility users including utility dispatchers via a web portal and local crew supervisors via a damage viewing application;
ingesting location, relevance and reported severity of damage and using this data to automatically and algorithmically compute, recommend and communicate event priority by employing pattern-matching, relevance analysis and image processing;
grouping, sorting, cataloging and organizing damage assessment reports for the display on the central web portal;
publishing images and metadata to utility's own geographical information system in the form of map pins which are derived from damage geo-location;
allowing qualified electrical technicians or utility damage assessors and dispatchers to view the damage reports on the central web portal and determining the response required;
disseminating damage reports to utility operations planners for them to prepare dispatch orders/work orders for utility crews by remotely assessing the nature of equipment, personnel and materials required;
routing the crews to exact damage address to complete repairs and restoring the power;
updating job and repair status by dispatcher and crew; and
allowing the municipalities and towns to view updated ticket status of local utility damage events on the town web portal.

### Claim 10 (depends on 9)

The method as claimed in claim 9, wherein said central web portal via the MTIP further provides the status updates of the response sent to first responder.

### Claim 11 (depends on 9)

The method as claimed in claim 9, wherein said status updated by dispatcher is the state of the outage event such as cleared or repaired.

### Claim 12

A system for gathering and disseminating real-time visual intelligence of a utility damage event, the system comprising:
a first responder mobile application installed onto a Global Positioning System (GPS) enabled first responder mobile device having an image capturing device, said first responder mobile application configured to operate the image capturing device to capture an image of the utility damage event and automatically determine a damage event location based on a location of the first responder mobile device when the image is captured, said first responder mobile application further configured to generate a first responder damage report of the utility damage event that includes the captured image and damage event location and transmit the first responder damage report; and
a multi-tenanted intelligent platform (MTIP) configured to receive the first responder damage report from the first responder mobile device and determine a priority for the first responder damage report by pattern-matching, relevance analysis and image processing of the captured image; and

### Claim 13 (depends on 12)

The system of claim 12, further comprising:
a central web portal for a plurality of utility tenants to view and manage first responder damage reports in multiple formats including map-based views, event management list views and an administrative capability allowing the utility tenant and their admin(s) to manage users, privileges and notification rules and jurisdictions;
utility crew mobile devices having a utility crew mobile application configured to receive and display first responder damage reports; and
a selective notification module in communication with the MTIP to dynamically determine which of the plurality of utility tenants the first responder can access via the central web portal the first responder damage report based on report location and damage type, and select which of the utility mobile devices are to receive the first responder damage report, said selective notification module further forwarding the first responder damage report to the selected utility mobile devices.

### Claim 14 (depends on 13)

The system of claim 13, said selective notification module further providing contextual notification based on geo-location both of the damage report and of the utility field personnel or their dispatch location.

### Claim 15 (depends on 12)

The system of claim 12, wherein said MTIP analyzes the captured image to determine a severity of the damage.

### Claim 16 (depends on 15)

The system of claim 15, wherein said MTIP analyzes the captured image to determine if a primary power line is damaged, and assigns a high priority to the first responder damage report if the primary power line is damage.

### Claim 17 (depends on 12)

The system of claim 12, wherein the first responder damage report includes a damage type for the utility damage event, and wherein said MTIP analyzes the captured image based on the damage type to determine if a severity of the damage.

### Claim 18 (depends on 13)

The system of claim 13, wherein the MTIP receives the first responder damage report directly from the first responder mobile device, and transmits the first responder damage report directly to the selected utility crew mobile devices.