# US 2020/0394725 A1 · Monitoring utility assets using crowd-sourced digital image data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0394725 A1
- Document ID: US20200394725A1
- Status: Published application
- Kind: A1
- Application number: 16/439,219
- Filed: 2019-06-12
- Published: 2020-12-17
- Earliest claimed: 2019-06-12
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Harish BHARTI; Pinaki BHATTACHARYA; Hemant KHADKE; Dinesh WADEKAR; Rajesh Kumar SAXENA
- Web page: https://patentgrep.com/patent/US20200394725A1

## CPC

- G06Q 50/06: Energy or water supply
- G06F 16/538: Presentation of query results
- G06Q 10/06316: {Sequencing of tasks or work}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods for monitoring of utility assets using crowd-sourced digital image data are disclosed. In embodiments, a method includes: monitoring, by a computing device, incoming real-time utility data; determining, by the computing device, that a triggering event has occurred based on the monitoring; sending, by the computing device, an event message to one or more agent devices comprising a request for digital image collection at a location based on the triggering event, the event message including event information, wherein the one or more agent devices are associated with respective agents in a crowd-sourcing network; receiving, by the computing device, event data from the one or more agent devices, the event data including one or more digital images; and processing, by the computing device, the one or more digital images to determine next steps with respect to the triggering event.

## Claims

### Claim 1

A computer-implemented method, comprising:
monitoring, by a computing device, incoming real-time utility data;
determining, by the computing device, that a triggering event has occurred based on the monitoring;
sending, by the computing device, an event message to one or more agent devices comprising a request for digital image collection at a location based on the triggering event, the event message including event information, wherein the one or more agent devices are associated with respective agents in a crowd-sourcing network;
receiving, by the computing device, event data from the one or more agent devices, the event data including one or more digital images; and
processing, by the computing device, the one or more digital images to determine next steps with respect to the triggering event.

### Claim 2 (depends on 1)

The computer-implemented method claim 1, further comprising issuing, by the computing device, a notification regarding the next steps.

### Claim 3 (depends on 1)

The computer-implemented method claim 1, wherein the event message includes an option to accept or decline the request, the method further comprising receiving, by the computing device, an acceptance of the request from the one of more agent devices.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, further comprising determining, by the computing device, the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network, the determining the one or more agent devices comprising:
monitoring, by the computing device, real-time location data of the one or more agent devices; and
determining, by the computing device, that the one or more agent devices are within a predetermined distance from the location.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, further comprising determining, by the computing device, the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network based on agent profile data in an agent database.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising determining, by the computing device, a reward for the one or more agents based on agent profile data in an agent database and based on the event data.

### Claim 7

A computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computing device to cause the computing device to:
monitor incoming utility data;
determine that a triggering event has occurred based on the monitoring;
determine that the triggering event is eligible for crowd sourcing based on determined aspects of the triggering event;
send an event message to one or more agent devices comprising a request for digital image collection at a location based on the triggering event and the determination that the triggering event is eligible for crowd sourcing, the event message including event information, wherein the one or more agent devices are associated with respective agents in a crowd-sourcing network;
receive event data from the one or more agent device, the event data including one or more digital images; and
process the one or more digital images to determine next steps with respect to the triggering event.

### Claim 8 (depends on 7)

The computer program product of claim 7, further comprising program instructions to cause the computing device to issue a notification regarding the next steps.

### Claim 9 (depends on 7)

The computer program product of claim 7, wherein the event message includes an option to accept or decline the request, and the program instructions further to cause the computing device to determine that an acceptance of the request from the one of more agent devices has been received.

### Claim 10 (depends on 7)

The computer program product of claim 7, further comprising program instructions to cause the computing device to determine the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network, the determining the one or more agent devices comprising:
monitoring real-time location data of the one or more agent devices; and
determining that the one or more agent devices are within a predetermined distance from the location.

### Claim 11 (depends on 7)

The computer program product of claim 7, further comprising program instructions to cause the computing device to determine the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network based on agent profile data in an agent database.

### Claim 12 (depends on 7)

The computer program product of claim 7, further comprising wherein the processing of the one or more digital images comprises:
determining if the one or more digital images are valid; and
if the digital images are not valid, re-sending the event message to the one or more agent devices.

### Claim 13

A system comprising:
a processor, a computer readable memory and a computer readable storage medium associated with a computing device;
program instructions to monitor incoming utility data;
program instructions to determine that a triggering event has occurred based on the monitoring;
program instructions to send an event message to one or more agent devices comprising a request for digital image collection at a location based on the triggering event, the event message including event information, wherein the one or more agent devices are associated with respective agents in a crowd-sourcing network;
program instructions to receive, from the one or more agent devices, digital image data for the location; and
program instructions to analyze the digital image data, including comparing the digital image data with historic digital image data to determine changes to the location over time that meet a threshold value,
wherein the program instructions are stored on the computer readable storage medium for execution by the processor via the computer readable memory.

### Claim 14 (depends on 13)

The system of claim 13, further comprising program instructions to determine next steps with respect to the triggering event based on the analysis of the digital image data.

### Claim 15 (depends on 14)

The system of claim 14, further comprising program instructions to issue a notification regarding the next steps.

### Claim 16 (depends on 13)

The system of claim 13, wherein the event message includes an option to accept or decline the request, and the system further comprises program instructions to determine that an acceptance of the request from the one of more agent devices has been received.

### Claim 17 (depends on 13)

The system of claim 13, further comprising program instructions to determine the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network, the determining the one or more agent devices comprising:
monitoring real-time location data of the one or more agent devices; and
determining that the one or more agent devices are within a predetermined distance from the location.

### Claim 18 (depends on 13)

The system of claim 13, further comprising program instructions to determine the one or more agent devices to send the event message to from a list of agents of the crowd-sourcing network based on agent profile data in an agent database.

### Claim 19 (depends on 13)

The system of claim 13, further comprising program instructions to determine a reward for the one or more agents based on agent profile data in an agent database and based on the receiving the digital image data.

### Claim 20 (depends on 13)

The system of claim 13, wherein the event information includes one or more of the group consisting of: coordinates, a desired angle of an image, a target for the image collection, a desired digital image format, and a service type associated with the triggering event.
