# US 2019/0171668 A1 · Distributed video storage and search with edge computing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0171668 A1
- Document ID: US20190171668A1
- Status: Published application
- Kind: A1
- Application number: 16/324,217
- Filed: 2017-08-08
- Published: 2019-06-06
- Earliest claimed: 2016-08-08
- Assignees: Netradyne, Inc.
- Applicants: NetraDyne, Inc.
- Inventors: Avneesh AGRAWAL; David Jonathan JULIAN; Venkata Sreekanta Reddy ANNAPUREDDY; Manoj Venkata TUTIKA; Vinay Kumar RAI; Sandeep PANDYA; Adam David KAHN; Michael CAMPOS; Badugu Naveen CHAKRAVARTHY; Ankur NIGAM; Praveen KUMAR; Tejeswara Rao GUDENA; Karan KISHORE
- Web page: https://patentgrep.com/patent/US20190171668A1

## CPC

- G06F 16/7837: {using objects detected or recognised in the video content}
- B60W 40/09: Driving style or behaviour
- G06F 16/00: Information retrieval; Database structures therefor; File system structures therefor
- G06F 16/71: Indexing; Data structures therefor; Storage structures
- G06F 16/73: Querying
- G06F 16/7844: {using original textual content or text extracted from visual content or transcript of audio data}
- G06V 20/48: {Matching video sequences}
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- G06N 20/00: Machine learning
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

Systems and methods are provided for distributed video storage and search with edge computing. The method may comprise caching a first portion of data on a first device. The method may further comprise determining, at a second device, whether the first device has the first portion of data. The determining may be based on whether the first piece of data satisfies a specified criterion. The method may further comprise sending the data, or a portion of the data, and/or a representation of the data from the first device to a third device.

## Claims

### Claim 1

A method, comprising:
receiving visual data from a camera at a first device, wherein the first device is proximate to the camera;
storing the visual data at a memory of the first device;
receiving a search query at a second device;
transmitting the search query from the second device to the first device; and
determining, at the first device, a relevance of the visual data based on the visual data and the search query.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
processing the visual data at the first device with a first inference engine to produce an inference data;
wherein the determined relevance is based on the inference data and the search query.

### Claim 3 (depends on 2)

The method of claim 2, wherein the inference data is a textual representation of the visual data.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
transmitting a search result data from the first device to the second device based on the determined relevance; and
receiving the search result data at the second device.

### Claim 5 (depends on 4)

The method of claim 4, further comprising:
receiving a third visual data from a third camera at a third device, wherein the third device is proximate to the third camera;
transmitting the search query from the second device to the third device;
determining, at the third device, a relevance of the third visual data based on the third visual data and the search query;
transmitting a search result data from the third device to the second device based on the determined relevance;
comparing, at the second device, the search result data and the third search result data; and
retrieving the visual data or the third visual data based on the comparison.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
transmitting the visual data from the first device to the second device based on the determined relevance.

### Claim 7 (depends on 7)

The method of claim 7, further comprising:
updating an inference engine based on the transmitted visual data.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first camera is affixed to a first vehicle.

### Claim 9 (depends on 8)

The method of claim 8, wherein the search query refers to a rarely observed driving scenario.

### Claim 10 (depends on 9)

The method of claim 9, further comprising:
determining, at the first device, a safety of a driving behavior of a driver of the first vehicle based on the stored visual data.

### Claim 11

An apparatus, the apparatus comprising:
a second memory unit;
a second at least one processor coupled to the second memory unit, in which the second at least one processor is configured to:
receive a search query; and
transmit the search query to a first memory unit; and
a first memory unit; and
a first at least one processor coupled to the first memory unit, in which the first at least one processor is configured to:
receive visual data from a proximate camera;
store the visual data at the first memory unit; and
determine a relevance of the visual data at the first device based on the visual data and the search query.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein the first at least one processor is further configured to:
process the visual data with a first inference engine to produce an inference data; wherein the determined relevance is based on the inference data and the search query.

### Claim 13 (depends on 11)

The apparatus of claim 11, wherein the first camera is affixed to a first vehicle.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the search query refers to a rarely observed driving scenario.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the first at least one processor is further configured to:
determine a safety of a driving behavior of a driver of the first vehicle.

### Claim 16

A computer program product, the computer program product comprising:
a non-transitory computer-readable medium having program code recorded thereon, the program code comprising program code to:
receive visual data from a camera at a first device, wherein the first device is proximate to the camera;
store the visual data to a memory at the first device;
receive a search query at a second device;
determine, at the second device, whether the first device has stored the visual data in the memory storage; and
transmit the visual data from the first device to the second device.

### Claim 17 (depends on 16)

The computer program product of claim 16, the program code further comprising program code to:
transmit metadata corresponding to the visual data from the first device to the second device; wherein determining whether the first device has stored the visual data is based in part on the metadata.

### Claim 18 (depends on 16)

The computer program product of claim 16, the program code further comprising program code to:
transmit inference data corresponding to the visual data from the first device to the second device; wherein determining whether the first device has stored the visual data is based in part on the inference data.

### Claim 19 (depends on 16)

The computer program product of claim 16, the program code further comprising program code to:
query, at the second device, weather information in a proximity of the first device, wherein determining whether the first device has stored the visual data is based on the query.

### Claim 20 (depends on 16)

The computer program product of claim 16, wherein the camera is a vehicle mounted camera, a vehicle dash camera, a drone mounted camera, an appliance mounted camera, a retail camera, a smart city camera or a surveillance camera.

### Claim 21 (depends on 16)

The computer program product of claim 16, wherein storing the visual data comprises assigning a descriptor of the visual data to a first queue of a plurality of queues.

### Claim 22 (depends on 21)

The computer program product of claim 21, wherein the first queue corresponds to at least one of: a specified compression level, specified criteria from a set of criteria, a specified period of data persistence, a location, a time, and a weather condition.