# US 9,438,865 B2 · Systems and methods for automated cloud-based analytics for security surveillance systems with mobile input capture devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,865 B2
- Document ID: US9438865B2
- Status: Granted
- Kind: B2
- Application number: 14/845,480
- Filed: 2015-09-04
- Published: 2015-12-31
- Granted: 2016-09-06
- Earliest claimed: 2014-04-10
- Assignees: Smartvue Corporation
- Applicants: Smartvue Corporation
- Inventors: Martin A. Renkis
- Web page: https://patentgrep.com/patent/US9438865B2

## CPC

- H04N 7/181: {for receiving images from a plurality of remote sources}
- B25J 9/1679: {characterised by the tasks executed}
- G06T 19/003: {Navigation within 3D models or images}
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 13/00: Burglar, theft or intruder alarms
- G08B 13/19656: {Network used to communicate with a camera, e.g. WAN, LAN, Internet}
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- H04L 67/125: involving control of end-device applications over a network
- H04L 67/306: User profiles
- H04L 67/34: {involving the movement of software or configuration parameters (network booting or remote initial program loading [RIPL] G06F9/4416)}
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence)
- H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- Y10S 901/01: Mobile robot
- Y10S 901/47: Optical
- Y10S 901/50: Miscellaneous
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

Systems and methods for cloud-based surveillance for a target surveillance area are disclosed. At least two input capture devices and at least one user device are communicatively connected to a cloud-based analytics platform. At least one input capture device is a mobile device with visual sensors. The cloud-based analytics platform automatically analyzes received 2-Dimensional (2D) video and/or image inputs for generating 3-Dimensional (3D) surveillance data and providing 3D display for a target surveillance area.

## Claims

### Claim 1

A cloud-based surveillance system for a target surveillance area, comprising:
at least two input capture devices (ICDs), a cloud-based analytics platform having a processor and a memory, at least one user device having a display with a user interface;
wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs and the at least one user device;
wherein the at least two ICDs have visual sensors and are operable to capture and transmit input data to the cloud-based analytics platform; wherein at least one of the at least two ICDs is a mobile device with a visual sensor;
wherein the cloud-based analytics platform is operable to:
receive and authenticate the input data;
generate 3-Dimensional (3D) visual representation based on input data captured from the at least two ICDs;
perform advanced analytics based on the input data and/or the generated 3D visual representation;
wherein the at least one user device is operable to display the 3D visual representation for the target surveillance area via the user interface.

### Claim 2 (depends on 1)

The system of claim 1, wherein the at least two ICDs are selected from the group consisting of security cameras, mobile phones, smart phones, tablets, portable computers, and wearable input capture devices.

### Claim 3 (depends on 1)

The system of claim 1, wherein the input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

### Claim 4 (depends on 1)

The system of claim 1, wherein the input data are automatically tagged, combined, grouped, and edited by the cloud-based analytics platform according to the target surveillance area.

### Claim 5 (depends on 1)

The system of claim 1, wherein authentication of the input data includes confirming the time for the input data captured by the at least two ICDs.

### Claim 6 (depends on 1)

The system of claim 1, wherein authentication of the input data includes confirmation of global positioning system (GPS) location of each of the remote input devices providing inputs and matching the GPS location with that of the target surveillance area.

### Claim 7 (depends on 1)

The system of claim 1, wherein authentication of the input data includes confirming that there has been no alteration, editing, and/or modification to the input data prior to its receipt by the cloud-based analytics platform.

### Claim 8 (depends on 1)

The system of claim 1, wherein the cloud-based analytics platform is further operable to provide data storage, wherein a time period of storage is selectable on the cloud-based analytics platform.

### Claim 9 (depends on 1)

The system of claim 1, wherein the 3D visual representation of the target surveillance area includes 3D playback for a predetermined time period.

### Claim 10 (depends on 1)

The system of claim 1, wherein the 3D visual representation of the target surveillance area is interactive.

### Claim 11

A method for providing cloud-based surveillance for a target surveillance area, comprising:
communicatively connecting at least two input capture devices (ICDs) and at least one user device having a display with a user interface to a cloud-based analytics platform having a processor and a memory via a communication network; wherein each of the at least two ICDs has at least one visual sensor; wherein at least one of the at least two ICDs is a mobile device with a visual sensor;
the at least two ICDs capturing and transmitting input data to the cloud-based analytics platform;
the cloud-based analytics platform receiving and authenticating the input data;
the cloud-based analytics platform generating 3-Dimensional (3D) visual representation based on input data captured from the at least two ICDs;
the cloud-based analytics platform performing advanced analytics based on the input data and/or the generated 3D visual representation;
the at least one user device displaying the 3D visual representation for the target surveillance area via the user interface.

### Claim 12 (depends on 11)

The method of claim 11, wherein the at least two ICDs are selected from the group consisting of security cameras, mobile phones, smart phones, tablets, portable computers, and wearable input capture devices.

### Claim 13 (depends on 11)

The method of claim 11, wherein the input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

### Claim 14 (depends on 11)

The method of claim 11, further comprising the cloud-based analytics platform tagging, combining, grouping, and editing the input data according to the target surveillance area.

### Claim 15 (depends on 11)

The method of claim 11, wherein authenticating the input data comprises confirming the time for the input data captured by the at least two ICDs.

### Claim 16 (depends on 11)

The method of claim 11, wherein authenticating the input data comprises confirming a global positioning system (GPS) location of each of the at least two ICDs and matching the GPS location with that of the target surveillance area.

### Claim 17 (depends on 11)

The method of claim 11, wherein authenticating the input data comprises confirming that there has been no alteration, editing, and/or modification to the input data prior to its receipt by the cloud-based analytics platform.

### Claim 18 (depends on 11)

The method of claim 11, further comprising the cloud-based analytics platform providing data storage, wherein a time period of storage is selectable on the cloud-based analytics platform.

### Claim 19 (depends on 11)

The method of claim 11, wherein the 3D visual representation of the target surveillance area includes 3D playback for a predetermined time period.

### Claim 20 (depends on 11)

The method of claim 11, wherein the 3D visual representation of the target surveillance area is interactive.