# US 2012/0249787 A1 · Surveillance System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249787 A1
- Document ID: US20120249787A1
- Status: Published application
- Kind: A1
- Application number: 13/438,188
- Filed: 2012-04-03
- Published: 2012-10-04
- Earliest claimed: 2011-04-04
- Assignees: Polaris Wireless, Inc.
- Inventors: Manlio Allegra; Martin Feuerstein; Mahesh B. Patel
- Web page: https://patentgrep.com/patent/US20120249787A1

## CPC

- G06V 40/172: {Classification, e.g. identification}
- H04W 4/02: Services making use of location information
- G06V 20/48: {Matching video sequences}
- G06V 40/168: {Feature extraction; Face representation}
- H04L 43/103: with adaptive polling, i.e. dynamically adapting the polling rate
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04W 4/029: Location-based management or tracking services
- H04W 4/90: Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
- G06V 40/179: {metadata assisted face recognition}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Data from a wireless network location system is used in conjunction with the known geographic location of a video surveillance area such that the system according to the present invention infers that a person who appears in an image in the video is the user of a mobile phone estimated to be at the person's location. When facial recognition is applied and the person's identity is thus recognized, an association is generated as between the identity according to the facial recognition and the identity of the co-located mobile phone. This association can be critical when there is no personal identification available for a mobile phone such as a pre-paid mobile.

## Claims

### Claim 1

A method comprising:
receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises an image of a person at a location;
estimating the identity of a mobile phone based on the location of the person;
estimating the identity of the person based on the identity of the mobile phone; and
transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the person, and
(ii) a depiction of the identity of the person.

### Claim 2 (depends on 1)

The method of claim 1 wherein the image of the person is sufficient to identify the person.

### Claim 3 (depends on 1)

The method of claim 1 wherein the image of the person is insufficient to identify the person.

### Claim 4

The method of claim further comprising:
transmitting, by the data-processing system to a data store, an association between the image of the person and the identity of the person.

### Claim 5

A method comprising:
receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises an image of a first person at a location;
estimating the identity of a first mobile phone based on the location of the first person;
receiving, by the data-processing system, information regarding a communication involving the first mobile phone; and
transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person, and
(ii) a depiction of the information regarding the communication.

### Claim 6 (depends on 5)

The method of claim 5 further comprising:
estimating the identity of the first person based on the identity of the first mobile phone; and
wherein the second video frame further comprises:
(iii) a depiction of the identity of the first person.

### Claim 7 (depends on 5)

The method of claim 5 wherein the second video frame further comprises:
(iii) a depiction of the identity of the first mobile phone.

### Claim 8 (depends on 5)

The method of claim 5 further comprising:
estimating, based on the information regarding the communication, the identity of a second telecommunications terminal;
wherein the second video frame further comprises:
(iii) a depiction of the identity of the second telecommunications terminal.

### Claim 9 (depends on 5)

The method of claim 5 further comprising:
estimating, based on the information regarding the communication, the identity of a second telecommunications terminal;
estimating the identity of a second person based on the identity of the second telecommunications terminal; and
wherein the second video frame further comprises:
(iii) a depiction of the identity of the second person.

### Claim 10 (depends on 5)

The method of claim 5 wherein the image of the person is sufficient to identify the person.

### Claim 11 (depends on 5)

The method of claim 5 wherein the image of the person is insufficient to identify the person.

### Claim 12 (depends on 5)

The method of claim 5 further comprising:
estimating, by the data-processing system, the identity of the first person based on the identity of the first mobile phone;
estimating, based on the information regarding the communication, the identity of a second telecommunications terminal;
estimating the identity of a second person based on the identity of the second telecommunications terminal; and
estimating a relationship between the first person and the second person; and
wherein the second video frame further comprises:
(iii) a depiction of the relationship between the first person and the second person.

### Claim 13 (depends on 12)

The method of claim 12 wherein the relationship is one of:
(i) a familial connection,
(ii) a telecommunications event,
(iii) a social connection, and
(iv) a financial transaction.

### Claim 14

A method comprising:
receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises an image of a first person at a location;
estimating the identity of a first mobile phone based on the location of the first person;
estimating, based on the identity of the first mobile phone, the identity of a second telecommunications terminal, wherein the second telecommunications terminal is one of a mobile phone or a wired telecommunications terminal;
estimating the identity of a second person based on the identity of the second telecommunications terminal; and
transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person, and
(ii) a depiction of the identity of the second person.

### Claim 15 (depends on 14)

The method of claim 14 further comprising:
estimating a relationship between the first person and the second person; and
wherein the second video frame further comprises:
(iii) a depiction of the relationship between the first person and the second person.

### Claim 16 (depends on 14)

The method of claim 14 wherein the relationship is one of:
(i) a familial connection,
(ii) a telecommunications event,
(iii) a social connection, and
(iv) a financial transaction.

### Claim 17

A method comprising:
receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises:
(i) an image of a first person at a first location, and
(ii) an image of a second person at a second location;
estimating the identity of a first mobile phone based on the location of the first person; and
estimating a relationship between the first person and the second person based on the identity of the first mobile phone; and
transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person,
(ii) the image of the second person, and
(iii) a depiction of the relationship between the first person and the second person.

### Claim 18 (depends on 17)

The method of claim 17 further comprising:
estimating the identity of the first person based on the identity of the first mobile phone.

### Claim 19 (depends on 17)

The method of claim 17 further comprising:
estimating the identity of the first person based on facial recognition applied to the image the first person.

### Claim 20 (depends on 17)

The method of claim 17 further comprising:
estimating the identity of a second mobile phone based on the location of the second person; and
estimating the identity of the second person based on the identity of the second mobile phone.

### Claim 21 (depends on 17)

The method of claim 17 further comprising:
estimating the identity of the second person based on facial recognition applied to the image of the second person.

### Claim 22 (depends on 17)

The method of claim 17 wherein the relationship between the first person and the second person is one of:
(i) a telecommunications event,
(ii) a financial transaction,
(iii) a social connection, and
(iv) a familial connection.

### Claim 23

A method comprising:
receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises an image of a first person at a first location;
estimating the identity of a first mobile phone based on the location of the first person;
estimating the identity of the first person based on facial recognition applied to the image the first person; and
transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) a depiction of an association between the identity of the first person and the identity of the first mobile phone.

### Claim 24 (depends on 23)

The method of claim 23 further comprising:
estimating a relationship between the first person and a second person based on the identity of the first person;
wherein the second video frame further comprises:
(ii) a depiction of the relationship between the first person and the second person.

### Claim 25 (depends on 24)

The method of claim 24 wherein the relationship is one of:
(i) a familial connection,
(ii) a telecommunications event,
(iii) a social connection, and
(iv) a financial transaction.

### Claim 26

A data-processing system comprising:
a non-transitory memory that stores program code;
a processor that when executing the program code is for:
(a) estimating the identity of a mobile phone based on a location of a person, wherein a first video frame comprises an image of the person at the location, and
(b) estimating the identity of the person based on the identity of the mobile phone; and
a transceiver for:
(a) receiving a first video signal that carries the first video frame, and
(b) transmitting a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the person, and
(ii) a depiction of the identity of the person.

### Claim 27 (depends on 26)

The data-processing system of claim 26 wherein the transceiver is further for:
(c) transmitting to a data store an association between the image of the person and the identity of the person.

### Claim 28

A data-processing system comprising:
a non-transitory memory that stores program code;
a processor that when executing the program code is for estimating the identity of a first mobile phone based on a location of a first person, wherein a first video frame comprises an image of the first person at the location; and
a transceiver for:
(a) receiving a first video signal that carries the first video frame,
(b) receiving information regarding a communication involving the first mobile phone, and
(c) transmitting a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person, and
(ii) a depiction of the information regarding the communication.

### Claim 29 (depends on 28)

The data-processing system of claim 28 wherein the processor, when executing the program code, is further for estimating the identity of the first person based on the identity of the first mobile phone; and
wherein the second video frame further comprises:
(iii) a depiction of the identity of the first person.

### Claim 30 (depends on 28)

The data-processing system of claim 28 wherein the second video frame further comprises:
(iii) a depiction of the identity of the first mobile phone.

### Claim 31 (depends on 28)

The data-processing system of claim 28 wherein the processor, when executing the program code, is further for estimating, based on the information regarding the communication, the identity of a second telecommunications terminal;
wherein the second video frame further comprises:
(iii) a depiction of the identity of the second telecommunications terminal.

### Claim 32 (depends on 28)

The data-processing system of claim 28 wherein the processor, when executing the program code, is further for:
(a) estimating, based on the information regarding the communication, the identity of a second telecommunications terminal, and
(b) estimating the identity of a second person based on the identity of the second telecommunications terminal; and
wherein the second video frame further comprises:
(iii) a depiction of the identity of the second person.

### Claim 33 (depends on 28)

The data-processing system of claim 28 wherein the processor, when executing the program code, is further for:
(a) estimating the identity of the first person based on the identity of the first mobile phone,
(b) estimating, based on the information regarding the communication, the identity of a second telecommunications terminal,
(c) estimating the identity of a second person based on the identity of the second telecommunications terminal, and
(d) estimating a relationship between the first person and the second person; and
wherein the second video frame further comprises:
(iii) a depiction of the relationship between the first person and the second person.

### Claim 34

A data-processing system comprising:
a non-transitory memory that stores program code;
a processor that when executing the program code is for:
(a) estimating the identity of a first mobile phone based on a location of a first person, wherein a first video frame comprises an image of the first person at the location,
(b) estimating, based on the identity of the first mobile phone, the identity of a second telecommunications terminal, wherein the second telecommunications terminal is one of a mobile phone or a wired telecommunications terminal, and
(c) estimating the identity of a second person based on the identity of the second telecommunications terminal; and
a transceiver for:
(a) receiving a first video signal that carries the first video frame, and
(b) transmitting a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person, and
(ii) a depiction of the identity of the second person.

### Claim 35 (depends on 34)

The data-processing system of claim 34 wherein the processor, when executing the program code, is further for:
(iv) estimating a relationship between the first person and the second person; and
wherein the second video frame further comprises:
(iii) a depiction of the relationship between the first person and the second person.

### Claim 36

A data-processing system comprising:
a non-transitory memory that stores program code;
a transceiver for:
(a) receiving a first video signal that carries a first video frame, wherein the first video frame comprises:
(i) an image of a first person at a first location, and
(ii) an image of a second person at a second location, and
(b) transmitting a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) the image of the first person,
(ii) the image of the second person, and
(iii) a depiction of a relationship between the first person and the second person; and
a processor that when executing the program code is for:
(a) estimating the identity of the first mobile phone based on the location of the first person, and
(b) estimating the relationship between the first person and the second person based on the identity of the first mobile phone.

### Claim 37 (depends on 36)

The data-processing system of claim 36 wherein the processor, when executing the program code, is further for:
(c) estimating the identity of the first person based on the identity of the first mobile phone.

### Claim 38 (depends on 36)

The data-processing system of claim 36 wherein the processor, when executing the program code, is further for:
(c) estimating the identity of the first person based on facial recognition applied to the image the first person.

### Claim 39 (depends on 36)

The data-processing system of claim 36 wherein the processor, when executing the program code, is further for:
(c) estimating the identity of a second mobile phone based on the location of the second person; and
(d) estimating the identity of the second person based on the identity of the second mobile phone.

### Claim 40 (depends on 36)

The data-processing system of claim 36 wherein the processor, when executing the program code, is further for:
(c) estimating the identity of the second person based on facial recognition applied to the image of the second person.

### Claim 41 (depends on 36)

The data-processing system of claim 36 wherein the relationship between the first person and the second person is one of:
(i) a telecommunications event,
(ii) a financial transaction,
(iii) social connection, and
(iv) a familial connection.

### Claim 42

A data-processing system comprising:
a non-transitory memory that stores program code;
a transceiver for:
(a) receiving, by a data-processing system, a first video signal that carries a first video frame, wherein the first video frame comprises an image of a first person at a first location, and
(b) transmitting, by the data-processing system, a second video signal that carries a second video frame that is based on the first video frame, wherein the second video frame comprises:
(i) a depiction of an association between the identity of the first person and the identity of a first mobile phone; and
a processor that when executing the program code is for:
(a) estimating the identity of the first mobile phone based on the location of the first person, and
(b) estimating the identity of the first person based on facial recognition applied to the image the first person.

### Claim 43 (depends on 42)

The data-processing system of claim 42 wherein the processor, when executing the program code, is further for:
(c) estimating estimating a relationship between the first person and a second person based on the identity of the first person; and
wherein the second video frame further comprises:
(ii) a depiction of the relationship between the first person and the second person.

### Claim 44 (depends on 43)

The data-processing system of claim 43 wherein the relationship is one of:
(i) a familial connection,
(ii) a telecommunications event,
(iii) a social connection, and
(iv) a financial transaction.
