# US 2015/0146004 A1 · Centralized video surveillance data in head mounted device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146004 A1
- Document ID: US20150146004A1
- Status: Published application
- Kind: A1
- Application number: 14/092,767
- Filed: 2013-11-27
- Published: 2015-05-28
- Earliest claimed: 2013-11-27
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Barry Alan Kritt; Sarbajit Kumar Rakshit
- Web page: https://patentgrep.com/patent/US20150146004A1

## CPC

- G06V 20/20: in augmented reality scenes
- G02B 27/017: {Head mounted}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04N 7/181: {for receiving images from a plurality of remote sources}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0198: {System for aligning or maintaining alignment of an image in a predetermined direction}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An apparatus includes a security location module that tracks a location of a user. The user has a heads-up display with a display that allows viewing by the user of items along with electronic display images. An object identification module identifies an object for tracking using cameras. A selection module selects the identified object for tracking, an object location module identifies a location and direction information of the selected object and an alert module sends the location and the direction information of the selected object to the heads-up display. A display module identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display, or provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

## Claims

### Claim 1

An apparatus comprising:
a security location module that tracks a location of a user, the user having a heads-up display, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;
an object identification module that identifies an object for tracking, the object identified using one or more cameras of a video surveillance system;
a selection module that selects the identified object for tracking;
an object location module that identifies a location and direction information of the selected object;
an alert module that sends the location and the direction information of the selected object to the heads-up display; and
an display module that one of
identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display; and
provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display,
wherein the security location module, the object identification module, the selection module, the object location module, the alert module, and the display module comprise one or more of hardware and executable code, the executable code stored on one or more computer readable storage media.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the display module identifies the selected object in the heads-up display by locating a symbol on one or more of
an image of the selected object visible in the heads-up display; and
a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to an obstruction between the selected object and the heads-up display.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the display module identifies the selected object in the heads-up display as a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to other obstructions between the selected object and the heads-up display and tracks the selected object until the selected object is in view of the user through the heads-up display.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein the display module identifies the selected object in the heads-up display by one or more of an icon, a symbol, and a color change.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the display module further comprises an object information module that displays information about the selected object along with identification of the selected object by the display module.

### Claim 6 (depends on 5)

The apparatus of claim 5, wherein the information about the selected object comprises one or more of
a description of the selected object;
an indication of direction of the selected object; and
an indication of speed of the selected object.

### Claim 7 (depends on 5)

The apparatus of claim 5, wherein the object comprises a person and further comprising a recognition module that uses an image of the person acquired by the one or more cameras to determine an identity of the person, wherein the object information module displays identity information in the heads-up display in addition to identifying the selected object in the heads-up display.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the identify information comprises one or more of a picture of the person, a name of the person, and a description of the person.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the one or more cameras of the video surveillance system comprises cameras each mounted at a fixed location with a camera display, from each camera, located in a central location.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the selection module selects the identified object for tracking by receiving input from a user to select the identified object.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the one or more cameras of the video surveillance system comprise one or more cameras mounted on the heads-up display of one or more users different than the heads-up display where the alert module sends the location and direction information of the selected object.

### Claim 12 (depends on 1)

The apparatus of claim 1, wherein the display module tracks movement of the selected object and adjusts one or more of
identification of the selected object in the heads-up display to continually track the selected object; and
updates instruction of the heads-up display to direct the user regarding movement of the heads-up display so the selected object is in the field of view of the heads-up display.

### Claim 13 (depends on 1)

The apparatus of claim 1, wherein the alert module sends the location and direction information of the selected object to two or more heads-up displays.

### Claim 14 (depends on 1)

The apparatus of claim 1, wherein the heads-up display comprises one or more of:
a transparent display that allows viewing by the user of the items in the field of view of the user through the transparent display along with electronic images in the field of view of the user on the transparent display; and
an electronic display that combines images of the items in the field of view of the user with electronic display images in the field of view of the user.

### Claim 15

A method comprising:
tracking a location of a user, the user having a heads-up display, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;
identifying an object for tracking, the object identified using one or more cameras of a video surveillance system;
selecting the identified object for tracking;
identifying a location and direction information of the selected object;
sending the location and the direction information of the selected object to the heads-up display; and
one of identifying the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display, and providing instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

### Claim 16 (depends on 15)

The method of claim 15, further comprising displaying information about the selected object along with identification of the selected object.

### Claim 17 (depends on 15)

The method of claim 15, wherein the object comprises a person and further comprising using an image of the person acquired by the one or more cameras to determine an identity of the person, wherein the identity information is displayed in the heads-up display in addition to identifying the selected object in the heads-up display.

### Claim 18 (depends on 15)

The method of claim 15, wherein identifying the selected object in the heads-up display comprises locating a symbol in the heads-up display on one or more of
an image of the selected object visible in the heads-up display; and
a location on the heads-up display corresponding to a direction of the selected object where the selected object is not visible due to other obstructions between the selected object and the heads-up display.

### Claim 19

A system comprising:
one or more cameras;
a heads-up display on a user, the heads-up display comprising a display that allows viewing by the user of items in the field of view of the user along with electronic display images in the field of view of the user;
a security location module that tracks a location of the user;
an object identification module that identifies an object for tracking, the object identified using the one or more cameras;
a selection module that selects the identified object for tracking;
an object location module that identifies a location and direction information of the selected object;
an alert module that sends the location and the direction information of the selected object to the heads-up display; and
a display module that one of
identifies the selected object in the heads-up display of the user when the object is in the field of view of the heads-up display; and
provides instruction on the heads-up display to direct the user to move the heads-up display so that the selected object is in the field of view of the heads-up display.

### Claim 20 (depends on 19)

The system of claim 19, further comprising one or more of
electronic displays that display images captured by the one or more cameras;
a server that communicates with the one or more cameras and the heads-up display; and
a wireless network in communication with the heads-up display.
