# US 2016/0321498 A1 · Warning a user about adverse behaviors of others within an environment based on a 3d captured image stream

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0321498 A1
- Document ID: US20160321498A1
- Status: Published application
- Kind: A1
- Application number: 15/196,446
- Filed: 2016-06-29
- Published: 2016-11-03
- Earliest claimed: 2007-01-12
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Jacob C. Albertson; Kenneth C. Arnold; Steven D. Goldman; Michael A. Paolini; Anthony J. Sessa
- Web page: https://patentgrep.com/patent/US20160321498A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G01V 5/20: Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects
- G06T 7/292: Multi-camera tracking
- G06T 7/33: using feature-based methods
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G08B 6/00: Tactile signalling systems, e.g. tactile personal calling systems
- G08B 13/19602: {Image analysis to detect motion of the intruder, e.g. by frame subtraction}
- G08B 13/19608: {Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position}
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G08B 13/19615: {wherein said pattern is defined by the user}
- G08B 13/19641: {Multiple cameras having overlapping views on a single scene}
- G08B 31/00: Predictive alarm systems characterised by extrapolation or other computation using updated historic data
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)}
- G06F 9/451: Execution arrangements for user interfaces
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20076: Probabilistic image processing
- G06T 2207/20081: Training; Learning
- G06T 2207/30232: Surveillance
- Y10S 706/933: Law, law enforcement, or government
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01V: GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS (means for indicating the location of accidentally buried, e.g. snow-buried, persons A63B29/02)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y10S: TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

## Abstract

One or more audio feedback output devices receive warning signals for controlling types of audio output by the audio output devices, the warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, audio feedback output devices worn by the supervising user. The audio feedback output devices operative to control the types of audio outputs of the audio output devices that are detectable by the supervising user wearing the audio feedback output devices according to the warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

## Claims

### Claim 1

A system, comprising:
one or more audio feedback output devices operative to receive one or more warning signals for controlling one or more types of audio output by the one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and
the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

### Claim 2 (depends on 1)

The system according to claim 1, wherein the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse further comprise:
the one or more audio feedback output devices operative to convert the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

### Claim 3 (depends on 1)

The system according to claim 1, wherein the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse further comprise:
the one or more audio feedback output devices operative to convert the one or more warning signals from text into audible speech feedback.

### Claim 4 (depends on 1)

The system according to claim 1, further comprising:
a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment;
the plurality of image capture devices each operative to securely transmit one or more captured image streams within the particular environment to one or more computer systems;
the one or more computer systems operative to gather the one or more captured image streams from the plurality of image capture devices into a collaborative image;
the one or more computer systems operative to align the one or more captured image streams within the collaborative image;
the one or more computer systems operative to determine from the collaborative image the predicted behavior of the monitored user represents the particular behavior that is potentially adverse within the particular environment;
the one or more computer systems operative to select the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse; and
the one or more computer systems operative to securely transmit the one or more warning signals to the one or more audio feedback output devices for the supervising user.

### Claim 5

A method, comprising:
receiving, by one or more audio feedback output devices, one or more warning signals for controlling one or more types of audio output by the one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and
controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

### Claim 6 (depends on 5)

The method according to claim 5, wherein controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse further comprises:
converting, by the one or more audio feedback output devices, the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

### Claim 7 (depends on 5)

The method according to claim 5, wherein controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse further comprises:
converting, by the one or more audio feedback output devices, the one or more warning signals from text into audible speech feedback.

### Claim 8 (depends on 5)

The method according to claim 5, further comprising:
securely transmitting, by a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment, one or more captured image streams within the particular environment to one or more computer systems;
gathering, by the one or more computer systems, the one or more captured image streams from the plurality of image capture devices into a collaborative image;
aligning, by the one or more computer systems, the one or more captured image streams within the collaborative image;
determining, by the one or more computer systems, from the collaborative image, the predicted behavior of the monitored user represents the particular behavior that is potentially adverse within the particular environment;
selecting, by the one or more computer systems, the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse; and
securely transmitting, by the one or more computer systems, the one or more warning signals to the one or more audio feedback output devices for the supervising user.

### Claim 9

A computer program product comprising one or more computer-readable storage devices and program instructions, stored on at least one of the one or more storage devices, the stored program instructions comprising:
program instructions to receive, by one or more audio feedback output devices, one or more warning signals for controlling one or more types of audio output by the one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and
program instructions to control, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

### Claim 10 (depends on 9)

The computer program product according to claim 9, wherein the program instructions further comprise:
program instructions to convert, by the one or more audio feedback output devices, the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

### Claim 11 (depends on 9)

The computer program product according to claim 9, wherein the program instructions further comprise:
program instructions to convert, by the one or more audio feedback output devices, the one or more warning signals from text into audible speech feedback.

### Claim 12 (depends on 9)

The computer program product according to claim 9, wherein the program instructions further comprise:
program instructions to securely transmit, by a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment, one or more captured image streams within the particular environment to one or more computer systems;
program instructions to gather, by the one or more computer systems, the one or more captured image streams from the plurality of image capture devices into a collaborative image;
program instructions to align, by the one or more computer systems, the one or more captured image streams within the collaborative image;
program instructions to determine, by the one or more computer systems, from the collaborative image, the predicted behavior of the monitored user represents the particular behavior that is potentially adverse within the particular environment;
program instructions to select, by the one or more computer systems, the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse; and
program instructions to securely transmit, by the one or more computer systems, the one or more warning signals to the one or more audio feedback output devices for the supervising user.
