# US 10,121,075 B2 · Method and apparatus for early warning of danger

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,075 B2
- Document ID: US10121075B2
- Status: Granted
- Kind: B2
- Application number: 15/525,218
- Filed: 2015-10-20
- Published: 2017-11-09
- Granted: 2018-11-06
- Earliest claimed: 2014-11-06
- Assignees: Samsung Electronics Co., Ltd.
- Applicants: Samsung Electronics Co., Ltd.
- Inventors: Xiaoyi Du; Hengliang Luo; Haifeng Deng; Li Zhang
- Web page: https://patentgrep.com/patent/US10121075B2

## CPC

- G06V 20/20: in augmented reality scenes
- G06F 3/012: {Head tracking input arrangements}
- G06V 40/174: {Facial expression recognition}
- G08B 13/1672: {using sonic detecting means, e.g. a microphone operating in the audio frequency range}
- G08B 13/194: using image scanning and comparing systems
- G08B 21/02: Alarms for ensuring the safety of persons
- G08B 25/08: using communication transmission lines {(G08B13/19658, G08B21/0286, G08B25/016 take precedence)}
- G08B 25/10: using wireless transmission systems {(G08B25/009 takes precedence)}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

Provided are a method and an apparatus for early warning of danger, the method including acquiring image information of a target object through a first wearable device worn by a user, detecting a physical characteristic of the target object based on the acquired image information, determining a degree of danger that is a degree to which safety of the user is endangered, by using the detected physical characteristic, and providing a warning to the user based on the determined degree of danger of an event.

## Claims

### Claim 1

A method for early warning of danger, performed by a wearable device, the method comprising:
acquiring, by an image sensor of the wearable device, image information of a target object;
acquiring, by an audio sensor of the wearable device, audio information of a surrounding environment;
detecting a physical characteristic of the target object based on the acquired image information;
detecting an audio characteristic of the target object by separating the audio characteristic from a background sound based on the acquired audio information;
determining a degree of danger that is a degree to which safety of a user is endangered, by using the detected physical characteristic and the audio characteristic; and
providing a warning to the user based on the determined degree of danger.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining of the degree of danger comprises:
determining a time taken by the target object to reach the wearable device based on the image information; and
determining the degree of danger with respect to the target object according to at least one of the physical characteristic of the target object, the time taken by the target object to reach the wearable device, and the audio characteristic of the target object.

### Claim 3 (depends on 1)

The method of claim 1, wherein the physical characteristic of the target object comprises a face of a person, a trunk of the person, limbs of the person, teeth of an animal, a tail of the animal, or eyes of the animal.

### Claim 4 (depends on 1)

The method of claim 1, wherein the audio characteristic of the target object comprises at least one of a volume, a pitch, a Mel Frequency Cepstrum Coefficient (MFCC), a human speech, and a Power Normalized Cepstral Coefficient (PNCC).

### Claim 5 (depends on 1)

The method of claim 1,
wherein the acquiring of the image information comprises: acquiring weather information or odor information, and
wherein the determining of the degree of danger comprises: determining the degree of danger based on the weather information or the odor information.

### Claim 6 (depends on 1)

The method of claim 1, wherein the providing of the warning comprises: providing the warning in different ways according to the degree of danger.

### Claim 7 (depends on 1)

The method of claim 1, further comprising: receiving the acquired image information or audio information through a second wearable device,
wherein the determining of the degree of danger comprises: determining the degree of danger based on information received from the second wearable device.

### Claim 8 (depends on 1)

The method of claim 1,
wherein the detecting of the physical characteristic comprises:
detecting whether the target object is a person by using the image information; and
if the target object is the person, detecting a face of the person, and
wherein the determining of the degree of danger comprises: determining the degree of danger according to whether the detected face is included in a preset face database.

### Claim 9

A computer-program product comprising a non-transitory computer-readable program including instructions, to be executed by one or more processors, for:
acquiring, by an image sensor, image information of a target object;
acquiring, by an audio sensor, audio information of a surrounding environment;
detecting a physical characteristic of the target object based on the acquired image information;
detecting an audio characteristic of the target object by separating the audio characteristic from a background sound based on the acquired audio information;
determining a degree of danger that is a degree to which safety of a user is endangered, by using the detected physical characteristic and the audio characteristic; and
providing a warning to the user based on the determined degree of danger.

### Claim 10

A wearable device for early warning of danger, the wearable device comprising:
an image sensor configured to acquire image information of a target object;
an audio sensor configured to acquire audio information of a surrounding environment;
a processor configured to detect a physical characteristic of the target object based on the acquired image information, detect an audio characteristic of the target object by separating the audio characteristic from a background sound based on the acquired audio information, and determine a degree of danger that is a degree to which safety of a user is endangered, by using the detected physical characteristic and the audio characteristic; and
a warning unit configured to warn the user based on the determined degree of danger.

### Claim 11 (depends on 10)

The wearable device of claim 10, wherein the processor determines a time taken by the target object to reach the wearable device based on the image information and determines the degree of danger with respect to the target object according to at least one of the physical characteristic of the target object, the time taken by the target object to reach the wearable device, and the audio characteristic of the target object.

### Claim 12 (depends on 10)

The wearable device of claim 10, wherein the physical characteristic of the target object comprises a face of a person, a trunk of the person, limbs of the person, teeth of an animal, a tail of the animal, or eyes of the animal.

### Claim 13 (depends on 10)

The wearable device of claim 10, wherein the audio characteristic of the target object comprises at least one of a volume, a pitch, a Mel Frequency Cepstrum Coefficient (MFCC), human speech, and a Power Normalized Cepstral Coefficient (PNCC).

### Claim 14 (depends on 10)

The wearable device of claim 10, further comprising:
another sensor configured to acquire weather information or odor information, and
wherein the processor determines the degree of danger based on the weather information or the odor information.

### Claim 15 (depends on 10)

The wearable device of claim 10, wherein the warning unit provides the warning in different ways according to the degree of danger.

### Claim 16 (depends on 10)

The wearable device of claim 10, further comprising: a receiving unit configured to receive the acquired image information or audio information through a second wearable device,
wherein the processor determines the degree of danger based on information received from the second wearable device.

### Claim 17 (depends on 10)

The wearable device of claim 10,
wherein the processor detects whether the target object is a person by using the image information and, if the target object is the person, detects a face of the person, and determines the degree of danger according to whether the detected face is included in a preset face database.