# US 2019/0315003 A1 · Information processing device and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0315003 A1
- Document ID: US20190315003A1
- Status: Published application
- Kind: A1
- Application number: 16/306,014
- Filed: 2017-03-10
- Published: 2019-10-17
- Earliest claimed: 2016-06-14
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: HIROSHI IWANAMI
- Web page: https://patentgrep.com/patent/US20190315003A1

## CPC

- B25J 11/008: {Manipulators for service tasks}
- B25J 19/026: {Acoustical sensing devices}
- B25J 9/0003: {Home robots, i.e. small robots for domestic use}
- B25J 9/1666: {Avoiding collision or forbidden zones}
- B25J 9/1676: {Avoiding collision or forbidden zones}
- B25J 11/0005: {Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means}
- G06N 99/00: Subject matter not provided for in other groups of this subclass
- G08B 25/04: using a single signalling line, e.g. in a closed loop
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

[Object] To provide an information processing device and a storage medium capable of sensing approach of an object and notifying a user in advance. [Solution] The information processing device includes: a passive ultrasonic sensor; a notification section configured to notify a user; and a control section configured to, when detecting a feature indicating approach of an object learned in advance from sensor data detected by the ultrasonic sensor, control the notification section to notify the user.

## Claims

### Claim 1

An information processing device comprising:
a passive ultrasonic sensor;
a notification section configured to notify a user; and
a control section configured to, when detecting a feature indicating approach of an object learned in advance from sensor data detected by the ultrasonic sensor, control the notification section to notify the user.

### Claim 2 (depends on 1)

The information processing device according to claim 1, further comprising:
a command acquisition section configured to acquire a command from the user, wherein
when recognizing that a specific command has been acquired by the command acquisition section, the control section exerts control to generate teacher data for recognizing an approaching object on a basis of sensor data detected since a time point going back a predetermined period and to store the teacher data in a storage section.

### Claim 3 (depends on 2)

The information processing device according to claim 2, wherein
the control section detects a feature similar to the teacher data from the sensor data detected by the ultrasonic sensor, and controls the notification section to notify the user that an object approaches, and
when recognizing that a command indicating a positive evaluation has been acquired by the command acquisition section in response to the notification, the control section updates the teacher data on a basis of the sensor data detected by the ultrasonic sensor.

### Claim 4 (depends on 2)

The information processing device according to claim 2, wherein
the teacher data is data indicating a feature of chronological sensor data since the time point going back the predetermined period.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein
when recognizing that a command requesting a still earlier notification has been acquired by the command acquisition section in response to the notification, the control section updates the teacher data on a basis of data indicating a feature of chronological sensor data since a time point going back further than the predetermined period.

### Claim 6 (depends on 4)

The information processing device according to claim 4, wherein
when features similar to the teacher data are successively detected from the chronological sensor data detected by the ultrasonic sensor, the control section controls the notification section to notify the user that an object approaches.

### Claim 7 (depends on 4)

The information processing device according to claim 4, wherein
a feature detected from the sensor data is a state transition or a waveform.

### Claim 8 (depends on 1)

The information processing device according to claim 1, further comprising:
a radio wave receiving section, wherein
when detecting a feature indicating approach of an object, learned in advance, in the sensor data detected by the ultrasonic sensor and a radio wave signal received by the radio wave receiving section, the control section controls the notification section to notify the user.

### Claim 9 (depends on 8)

The information processing device according to claim 8, wherein
the control section
performs, after first recognition processing of recognizing an approaching object in accordance with an ID included in the radio wave signal, second recognition processing of recognizing the approaching object in accordance with a feature included in the sensor data detected by the ultrasonic sensor, and
exerts control to notify the user about the approaching object in accordance with coincidence between results of the first recognition processing and the second recognition processing.

### Claim 10 (depends on 1)

The information processing device according to claim 1, further comprising:
a smell sensor, wherein
when detecting a feature indicating approach of an object, learned in advance, from the sensor data detected by the ultrasonic sensor and smell data detected by the smell sensor, the control section controls the notification section to notify the user.

### Claim 11 (depends on 10)

The information processing device according to claim 10, wherein
smell data and an approaching object are associated in advance, ultrasonic sensor data and the approaching object are associated in advance, and
the control section exerts control to recognize the approaching object in accordance with the smell data, recognize the approaching object in accordance with the ultrasonic sensor data, and notify the user about the approaching object in accordance with coincidence between the two recognition results.

### Claim 12 (depends on 1)

The information processing device according to claim 1, further comprising:
an imaging section configured to image a face of the user, wherein
the control section
estimates an emotion of the user from a face image of the user captured by the imaging section when the user answers a visitor serving as the object, and
updates a content to be notified by the notification section in accordance with a result of estimation of the emotion.

### Claim 13 (depends on 1)

The information processing device according to claim 1, further comprising:
an imaging section configured to image a face of the user, wherein
the control section estimates an emotion of the user from a face image of the user captured by the imaging section when the user answers a visitor serving as the object, and
in accordance with a result of the estimation after the user answers the visitor,
on a basis of sensor data detected since a time point going back a predetermined period from that time point, the control section exerts control to generate teacher data for recognizing the visitor, and to store the teacher data in a storage section.

### Claim 14

A storage medium having a program stored thereon, the program causing a computer to function as
a control section configured to control a notification section to notify a user when detecting a feature indicating approach of an object learned in advance from sensor data detected by a passive ultrasonic sensor.
