# US 11,308,787 B2 · Information processing system, recording medium, and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,308,787 B2
- Document ID: US11308787B2
- Status: Granted
- Kind: B2
- Application number: 17/002,029
- Filed: 2020-08-25
- Published: 2020-12-10
- Granted: 2022-04-19
- Earliest claimed: 2016-07-27
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Yasuhide Hosoda; Manabu Kii; Yoshiki Takeoka
- Web page: https://patentgrep.com/patent/US11308787B2

## CPC

- G08B 21/24: Reminder alarms, e.g. anti-loss alarms
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 9/453: {Help systems}
- G06N 5/04: Inference or reasoning models
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- G16H 20/00: ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- B25J 11/00: Manipulators not otherwise provided for
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50})

## Abstract

Provided is an information processing system that acquires context information representing at least one of a surrounding environment of a user having a device, a feeling of the user, a situation of the user, feelings of other people around the user, or situations of the other people, recognizes a context of the user on the basis of the context information, determines an action corresponding to the context, and determines a transmission method for the action to the user, the transmission method being suitable for the context and the action.

## Claims

### Claim 1

An information processing system, comprising:
a device; and
a processor configured to:
acquire context information representing at least one of a surrounding environment of a user associated with the device, a feeling of the user, a situation of the user, feelings of people around the user, or situations of the people, wherein
the device is wearable on a shoulder of the user, and
at least a part of a casing of the device is made of a flexible and deformable material;
recognize a context of the user based on the context information;
determine an action corresponding to the context; and
determine a transmission method for the action to the user, wherein
the determined transmission method is suitable for the context and the action.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein the processor is further configured to transmit the action corresponding to the context to the user by the determined transmission method.

### Claim 3 (depends on 2)

The information processing system according to claim 2, further comprising a storage unit configured to store a database, wherein
the database comprises a plurality of actions including a first action and a second action registered in association with a single context.

### Claim 4 (depends on 3)

The information processing system according to claim 3, wherein
the processor is further configured to:
determine one of the first action or the second action as the action corresponding to the context;
determine the transmission method suitable for the context and the one of the first action or the second action; and
transmit the one of the first action or the second action to the user by the determined transmission method.

### Claim 5 (depends on 3)

The information processing system according to claim 3, wherein
the first action is opposite to the second action, and
the processor is further configured to:
determine the first action and the second action as the plurality of actions corresponding to the context;
determine respective transmission methods for the first action and the second action; and
transmit the first action and the second action to the user by the respective determined transmission methods.

### Claim 6 (depends on 3)

The information processing system according to claim 3, wherein
the processor is further configured to:
predict a behavior of the user based on the acquired context information;
select one of the first action or the second action that is associated with the context, depending on a result of the predicted behavior of the user; and
determine the transmission method suitable for the context and the selection.

### Claim 7 (depends on 1)

The information processing system according to claim 1, further comprising a communication unit configured to receive the context information transmitted from the device, wherein
the processor is further configured to control the communication unit to send a control signal to the device, and
the control signal indicates that the action corresponding to the context is to be transmitted to the user by the transmission method.

### Claim 8 (depends on 1)

The information processing system according to claim 1, wherein
the processor is further configured to:
analyze content of a message to the user; and
recognize the context of the user depending on a result of the analysis.

### Claim 9 (depends on 1)

The information processing system according to claim 1, wherein the transmission method includes at least one of a first method that uses wind, a second method that uses vibration, a third method that uses sound, or a fourth method that uses drive of a robot arm provided to the device.

### Claim 10 (depends on 9)

The information processing system according to claim 9, wherein the first method generates the wind having a temperature corresponding to the action to be transmitted.

### Claim 11 (depends on 9)

The information processing system according to claim 9, wherein the second method generates the vibration in a pattern corresponding to the action to be transmitted.

### Claim 12 (depends on 9)

The information processing system according to claim 9, wherein the third method comprises output of the sound of a tone corresponding to the action to be transmitted.

### Claim 13 (depends on 9)

The information processing system according to claim 9, wherein the fourth method comprises the drive of the robot arm to pull hair of the user or push back the user.

### Claim 14 (depends on 1)

The information processing system according to claim 1, wherein
the device is further wearable by being hooked on an ear, and
at least a part of an ear hook portion in the device is made of a material configured to deform depending on a body temperature of the user.

### Claim 15

A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a processor, cause the processor to execute operations, the operations comprising:
acquiring context information representing at least one of a surrounding environment of a user associated with a device, a feeling of the user, a situation of the user, feelings of people around the user, or situations of the people, wherein
the device is wearable on a shoulder of the user, and
at least a part of a casing of the device is made of a flexible and deformable material;
recognizing a context of the user based on the context information;
determining an action corresponding to the context; and
determining a transmission method for transmission of the action to the user, wherein
the determined transmission method is suitable for the context and the action.

### Claim 16

An information processing method, comprising:
acquiring context information representing at least one of a surrounding environment of a user associated with a device, a feeling of the user, a situation of the user, feelings of people around the user, or situations of the people, wherein
the device is wearable on a shoulder of the user, and
at least a part of a casing of the device is made of a flexible and deformable material;
recognizing a context of the user based on the context information;
determining an action corresponding to the context; and
determining a transmission method for transmission of the action to the user, wherein
the determined transmission method is suitable for the context and the action.
