# US 2021/0063978 A1 · Information processing apparatus and non-transitory computer readable medium storing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0063978 A1
- Document ID: US20210063978A1
- Status: Published application
- Kind: A1
- Application number: 16/746,982
- Filed: 2020-01-20
- Published: 2021-03-04
- Earliest claimed: 2019-08-26
- Assignees: Fuji Xerox Co., Ltd.
- Applicants: Fuji Xerox Co., Ltd.
- Inventors: Masahiro SATO; Kengo TOKUCHI
- Web page: https://patentgrep.com/patent/US20210063978A1

## CPC

- A61B 5/4809: {Sleep detection, i.e. determining whether a subject is asleep or not}
- G05B 15/02: electric
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/372: Analysis of electroencephalograms
- A61B 5/378: Visual stimuli
- A61B 5/381: Olfactory or gustatory stimuli
- A61B 5/749: {Voice-controlled interfaces}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- A61B 5/117: Identification of persons (methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00)
- A61B 2505/07: Home care
- A61B 2560/0242: adapted to measure environmental factors, e.g. temperature, pollution
- A61B 2562/0204: Acoustic sensors
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L 2015/227: {of the speaker; Human-factor methodology}
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An information processing apparatus includes a processor configured to associate information indicating a recognition result of a voice of a user uttered at a time at which the user manually operates a device, biological information other than the voice of the user, and manual operation information indicating a manual operation for the device with each other, and operate the device based on the biological information in a subsequent operation.

## Claims

### Claim 1

An information processing apparatus comprising:
a processor configured to
associate information indicating a recognition result of a voice of a user uttered at a time at which the user manually operates a device, biological information other than the voice of the user, and manual operation information indicating a manual operation for the device with each other, and
operate the device based on the biological information in a subsequent operation.

### Claim 2

An information processing apparatus comprising:
a processor configured to
operate a device based on biological information in a subsequent operation in a case where information indicating a recognition result of a voice of a user uttered at a time at which the user manually operates the device and the biological information other than the voice of the user are included in an allowable range of manual operation information indicating a manual operation for the device.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2,
wherein the manual operation information indicating the manual operation for the device, voice information indicating an operation of the device by a voice, and the biological information other than the voice of the user at a time at which the voice is uttered are associated with each other in advance, and
the processor operates the device based on the biological information in a subsequent operation in a case where a difference between the information indicating the recognition result of the voice of the user at the time at which the user manually operates the device and the associated voice information is within a first allowable range and a difference between the biological information other than the voice of the user at the time at which the user manually operates the device and the associated biological information is within a second allowable range.

### Claim 4 (depends on 1)

The information processing apparatus according to claim 1,
wherein the manual operation information, voice information, and the biological information are associated for each user, and
the processor discriminates the voice for each user, and operates the device based on the biological information.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3,
wherein the manual operation information, the voice information, and the biological information are associated for each user, and
the processor discriminates the voice for each user, and operates the device based on the biological information.

### Claim 6 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor stops processing for associating voice information and the biological information with each other while the user is sleeping.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor stops the operation using the biological information while the user is sleeping.

### Claim 8 (depends on 2)

The information processing apparatus according to claim 2,
wherein the processor stops the operation using the biological information while the user is sleeping.

### Claim 9 (depends on 3)

The information processing apparatus according to claim 3,
wherein the processor stops the operation using the biological information while the user is sleeping.

### Claim 10 (depends on 4)

The information processing apparatus according to claim 4,
wherein the processor stops the operation using the biological information while the user is sleeping.

### Claim 11 (depends on 5)

The information processing apparatus according to claim 5,
wherein the processor stops the operation using the biological information while the user is sleeping.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1,
wherein, in a case where voices of a predetermined number of users or more are measured, the processor stops the operation using the biological information.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1,
wherein the processor operates the device based on the biological information generated from the user who receives an external stimulus.

### Claim 14 (depends on 13)

The information processing apparatus according to claim 13,
wherein the external stimulus is a voice of a conversation partner of the user.

### Claim 15 (depends on 13)

The information processing apparatus according to claim 13,
wherein the external stimulus is an odor.

### Claim 16 (depends on 13)

The information processing apparatus according to claim 13,
wherein the external stimulus is a temperature.

### Claim 17 (depends on 13)

The information processing apparatus according to claim 13,
wherein the external stimulus is a situation that the user views.

### Claim 18 (depends on 1)

The information processing apparatus according to claim 1,
wherein the biological information is brain waves.

### Claim 19

A non-transitory computer readable medium storing a program causing a computer to execute:
associating information indicating a recognition result of a voice of a user uttered at a time at which the user manually operates a device, biological information other than the voice of the user, and manual operation information indicating a manual operation for the device with each other; and
operating the device based on the biological information in a subsequent operation.

### Claim 20

A non-transitory computer readable medium storing a program causing a computer to execute:
operating a device based on biological information in a subsequent operation in a case where information indicating a recognition result of a voice of a user uttered at a time at which the user manually operates the device and the biological information other than the voice of the user are included in an allowable range of manual operation information indicating a manual operation for the device.
