# US 2026/0227856 A1 · Information processing system, information processing method and non-transitory computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0227856 A1
- Document ID: US20260227856A1
- Status: Published application
- Kind: A1
- Application number: 19/630,214
- Filed: 2026-03-26
- Published: 2026-08-06
- Earliest claimed: 2023-10-06
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: TAIHEI MUKAIDE; CHIHIRO NAGURA
- Web page: https://patentgrep.com/patent/US20260227856A1

## CPC

- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G10L 13/027: Concept to speech synthesisers; Generation of natural phrases from machine-based concepts (generation of parameters for speech synthesis out of text G10L13/08)
- G10L 15/00: Speech recognition (G10L17/00 takes precedence)
- G10L 15/24: Speech recognition using non-acoustical features
- G10L 17/22: Interactive procedures; Man-machine interfaces
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

An information processing system includes a processor and a memory storing a program which, when executed by the processor, causes the information processing system to a biometric information detection processing of detecting biometric information from one or more portions of a user, an estimation processing of estimating textual information or voice information from the biometric information detected by the biometric information detection processing, a determination processing of determining whether or not the biometric information corresponds to a specific movement for controlling the system, and a control processing of controlling the system on the basis of a result of the determination by the determination processing.

## Claims

### Claim 1

An information processing system comprising:
a processor; and
a memory storing a program which, when executed by the processor, causes the information processing system to execute
a biometric information detection processing of detecting biometric information from one or more portions of a user;
an estimation processing of estimating textual information or voice information from the biometric information detected by the biometric information detection processing;
a determination processing of determining whether or not the biometric information corresponds to a specific movement for controlling the system; and
a control processing of controlling the system on the basis of a result of the determination by the determination processing.

### Claim 2 (depends on 1)

The information processing system according to claim 1,
wherein, when it is determined that the biometric information corresponds to a first specific movement, in the control processing the system is controlled so as to start the estimation of the textual information or the voice information by the estimation processing based on the biometric information.

### Claim 3 (depends on 1)

The information processing system according to claim 1,
wherein, when it is determined that the biometric information corresponds to a second specific movement, in the control processing the system is controlled so as to end the estimation of the textual information or the voice information by the estimation processing based on the biometric information.

### Claim 4 (depends on 1)

The information processing system according to claim 1,
wherein in the control processing the system is controlled so as to switch an operation mode depending on which one of a plurality of the specific movements the biometric information corresponds to.

### Claim 5 (depends on 1)

The information processing system according to claim 1,
wherein in the control processing the system is controlled so as to activate an application depending on which one of the plurality of specific movements the biometric information corresponds to.

### Claim 6 (depends on 1)

The information processing system according to claim 1,
wherein the specific movement is at least any one of a face movement, a cheek movement, a tongue movement, and an eyeball or eyelid movement of the user.

### Claim 7 (depends on 1)

The information processing system according to claim 1,
wherein in the biometric information detection processing the biometric information for estimating the voice information or the textual information and the biometric information for determining whether or not the biometric information corresponds to the specific movement are detected by using a same sensor.

### Claim 8 (depends on 1)

The information processing system according to claim 1,
wherein in the biometric information detection processing at least one of an acceleration sensor and an angular velocity sensor is used and a myoelectric sensor is used.

### Claim 9 (depends on 1)

The information processing system according to claim 1,
wherein in the biometric information detection processing at least one of an acceleration sensor and an angular velocity sensor is used and a tactile sensor is used.

### Claim 10 (depends on 1)

The information processing system according to claim 1,
wherein in the biometric information detection processing the biometric information is detected from at least two or more portions of the user among the user's lower jaw region, cheeks, throat, subaural regions, neck region, and temples.

### Claim 11 (depends on 1)

The information processing system according to claim 1,
wherein in the control processing displaying the textual information by using a display is started when it is determined that the biometric information corresponds to a third specific movement, and the displaying of the textual information using the display is ended when it is determined that the biometric information corresponds to a fourth specific movement.

### Claim 12 (depends on 1)

The information processing system according to claim 1,
wherein in the control processing outputting the voice information by using a sound information output processing is started when it is determined that the biometric information corresponds to a fifth specific movement, and the outputting of the voice information using the sound information output processing is ended when it is determined that the biometric information corresponds to a sixth specific movement.

### Claim 13 (depends on 1)

The information processing system according to claim 1,
wherein in the estimation processing the textual information or the voice information is estimated from the biometric information by using a first trained model, and
wherein in the determination processing it is determined whether or not the biometric information corresponds to the specific movement by using a second trained model.

### Claim 14 (depends on 13)

The information processing system according to claim 13,
wherein each of the first trained model and the second trained model is a same trained model.

### Claim 15 (depends on 1)

The information processing system according to claim 1,
wherein the biometric information detection processing is executed in a device that can be attached to the user, and
wherein the estimation processing, the determination processing, and the control processing are executed in an information processing apparatus configured to be communicative with the device.

### Claim 16 (depends on 15)

The information processing system according to claim 15,
wherein the device outputs the textual information or the voice information estimated by the estimation processing.

### Claim 17 (depends on 1)

The information processing system according to claim 1,
wherein in the control processing the system is controlled on the basis of a type of a movement based on the biometric information.

### Claim 18

An information processing method comprising:
detecting biometric information from one or more portions of a user;
estimating textual information or voice information from the biometric information detected in the detecting;
determining whether or not the biometric information corresponds to a specific movement for controlling a system; and
controlling the system on the basis of a result of the determination in the determining.

### Claim 19

A non-transitory computer readable medium that stores a program, wherein the program causes a computer to execute an information processing method comprising:
detecting biometric information from one or more portions of a user;
estimating textual information or voice information from the biometric information detected in the detecting;
determining whether or not the biometric information corresponds to a specific movement for controlling a system; and
controlling the system on the basis of a result of the determination in the determining.
