# US 2026/0018174 A1 · Information conversion system, information processing apparatus, information processing method, information conversion method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0018174 A1
- Document ID: US20260018174A1
- Status: Published application
- Kind: A1
- Application number: 19/337,335
- Filed: 2025-09-23
- Published: 2026-01-15
- Earliest claimed: 2023-03-27
- Applicants: Canon Kabushiki Kaisha
- Inventors: TAKESHI KONDOH; TAIHEI MUKAIDE
- Web page: https://patentgrep.com/patent/US20260018174A1

## CPC

- G10L 15/24: Speech recognition using non-acoustical features
- G10L 15/25: using position of the lips, movement of the lips or face analysis
- A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)}
- A61B 5/394: specially adapted for electroglottography or electropalatography
- G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence)
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G09B 21/04: Devices for conversing with the deaf-blind
- G10L 15/063: {Training}
- G10L 15/16: using artificial neural networks
- G10L 25/18: the extracted parameters being spectral information of each sub-band
- G10L 25/21: the extracted parameters being power information
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

An information conversion system including a biological information acquisition unit configured to acquire biological information based on a muscle movement caused by a speech motion of a user, a conversion unit configured to convert the biological information into text information by using the biological information to acquire feature matrix data based on an acquisition time of the biological information and inputting the feature matrix data to an inference model to cause the inference model to infer the text information corresponding to the feature matrix data, and an output unit configured to output the text information converted by the conversion unit.

## Claims

### Claim 1

An information conversion system comprising:
a biological information acquisition unit configured to acquire biological information based on a muscle movement caused by a speech motion of a user;
a conversion unit configured to convert the biological information into text information by using the biological information to acquire feature matrix data based on an acquisition time of the biological information and inputting the feature matrix data to an inference model to cause the inference model to infer the text information corresponding to the feature matrix data; and
an output unit configured to output the text information converted by the conversion unit.

### Claim 2 (depends on 1)

The information conversion system according to claim 1, wherein the biological information is at least one of myoelectric potential information, acceleration information, angular velocity information, and magnetic information based on the speech motion of the user.

### Claim 3 (depends on 1)

The information conversion system according to claim 1, wherein the biological information is information that does not include speech information on the speech motion of the user.

### Claim 4 (depends on 1)

The information conversion system according to claim 1, wherein the biological information includes two or more types of information acquired from one part of the user.

### Claim 5 (depends on 1)

The information conversion system according to claim 1, wherein the biological information includes two or more types of information acquired from a plurality of parts of the user.

### Claim 6 (depends on 1)

The information conversion system according to claim 1, wherein the feature matrix data is a spectrogram.

### Claim 7 (depends on 6)

The information conversion system according to claim 6, wherein the feature matrix data is the spectrogram generated by acquiring a plurality of power spectra based on the biological information and successively arranging the plurality of power spectra according to the acquisition time of corresponding biological information.

### Claim 8 (depends on 1)

The information conversion system according to claim 1, wherein the feature matrix data is a complex Fourier spectrogram.

### Claim 9 (depends on 1)

The information conversion system according to claim 1, wherein the feature matrix data is a Mel spectrogram.

### Claim 10 (depends on 1)

The information conversion system according to claim 1, wherein the inference model is an inference model trained using, as teacher data, the feature matrix data based on the acquisition time of the biological information acquired by using the biological information based on the muscle movement caused by the speech motion of the user and the text information based on the speech motion of the user.

### Claim 11 (depends on 1)

The information conversion system according to claim 1, further comprising a display unit configured to display an output by the output unit,
wherein the display unit displays the text information.

### Claim 12 (depends on 1)

The information conversion system according to claim 1, further comprising a training unit configured to perform additional training of the inference model by using teacher data in which the text information based on the speech motion of the user is set as ground truth and the feature matrix data acquired from the biological information based on the muscle movement caused by the speech motion of the user is set as training data.

### Claim 13 (depends on 1)

The information conversion system according to claim 1,
wherein the conversion unit has a plurality of inference models each trained by different training data, and
wherein the inference is performed using an inference model selected from among the plurality of inference models.

### Claim 14 (depends on 13)

The information conversion system according to claim 13, further comprising:
a speech information acquisition unit configured to acquire speech information on the speech motion of the user,
wherein an inference model in which a matching rate between a plurality of inference results obtained by inputting the feature matrix data acquired from the biological information based on the muscle movement caused by the speech motion of the user to the plurality of inference models and the speech information satisfies a predetermined condition is selected.

### Claim 15 (depends on 1)

The information conversion system according to claim 1, wherein the inference model is a neural network including a convolutional layer.

### Claim 16

An information processing apparatus comprising:
a teacher data acquisition unit configured to acquire teacher data including feature matrix data based on an acquisition time of biological information and text information corresponding to the biological information, the feature matrix data being acquired using the biological information based on a muscle movement caused by a speech motion of a user;
an inference model acquisition unit configured to acquire an inference model; and
a training unit configured to train the inference model by using the teacher data.

### Claim 17

An information processing method comprising:
acquiring teacher data including feature matrix data based on an acquisition time of biological information and text information corresponding to the biological information, the feature matrix data being acquired using the biological information based on a muscle movement caused by a speech motion of a user;
acquiring an inference model; and
training the inference model by using the teacher data.

### Claim 18

An information conversion method comprising:
acquiring biological information based on a muscle movement caused by a speech motion of a user;
converting the biological information into text information by using the biological information to acquire feature matrix data based on an acquisition time of the biological information and inputting the feature matrix data to an inference model to cause the inference model to infer the text information corresponding to the feature matrix data; and
outputting the text information converted by the converting.

### Claim 19 (depends on 18)

A non-transitory computer-readable storage medium storing a program for executing the information conversion method according to claim 18 on a computer.
