# US 2022/0284739 A1 · Method for generating learned model, system for generating learned model, prediction device, and prediction system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284739 A1
- Document ID: US20220284739A1
- Status: Published application
- Kind: A1
- Application number: 17/677,154
- Filed: 2022-02-22
- Published: 2022-09-08
- Earliest claimed: 2021-03-03
- Assignees: Nihon Kohden Corporation
- Applicants: Nihon Kohden Corporation
- Inventors: Hiroto SANO; Wataru Matsuzawa; Takuya Kawashima
- Web page: https://patentgrep.com/patent/US20220284739A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G06V 10/82: using neural networks
- G06V 40/174: {Facial expression recognition}
- G06V 2201/033: of skeletal patterns
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method for generating a learned model applied to a prediction device that predicts a probability that a subject develops delirium based on a moving image in which the subject appears is provided. The method includes: acquiring first data corresponding to the moving image in which the subject appears; generating, based on the first data, second data corresponding to changes over time in relative positions of a plurality of feature points in a body of the subject in the moving image; generating third data indicating a determination result as to whether the subject develops delirium based on the moving image; and generating the learned model by causing a neural network to learn using the second data and the third data.

## Claims

### Claim 1

A method for generating a learned model applied to a prediction device that predicts a probability that a subject develops delirium based on a moving image in which the subject appears, the method comprising:
acquiring first data corresponding to the moving image in which the subject appears;
generating, based on the first data, second data corresponding to changes over time in relative positions of a plurality of feature points in a body of the subject in the moving image;
generating third data indicating a determination result as to whether the subject develops delirium based on the moving image; and
generating the learned model by causing a neural network to learn using the second data and the third data.

### Claim 2 (depends on 1)

The method for generating the learned model according to claim 1, wherein the second data is generated by applying, to the first data, a skeleton model in which the plurality of feature points set for at least four limbs of a human body are connected based on a predetermined relationship.

### Claim 3 (depends on 1)

The method for generating the learned model according to claim 1, wherein the second data is generated by applying, to the first data, an expression detection model in which the plurality of feature points are set to a face.

### Claim 4 (depends on 1)

The method for generating the learned model according to claim 1, further comprising:
acquiring fourth data corresponding to at least one of physiological information acquired from the subject, body motion information of the subject, and voice information of the subject; and
generating the learned model by causing the neural network to learn using the fourth data as well.

### Claim 5 (depends on 1)

The method for generating the learned model according to claim 1, further comprising:
acquiring fifth data corresponding to at least one of background information of the subject; and
generating the learned model by causing the neural network to learn using the fifth data as well.

### Claim 6

A system for generating a learned model applied to a prediction device that predicts a probability that a subject develops delirium based on a moving image in which the subject appears, the system comprising:
an image processing device configured to generate, based on first data corresponding to the moving image in which the subject appears, second data corresponding to changes over time in relative positions of a plurality of feature points in a body of the subject in the moving image; and
a model generation device configured to generate the learned model by causing a neural network to learn using the second data and third data indicating a determination result as to whether the subject develops delirium, the determination result being made based on the moving image.

### Claim 7

A non-transitory computer-readable storage medium storing a computer program executable in a system for generating a learned model applied to a prediction device that predicts a probability that a subject develops delirium based on a moving image in which the subject appears, the computer program being executed to:
generate, by an image processing device included in the system, based on first data corresponding to the moving image in which the subject appears, second data corresponding to changes over time in relative positions of a plurality of feature points in a body of the subject in the moving image; and
generate, by a model generation device included in the system, the learned model by causing a neural network to learn using the second data and third data indicating a determination result as to whether the subject develops delirium, the determination result being made based on the moving image.

### Claim 8 (depends on 1)

A prediction device comprising:
an input interface configured to receive behavior data corresponding to changes over time in relative positions of a plurality of feature points in a body of a subject in a moving image in which the subject appears, the moving image being generated based on image data corresponding to the moving image;
a processor configured to acquire prediction data corresponding to a probability that the subject develops delirium by inputting the behavior data to a learned model generated by the method for generating the learned model according to claim 1; and
an output interface configured to output the prediction data.

### Claim 9 (depends on 8)

The prediction device according to claim 8,
wherein the input interface is configured to receive supplementary data including at least one of physiological information acquired from the subject, body motion information of the subject, and voice information of the subject, and
wherein the processor is configured to acquire the prediction data by inputting the supplementary data in addition to the behavior data to the learned model generated by the method for generating the learned model, which further includes acquiring fourth data corresponding to at least one of physiological information acquired from the subject, body motion information of the subject, and voice information of the subject and generating the learned model by causing the neural network to learn using the fourth data as well.

### Claim 10 (depends on 8)

The prediction device according to claim 8,
wherein the input interface is configured to receive background data including background information of the subject, and
wherein the processor is configured to acquire the prediction data by inputting the background data in addition to the behavior data to the learned model, the
generated by the method for generating the learned model, which further includes acquiring fifth data corresponding to at least one of background information of the subject and generating the learned model by causing the neural network to learn using the fifth data as well.

### Claim 11 (depends on 1)

A non-transitory computer-readable recording medium storing a computer program executable by a processor of a prediction device, the computer program being executed to, by the prediction device:
receive behavior data corresponding to changes over time in relative positions of a plurality of feature points in a body of a subject in a moving image in which the subject appears, the moving image being generated based on image data corresponding to the moving image;
acquire prediction data corresponding to a probability that the subject develops delirium by inputting the behavior data to a learned model generated by the method for generating the learned model according to claim 1; and
output the prediction data.

### Claim 12 (depends on 1)

A prediction system comprising:
an image processing device configured to generate, based on image data corresponding to a moving image in which a subject appears, behavior data corresponding to changes over time in relative positions of a plurality of feature points in a body of the subject in the moving image; and
a prediction device configured to acquire prediction data corresponding to a probability that the subject develops delirium by inputting the behavior data to a learned model generated by the method for generating the learned model according to claim 1, and output the prediction data.

### Claim 13 (depends on 12)

The prediction system according to claim 12, further comprising:
a user interface configured to input a determination result as to whether the subject develops delirium, the determination result being made by a medical worker based on the moving image corresponding to the image data; and
a training data generation device configured to generate the third data based on the determination result.
