US 2024/0404284 A1 · DESCRIPTION GENERATION DEVICE, METHOD, AND PROGRAM

Abstract

An acquisition unit (30) acquires, for a work including a plurality of steps, a material feature quantity representing each material used in the task, and a video feature quantity extracted from each clip, which is a video of each step in which the task is captured. An updating unit (40) identifies an action for a material included in the clip based on the video feature quantity of each clip, and updates the material feature quantity of the identified material in accordance with the identified action. A generation unit (50) generates a sentence explaining a task procedure for each of the steps based on the updated material feature quantity, the specified action, and the video feature quantity.

Claims10

Dependent claims

A description generation device, comprising:

an acquiring section configured to acquire, for a task including a plurality of steps, material characteristic amounts expressing respective materials used in the task, and video characteristic amounts extracted from respective videos of each of the steps that capture the task;
an updating section configured to, based on the video characteristic amounts of the respective videos of each of the steps, specify actions with respect to materials that are included in the videos of each of the steps, and updates the material characteristic amounts of specified materials in accordance with specified actions;
and
a generating section configured to, based on the updated material characteristic amounts, the specified actions and the video characteristic amounts, generate sentences describing procedures of the task for each of the steps.

1 more element

Dependencies are inferred from the claim text.

Description generation device, method, and program

Life of this patent

Description generation device, method, and program

Life of this patent

Abstract

Claims10