Question answer system based on analysis of speech and image in video and operation method therefor
AssigneeDATAEDU Inc.
InventorJongsik YOON
Life of this patent
Estimating the term…
Abstract
A question answer system for automatically generating an answer to a question of a user according to an exemplary embodiment of the present disclosure includes a user interface configured to receive a video URL address and the question from the user, a video analysis unit configured to download a video through the video URL address, divide the video into a plurality of sections, and recognize a speech, convert the speech into text, and extract text included in an image for each section to generate content of the video as text data, and a machine reading comprehension engine configured to receive the text data from the video analysis unit and extract the answer to the question from the text data.
Claims20
A question answer system for automatically generating an answer to a question of a user, the question answer system comprising:
- a user interface configured to receive a video URL address and the question from the user;
- a video analysis unit configured to download a video through the video URL address, divide the video into a plurality of sections, and recognize a speech, convert the speech into text, and extract text included in an image for each section to generate content of the video as text data;
- and
- a machine reading comprehension engine configured to receive the text data from the video analysis unit and extract the answer to the question from the text data.
An operation method for a question answer system for automatically generating an answer to a question of a user using at least one processor, the operation method comprising:
- receiving a video URL address and a question from a user by a user interface and the at least one processor;
- downloading, by the at least one processor, a video through the video URL address and dividing the video into a plurality of sections;
- generating, by the at least one processor, content of the video as text data by recognizing a speech, converting the speech into text, and extracting text included in an image for each section;
- and
- extracting, by the at least one processor, the answer to the question from the text data using a learned machine reading comprehension algorithm.
Dependencies are inferred from the claim text.