Image questioning and answering method, apparatus, device and storage medium
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsXiameng Qin, Yulin Li, Ju Huang, Qunyi Xie, Junyu Han
Life of this patent
Estimating the term…
Loading patent…
AssigneeBeijing Baidu Netcom Science Technology Co., Ltd.
InventorsXiameng Qin, Yulin Li, Ju Huang, Qunyi Xie, Junyu Han
Estimating the term…
The present application discloses an image questioning and answering method, apparatus, device and storage medium, relating to the technical field of image processing, computer vision, deep learning and natural language processing. The specific implementation solution is as follows: constructing a question graph with a topological structure and extracting a question feature of a query sentence, according to the query sentence; constructing a visual graph with a topological structure and a text graph with a topological structure according to a target image corresponding to the query sentence; performing fusion on the visual graph, the text graph and the question graph by using a fusion model, to obtain a final fusion graph; and determining reply information of the query sentence according to a reasoning feature extracted from the final fusion graph and the question feature.
An image questioning and answering method, comprising:
An image questioning and answering apparatus, comprising:
The image questioning and answering apparatus according to claim wherein, when executing at least one of the computer programs, the processor is configured to further perform operations comprising:
Dependencies are inferred from the claim text.