Loading patent…
AssigneeAncestry.com Operations Inc.
InventorsJiayun Li, Mohammad K. Ebrahimpour, Azadeh Moghtaderi, Yen-Yun Yu
Estimating the term…
Techniques for training a machine-learning (ML) model for captioning images are disclosed. A plurality of feature vectors and a plurality of visual attention maps are generated by a visual model of the ML model based on an input image. Each of the plurality of feature vectors correspond to different regions of the input image. A plurality of caption attention maps are generated by an attention model of the ML model based on the plurality of feature vectors. An attention penalty is calculated based on a comparison between the caption attention maps and the visual attention maps. A loss function is calculated based on the attention penalty. One or both of the visual model and the attention model are trained using the loss function.
A computer-implemented method of training a machine learning model for captioning images, the computer-implemented method comprising:
A hardware storage device having stored thereon computer-executable instructions that, when executed by one or more processors, configure a computer system to perform at least the following:
A system comprising:
Dependencies are inferred from the claim text.