Cascade dual-decoder based sign language producing device, method, and recording medium
AssigneeAjou University Industry-Academic Cooperation Foundation
InventorsTae-Sun CHUNG, Xiaohan MA, Rize JIN
Life of this patent
Estimating the term…
Loading patent…
AssigneeAjou University Industry-Academic Cooperation Foundation
InventorsTae-Sun CHUNG, Xiaohan MA, Rize JIN
Estimating the term…
Provided is a cascade dual-decoder based sign language producing device and method, and the device includes a text encoder configured to input a text sequence prepared in advance into at least one encoder block to output contextual features, a hand pose decoder configured to input the contextual features output from the text encoder and a hand pose sequence prepared in advance into at least one attention layer to output a hand-channel sign pose feature that aligns text and a hand motion, and a sign pose decoder configured to input the contextual features output from the text encoder and the hand pose decoder, the hand-channel sign pose feature, and a sign pose sequence prepared in advance into at least one attention layer to output a full-channel sign pose sequence in which the sign language is implemented as a hand element and a non-hand element.
A cascade dual-decoder based sign language producing device comprising:
A sign language producing method by a cascade dual-decoder-based sign language producing device, the sign language producing method comprising:
A recording medium having recorded thereon a computer program for performing a sign language producing method by a cascade dual-decoder-based sign language producing device, wherein the sign language producing method comprises:
Dependencies are inferred from the claim text.