Deep learning-based language processing device, deep learning-based language processing method, and non-transitory computer-readable medium

A deep learning-based language processing method comprising, by at least one processor:

• acquiring medical examination article strings including at least a medical examination article t(n) at a predetermined timing and a medical examination article t(i) at a different timing;
• referring, in an attention mechanism in an Encoder of a Transformer, to a string of first tokens constituting the medical examination article t(n) as input and a string of second tokens constituting the medical examination article t(i) as memory to generate context information regarding the string of first tokens, wherein the context information is information including the attention level of the string of second tokens relative to the string of first tokens;
• and
• generating meaning information corresponding to the string of first tokens with reference to the context information.

A non-transitory computer-readable medium stored with a program for causing a computer to execute processes of:

• acquiring medical examination article strings including at least a medical examination article t(n) at a predetermined timing and a medical examination article t(i) at a different timing;
• referring, in an attention mechanism in an Encoder of a Transformer, to a string of first tokens constituting the medical examination article t(n) as input and a string of second tokens constituting the medical examination article t(i) as memory to generate context information regarding the string of first tokens, wherein the context information is information including the attention level of the string of second tokens relative to the string of first tokens;
• and
• generating meaning information corresponding to the string of first tokens with reference to the context information.