System and method for dynamically normalized semantic distance and applications thereof

A machine readable non-transitory medium having information recorded thereon for assessing semantic distance, wherein the information, when read by the machine, causes the machine to perform the following:

• receiving, via the communication platform, a query;
• obtaining, via a document representation constructor, a first query representation of the query capturing characteristics of the query;
• obtaining, via a query representation constructor, a second query representation of the query capturing the characteristics of the query;
• determining, via a dynamic norm determiner, a dynamic norm based on a discrepancy between the first and the second query representations, wherein the dynamic norm is indicative of a bias between the document and query representation constructors;
• identifying a plurality of documents relevant to the query based on the second query representation;
• and
• for each of the plurality of documents,
• computing a similarity between the document represented by a document representation obtained via the document representation constructor and the query represented by the second query representation obtained via the query representation constructor, and
• determining a semantic distance between the query and the document based on the dynamic norm and the similarity, wherein the semantic distance is derived by adjusting a distance between the query and the document based on the dynamic norm to address the bias.

A system for assessing semantic distance, comprising:

• a document representation constructor implemented by a processor and configured for obtaining a first query representation of an input query capturing characteristics of the query;
• a query representation constructor implemented by the processor and configured for obtaining a second query representation of the input query capturing the characteristics of the query;
• a dynamic norm determiner implemented by the processor and configured for determining a dynamic norm based on a discrepancy between the first and the second query representations, wherein the dynamic norm is indicative of a bias between the document and query representation constructors;
• a relevant document identifier implemented by the processor and configured for
• identifying, based on the second query representation, a plurality of documents relevant to the input query, and
• for each of the plurality of documents, computing a similarity between the document represented by a document representation obtained via the document representation constructor and the query represented by the second query representation obtained via the query representation constructor;
• and
• a semantic distance determiner implemented by the processor and configured for determining a semantic distance between the input query and each of the plurality of documents based on the dynamic norm, wherein the semantic distance is derived by adjusting a distance between the query and the document based on the dynamic norm to address the bias.