Multimodal ai-based search for digital assets

A data center system comprising a plurality of computing nodes, wherein two or more computing nodes of the plurality of computing nodes comprises one or more graphics processing units (GPUs) to:

• receive a query associated with a first digital asset, the query being a natural language text sequence that includes a first set of characters representing a first condition for a first modality and a second set of characters representing a second condition for a second modality;
• compute a relevance score for at least a subset of digital assets of a set of digital assets by at least:
• parsing the natural language text sequence to detect the first condition for the first modality and the second condition for the second modality;
• and
• for each digital asset, of the subset of digital assets, performing a computer retrieval operation by mapping the first condition and the second condition to a respective composite index that associates, via at least one of a key or pointer, with a plurality of indices, each index, of the plurality of indices, representing data for a respective modality of the digital asset, wherein the computer retrieval operation accesses the data from the plurality of indices through the respective composite index;
• for each digital asset of the subset of digital assets, based at least in part on a measure in which the data across all modalities of the respective digital asset satisfies the first condition and the second condition, generate the relevancy score;
• compute a ranking for the subset of digital assets based at least on the query and the relevancy score;
• and
• based at least on the ranking, cause presentation, at a user device, of an indicator of at least the first digital asset.

A method comprising:

• mapping one or more parameters or one or more conditions of a user query to a plurality of indices, each sub-index of the plurality of sub-indices representing an association of the data with a respective modality associated with a digital asset;
• generating a multimodal profile for the digital asset by aggregating data obtained from the plurality of indices by associating an asset identifier to each index, of the plurality of indices, the asset identifier indicating an identity of the digital asset;
• based at least on the associating of the asset identifier to each index, of the plurality of indices, computing a relevance score for the digital asset, the relevance score indicating a measure in which the multimodal profile satisfies the one or more query parameters or conditions across each respective modality;
• and
• based at least on the relevance score, causing presentation of an indicator that represents at least the digital asset.