Back to results
US 2026/0288860 A1Published application
System
AssigneeSoftBank Group Corp.
InventorTsukasa SEKITA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to extract visual features from an image or a video, generate a prompt sentence that instructs a search of an information set based on the extracted visual features, and search the information set by using a generative AI model and generate an information list having high relevance.
Claims20
A system comprising:
- circuitry configured to:
- acquire, via a communication interface coupled to a packet-switched network, media data comprising visual frame data transmitted from a terminal device;
- convert the media data into a normalized tensor representation and extract a multidimensional feature vector from the normalized tensor representation by propagating the normalized tensor representation through a neural network feature extractor;
- construct a prompt data structure on the basis of the multidimensional feature vector and transmit the prompt data structure to a generative neural network model to obtain response data comprising candidate identifiers;
- compute a similarity measure between the multidimensional feature vector and a stored feature representation associated with each of the candidate identifiers to generate a relevance-scored data structure;
- apply a ranking model to the relevance-scored data structure to compute a ranking score for each candidate identifier and generate a ranked data structure ordered by the ranking scores;
- and
- transmit the ranked data structure to the terminal device via the packet-switched network.
5 more elements
A system comprising:
- circuitry configured to:
- acquire, via a communication interface coupled to a packet-switched network, media data comprising visual frame data including at least one of image data and video data transmitted from a terminal device;
- convert the media data into a normalized tensor representation by decoding the visual frame data into pixel matrices and normalizing pixel values, and extract a multidimensional feature vector by propagating the normalized tensor representation through a convolutional neural network feature extractor comprising a plurality of convolutional layers and obtaining activations from an intermediate feature extraction layer;
- construct a prompt data structure by mapping numerical ranges of the multidimensional feature vector to qualitative descriptive labels and assembling the qualitative descriptive labels with preference profile data of a user into a natural language template, and transmit the prompt data structure to a generative neural network model comprising a Transformer-based architecture that predicts output tokens via softmax probability computation to obtain response data comprising candidate identifiers with associated descriptive attributes;
- compute a similarity measure between the multidimensional feature vector and a stored feature representation associated with each of the candidate identifiers using a vector similarity operation to generate a relevance-scored data structure;
- apply a ranking model comprising a neural network with embedding layers and fully connected layers to the relevance-scored data structure and the preference profile data to compute an individuality evaluation value for each candidate identifier, and generate a ranked data structure ordered by the individuality evaluation values;
- store, as record information, the prompt data structure, the candidate identifiers, and the response data, and update generation conditions for constructing subsequent prompt data structures on the basis of accumulated record information;
- and
- transmit the ranked data structure to the terminal device via the packet-switched network.
6 more elements
A method performed by circuitry of a server coupled to a packet-switched network via a communication interface, the method comprising:
- acquiring, via the communication interface, media data comprising visual frame data transmitted from a terminal device;
- converting the media data into a normalized tensor representation and extracting a multidimensional feature vector from the normalized tensor representation by propagating the normalized tensor representation through a neural network feature extractor;
- constructing a prompt data structure on the basis of the multidimensional feature vector and transmitting the prompt data structure to a generative neural network model to obtain response data comprising candidate identifiers;
- computing a similarity measure between the multidimensional feature vector and a stored feature representation associated with each of the candidate identifiers to generate a relevance-scored data structure;
- applying a ranking model to the relevance-scored data structure to compute a ranking score for each candidate identifier and generating a ranked data structure ordered by the ranking scores;
- and
- transmitting the ranked data structure to the terminal device via the packet-switched network.
4 more elements
Dependencies are inferred from the claim text.