Back to results
US 2026/0289890 A1Published application
System
AssigneeSoftBank Group Corp.
InventorNoriyuki KASAI
Life of this patent
Estimating the term…
Abstract
A system including a processor, wherein the processor is configured to receive, as input, an episode and an image relating to a past memory provided by a user, and analyze the episode and the image using natural language processing techniques to recognize an emotion of the user, generate, based on the recognized emotion, a prompt for instructing a generative artificial intelligence model to generate a story, and automatically create a visually appealing animation based on the generated story by using an image generation technique.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, descriptive information and imaging information associated with a past event from a terminal device operated by a user;
- analyze the descriptive information using a natural language processing function to extract event summary information, subject information, temporal information, location information, and emotion information;
- analyze the imaging information using an image analysis function to extract subject-matter information, scene information, and facial expression information;
- generate an integrated feature representation of the past event based on the event summary information, the subject information, the temporal information, the location information, the emotion information, the subject-matter information, the scene information, and the facial expression information;
- construct a prompt sentence comprising the integrated feature representation and input the prompt sentence to a generative neural network model to obtain generated content output from the generative neural network model;
- generate, based on the generated content, a plurality of frame images using an image generation model, and assemble the frame images into a visual output sequence;
- and
- transmit the visual output sequence to the terminal device via the communication interface.
6 more elements
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, descriptive information and imaging information associated with a past event from a terminal device operated by a user;
- apply tokenization, named entity recognition, and sentiment classification to the descriptive information to extract event summary information, temporal information, location information, and emotion information comprising an emotion label and an emotion intensity score;
- apply an object detection model and a facial expression classifier to the imaging information to extract subject-matter information, scene information, and facial expression information;
- generate an integrated feature representation by concatenating the extracted information into a structured text representation, construct a prompt sentence encoding the integrated feature representation with generation instruction prefixes, and input the prompt sentence to a transformer-based generative neural network model to obtain generated content;
- generate a plurality of frame images by inputting image generation prompts derived from segments of the generated content to an image generation model, and assemble the frame images into a visual output sequence;
- and
- transmit the visual output sequence to the terminal device via the communication interface.
5 more elements
A method comprising:
- receiving, via a communication interface coupled to a packet-switched network, descriptive information and imaging information associated with a past event from a terminal device operated by a user;
- analyzing the descriptive information using a natural language processing function to extract event summary information, subject information, temporal information, location information, and emotion information;
- analyzing the imaging information using an image analysis function to extract subject-matter information, scene information, and facial expression information;
- generating an integrated feature representation of the past event based on the event summary information, the subject information, the temporal information, the location information, the emotion information, the subject-matter information, the scene information, and the facial expression information;
- constructing a prompt sentence comprising the integrated feature representation and inputting the prompt sentence to a generative neural network model to obtain generated content output from the generative neural network model;
- generating, based on the generated content, a plurality of frame images using an image generation model, and assembling the frame images into a visual output sequence;
- and
- transmitting the visual output sequence to the terminal device via the communication interface.
5 more elements
Dependencies are inferred from the claim text.