System
AssigneeSoftBank Group Corp.
InventorKohei HAGIHARA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to: collect daily life data of a user through a sensor device and an application, and analyze the collected data to manage an amount of exercise of the user and meal content of the user; analyze voice data and text data of the user to recognize an emotion of the user and adjust content of advice and encouragement based on a recognition result, and generate a prompt for providing the advice and the encouragement to the user by using a generative artificial intelligence model; and generate, by using the prompt, a coach that imitates a person or a character preferred by the user.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, from a terminal device, time-series sensor data and multimodal input data associated with a user;
- apply a first neural network model to the multimodal input data to generate a state classification label representing a detected condition of the user;
- generate, based on the time-series sensor data and the state classification label, a numerical feature vector encoding a plurality of attributes of the user;
- construct a natural-language prompt sentence incorporating at least a portion of the numerical feature vector and the state classification label;
- execute a generative neural network model with the natural-language prompt sentence as an input to produce structured output data comprising an inference result and a persona-adapted output representation;
- and
- transmit, via the communication interface coupled to the packet-switched network, the structured output data to the terminal device for presentation to the user.
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, from a terminal device, time-series sensor data and multimodal input data associated with a user;
- apply a first neural network model to the multimodal input data to generate a state classification label;
- preprocess the time-series sensor data using a tabular data processing function to generate feature information, and apply a machine-learning feature transformation function to the feature information to produce a numerical feature vector;
- construct a natural-language prompt sentence incorporating the numerical feature vector and the state classification label, the natural-language prompt sentence comprising explicit instructions specifying a required output format and style constraints;
- execute a generative neural network model with the natural-language prompt sentence as an input to produce structured output data comprising an inference result and a persona-adapted output representation including profile information and one or more guidance messages;
- and
- transmit, via the communication interface coupled to the packet-switched network, the structured output data to the terminal device.
A method performed by circuitry, the method comprising:
- receiving, via a communication interface coupled to a packet-switched network, from a terminal device, time-series sensor data and multimodal input data associated with a user;
- applying a first neural network model to the multimodal input data to generate a state classification label representing a detected condition of the user;
- generating, based on the time-series sensor data and the state classification label, a numerical feature vector encoding a plurality of attributes of the user;
- constructing a natural-language prompt sentence incorporating at least a portion of the numerical feature vector and the state classification label;
- executing a generative neural network model with the natural-language prompt sentence as an input to produce structured output data comprising an inference result and a persona-adapted output representation;
- and
- transmitting, via the communication interface coupled to the packet-switched network, the structured output data to the terminal device for presentation to the user.
Dependencies are inferred from the claim text.