System
AssigneeSoftBank Group Corp.
InventorTakuya FUJITA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to record a user's meal content as image data, identify food ingredients by using an image analysis technique on the image data, and estimate nutrients based on the identified food ingredients, record a user's amount of exercise by using an accelerometer and a location information technique, and calculate energy expenditure based on recorded data, and evaluate a nutritional status of the user by using recorded data of the meal content and the amount of exercise, and create a prompt for instructing a generative AI model to recommend specific nutritional supplements or protein products.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, image data and time-series sensor data from a terminal device;
- transmit the image data to an object recognition resource, acquire identification result data from the object recognition resource, and associate the identification result data with reference entries stored in a database to generate component data;
- compute a first numerical parameter set based on the component data and quantity estimation data derived from the identification result data;
- compute a second numerical parameter set based on the time-series sensor data and position data acquired from a location information acquisition device of the terminal device;
- generate structured evaluation data by aggregating the first numerical parameter set and the second numerical parameter set over a predetermined period, comparing aggregated values with baseline reference data and target parameter data derived from attribute data of a user, and producing surplus-or-deficiency indicator data;
- construct a prompt data structure comprising a natural-language summary of the structured evaluation data, the attribute data, and instruction data specifying an output format and a content category, and transmit the prompt data structure to a generative neural network model via the packet-switched network;
- and
- acquire generated text data from the generative neural network model, store the generated text data in a history storage device in association with the user, and transmit the generated text data to the terminal device via the communication interface.
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, image data and sensor data from a terminal device;
- transmit the image data to an object recognition resource and acquire identification result data comprising classification labels and confidence scores;
- compute intake parameter data by associating the identification result data with reference entries in a structured information storage and aggregating quantitative attribute values corresponding to the reference entries;
- compute expenditure parameter data by applying intensity coefficient data to the sensor data and position data received from the terminal device;
- generate structured evaluation data by comparing the intake parameter data and the expenditure parameter data with baseline reference data derived from user attribute data, and producing indicator data representing a surplus or deficiency of each of a plurality of tracked parameters;
- construct a prompt data structure by generating a natural-language summary of the structured evaluation data and appending instruction data specifying an output format, transmit the prompt data structure to a generative neural network model, and acquire generated guidance data from the generative neural network model;
- and
- store the generated guidance data in a history storage device and transmit the generated guidance data to the terminal device via the communication interface.
A method performed by circuitry, the method comprising:
- receiving, via a communication interface coupled to a packet-switched network, image data and time-series sensor data from a terminal device;
- transmitting the image data to an object recognition resource and acquiring identification result data from the object recognition resource;
- computing a first numerical parameter set based on component data derived from the identification result data and reference entries stored in a database;
- computing a second numerical parameter set based on the time-series sensor data and position data acquired from a location information acquisition device of the terminal device;
- generating structured evaluation data by aggregating the first numerical parameter set and the second numerical parameter set over a predetermined period, comparing aggregated values with baseline reference data and target parameter data, and producing surplus-or-deficiency indicator data;
- constructing a prompt data structure comprising a natural-language summary of the structured evaluation data and instruction data specifying an output format, and transmitting the prompt data structure to a generative neural network model via the packet-switched network;
- and
- acquiring generated text data from the generative neural network model, storing the generated text data in a history storage device, and transmitting the generated text data to the terminal device via the communication interface.
Dependencies are inferred from the claim text.