Back to results
US 2026/0289165 A1Published application
System
AssigneeSoftBank Group Corp.
InventorMasaki HAMADA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to acquire sound, motion, and environmental information of animals and plants, perform preprocessing on the acquired information to convert the acquired information into an analyzable format, analyze a prompt that instructs estimation of a state of the animals and plants from a user, estimate the state of the animals and plants by using a generative artificial intelligence model based on the prompt and the analyzable format, and generate an answer based on the estimated state.
Claims20
A system comprising:
- circuitry configured to:
- acquire, via sensor devices coupled to a communication interface, acoustic data, image data, and environmental data related to an organism on a continuous or periodic basis;
- preprocess the acoustic data by performing sampling, normalization, noise reduction, and frequency-domain conversion to generate acoustic feature sequences, and preprocess the image data by performing decoding, resolution conversion, color-space conversion, and background separation to generate image feature sequences;
- input the acoustic feature sequences and the image feature sequences into an identification model comprising a machine learning model for time-series data analysis, and classify or cluster behavior patterns of the organism based on the feature sequences;
- construct and update, in a storage device, language system data encoding correspondence relationships between the behavior patterns and state data indicative of internal states of the organism;
- receive, from a terminal device, a prompt sentence comprising an interrogative sentence regarding a state of the organism, parse the prompt sentence to extract at least a target identifier, a time range, and a question intention;
- acquire, from the storage device, one or more behavior patterns and corresponding portions of the language system data matching the extracted target identifier and time range, and generate context data describing a current or past state of the target;
- generate a composite prompt data structure by combining the context data with the prompt sentence according to a predetermined prompt template;
- and
- transmit the composite prompt data structure to a generative neural network model to cause the generative neural network model to estimate the state of the organism based on the language system data and generate an answer sentence in natural language, and output the answer sentence to the terminal device.
7 more elements
A system comprising:
- circuitry configured to:
- acquire acoustic data, image data, and environmental data related to an organism from sensor devices via a communication interface;
- preprocess the acoustic data and the image data to generate feature sequences, and input the feature sequences into a machine learning model to classify behavior patterns;
- construct language system data encoding correspondence between the behavior patterns and state data of the organism;
- receive a prompt sentence from a terminal device, parse the prompt sentence, acquire matching behavior patterns and language system data, and generate a composite prompt data structure;
- transmit the composite prompt data structure to a generative neural network model to generate an answer sentence regarding the state of the organism;
- and
- output the answer sentence to the terminal device.
5 more elements
A method comprising:
- acquiring, by circuitry via sensor devices, acoustic data, image data, and environmental data related to an organism;
- preprocessing the acoustic data and the image data to generate feature sequences, and inputting the feature sequences into a machine learning model to classify behavior patterns;
- constructing language system data encoding correspondence between the behavior patterns and state data of the organism;
- receiving a prompt sentence from a terminal device, parsing the prompt sentence, acquiring matching behavior patterns and language system data, and generating a composite prompt data structure;
- transmitting the composite prompt data structure to a generative neural network model to generate an answer sentence regarding the state of the organism;
- and
- outputting the answer sentence to the terminal device.
4 more elements
Dependencies are inferred from the claim text.