Back to results
US 2026/0253438 A1Published application
System
AssigneeSoftBank Group Corp.
InventorYo OE
Life of this patent
Estimating the term…
Abstract
A system according to an embodiment includes a recording unit, an identification unit, and a proposal unit. The recording unit records purchase information. The identification unit identifies a medicine corresponding to a symptom based on information recorded by the recording unit. The proposal unit proposes arrangement of an ambulance or a hospital visit based on the medicine identified by the identification unit.
Claims20
A system comprising:
- a communication interface configured to communicate with a client terminal via a packet-switched network;
- a processor;
- a random-access memory;
- a memory storing a data generation model obtained by deep learning on a neural network, and an emotion identification model;
- a database;
- and
- circuitry configured to:
- receive, from the client terminal via the communication interface, image data captured by a camera of the client terminal;
- extract structured data from the image data by performing at least one of optical character recognition or code decoding using a convolutional neural network, and store the extracted structured data in the database;
- receive, from the client terminal via the communication interface, query data comprising at least one of text data or voice data;
- convert the query data into a feature vector, calculate a similarity between the feature vector and reference vectors stored in the database, and identify a record from the database based on the calculated similarity;
- estimate an emotion of the user by applying the emotion identification model to sensor data received from the client terminal via the communication interface;
- generate, using the data generation model, inference data comprising at least one of a recommendation text or an action proposal, based on the identified record and an urgency score calculated from the query data;
- and
- transmit the inference data to the client terminal via the communication interface and the packet-switched network, the inference data causing the client terminal to present the inference data to the user.
12 more elements
A system comprising:
- a communication interface configured to communicate, via a packet-switched network conforming to at least one of a 5G, Wi-Fi, or Bluetooth communication standard, with a client terminal comprising a touch panel, a microphone, a speaker, a camera having a CMOS image sensor, and a display;
- a processor;
- a random-access memory;
- a memory storing a data generation model obtained by deep learning on a neural network, and an emotion identification model;
- a database;
- and
- circuitry configured to:
- receive, from the client terminal via the communication interface, image data captured by the camera having the CMOS image sensor;
- extract structured data from the image data by performing at least one of optical character recognition using a convolutional neural network or code decoding, and store the extracted structured data in the database;
- receive, from the client terminal via the communication interface, query data comprising at least one of text data input via the touch panel or voice data captured by the microphone;
- convert the query data into a feature vector using an encoder of the data generation model, calculate a similarity between the feature vector and reference vectors stored in the database, and identify a record from the database based on the calculated similarity;
- estimate an emotion of the user by applying the emotion identification model to at least one of the voice data captured by the microphone or image data captured by the camera;
- generate, using the data generation model, inference data comprising at least one of a recommendation text or an action proposal, based on the identified record and an urgency score calculated from the query data;
- adjust at least one of a presentation method or a level of detail of the inference data based on the estimated emotion;
- and
- transmit the inference data to the client terminal via the communication interface and the packet-switched network, the inference data causing the client terminal to present the inference data to the user via at least one of the display or the speaker.
13 more elements
A method performed by circuitry of a data processing system comprising a processor, a random-access memory, a memory storing a data generation model obtained by deep learning on a neural network and an emotion identification model, a database, and a communication interface, the method comprising:
- receiving, from a client terminal via the communication interface and a packet-switched network, image data captured by a camera of the client terminal;
- extracting structured data from the image data by performing at least one of optical character recognition or code decoding using a convolutional neural network, and storing the extracted structured data in the database;
- receiving, from the client terminal via the communication interface, query data comprising at least one of text data or voice data;
- converting the query data into a feature vector, calculating a similarity between the feature vector and reference vectors stored in the database, and identifying a record from the database based on the calculated similarity;
- estimating an emotion of the user by applying the emotion identification model to sensor data received from the client terminal via the communication interface;
- generating, using the data generation model, inference data comprising at least one of a recommendation text or an action proposal, based on the identified record and an urgency score calculated from the query data;
- and
- transmitting the inference data to the client terminal via the communication interface and the packet-switched network, the inference data causing the client terminal to present the inference data to the user.
5 more elements
Dependencies are inferred from the claim text.