Back to results
US 2026/0288799 A1Published application
System
AssigneeSoftBank Group Corp.
InventorRino ABE
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to conduct, with a generative AI model, a conversation with a candidate regarding a predetermined theme and to analyze content of the conversation, analyze a statement, a facial expression, and a voice tone of the candidate by using an emotion recognition engine to estimate an emotion of the candidate, and generate a report that evaluates characteristics and emotional aspects of the candidate based on a result of the analysis of the conversation and a result of emotion recognition.
Claims20
A system comprising:
- circuitry configured to:
- acquire, via a communication interface coupled to a packet-switched network, topic selection data from a terminal device, retrieve a topic description from an information storage device based on the topic selection data, and construct an initial instruction sequence comprising the topic description and a dialogue policy parameter, and input the initial instruction sequence into a generative neural network model comprising a transformer-based architecture to acquire an initial query output;
- transmit the initial query output to the terminal device via the communication interface, acquire response data from the terminal device, store the response data in the information storage device in association with a session identifier and a timestamp, construct a context sequence comprising prior dialogue records and a control instruction, and input the context sequence into the generative neural network model to acquire a follow-up query output, and repeat the acquiring, storing, and constructing until a termination condition is satisfied to produce a dialogue transcript;
- acquire multimodal signal data from the terminal device during the dialogue, the multimodal signal data comprising image frame data and audio segment data, preprocess the image frame data by executing a face region extraction operation and a spatial normalization operation, preprocess the audio segment data by computing spectral feature representations, and input the preprocessed image frame data and the spectral feature representations into respective neural network models to compute emotion estimation data comprising probability distributions over a plurality of affective state categories;
- construct an analysis instruction sequence comprising the dialogue transcript and the emotion estimation data, input the analysis instruction sequence into the generative neural network model, and acquire analysis output data comprising attribute descriptors and behavioral pattern classifications;
- compute a composite assessment score by applying a weighted integration operation to the analysis output data and the emotion estimation data, and generate structured assessment output data comprising the composite assessment score, summary text, and supporting evidence references;
- and
- store the structured assessment output data in the information storage device and transmit the structured assessment output data to the terminal device via the communication interface.
5 more elements
A system comprising:
- circuitry configured to:
- manage a dialogue session with an entity via a terminal device coupled to a packet-switched network by iteratively constructing instruction sequences based on accumulated dialogue records and inputting the instruction sequences into a generative neural network model comprising a transformer-based architecture to acquire generated query outputs, and storing the generated query outputs and response data in an information storage device;
- acquire multimodal signal data from the terminal device during the dialogue session, extract feature representations from the multimodal signal data using neural network models, and compute affective state classification data based on the extracted feature representations;
- construct an analysis instruction sequence based on the accumulated dialogue records and the affective state classification data, input the analysis instruction sequence into the generative neural network model, and acquire analysis output data;
- and
- generate structured assessment output data by integrating the analysis output data and the affective state classification data using a weighted scoring operation, and transmit the structured assessment output data to the terminal device via the communication interface.
3 more elements
A system comprising:
- circuitry configured to:
- conduct a multi-turn dialogue with a terminal device via a communication interface coupled to a packet-switched network by iteratively generating query outputs using a generative neural network model and accumulating response data to produce a dialogue transcript;
- acquire multimodal signal data during the dialogue, compute affective state data by processing the multimodal signal data through neural network classifiers, and temporally align the affective state data with dialogue turns in the dialogue transcript;
- input the dialogue transcript and the affective state data into the generative neural network model to acquire attribute analysis data;
- and
- generate assessment output data by computing a composite score from the attribute analysis data and the affective state data, and transmit the assessment output data to the terminal device.
3 more elements
Dependencies are inferred from the claim text.