Back to results
US 2026/0290312 A1Published application
System
AssigneeSoftBank Group Corp.
InventorHirotaka GOTO
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to collect, from a database, past message histories and call records of a deceased person, analyze the collected data to extract a speaking tone, expressions, and thinking patterns of the deceased person, construct a generative artificial intelligence model based on the analyzed data, generate a prompt sentence based on input from a user, input the generated prompt sentence into the generative artificial intelligence model to generate a response that mimics the speaking tone of the deceased person, and provide the generated response to the user.
Claims19
A system comprising:
- a communication interface connected to a packet-switched network;
- and
- circuitry configured to:
- acquire, from a data storage device, communication record data associated with a reference speaker, the communication record data comprising at least character-based communication history data and audio record data;
- normalize the communication record data into structured data organized on a conversation basis and a speaker basis;
- execute natural-language processing on the character-based communication history data to extract linguistic feature data comprising lexical selection tendencies, sentence structure patterns, and response patterns specific to the reference speaker;
- execute audio signal processing on the audio record data to extract acoustic feature data comprising audio feature quantities specific to the reference speaker;
- construct, using the linguistic feature data and the acoustic feature data in combination with a pre-trained language generation model, a speaker-adapted generative neural network model whose parameters are adjusted to conform to an expression style of the reference speaker;
- receive, via the communication interface, input data comprising a natural-language input from a terminal device;
- generate a prompt data structure based on the input data, the prompt data structure including at least one of a conversation topic indicator, situation information, and a constraint parameter indicating the expression style;
- transmit the prompt data structure to the speaker-adapted generative neural network model and receive, from the speaker-adapted generative neural network model, response data comprising a text output generated by autoregressive token generation that imitates the expression style of the reference speaker;
- and
- transmit the response data to the terminal device via the communication interface.
10 more elements
A system comprising:
- a communication interface connected to a packet-switched network;
- a data storage device;
- and
- circuitry configured to:
- acquire, from the data storage device, communication record data associated with a reference speaker;
- extract, by natural-language processing and audio signal processing, linguistic feature data and acoustic feature data specific to the reference speaker;
- construct a speaker-adapted generative neural network model based on the linguistic feature data and the acoustic feature data;
- receive, via the communication interface, input data from a terminal device;
- generate a prompt data structure based on the input data and a language style model derived from the linguistic feature data;
- transmit the prompt data structure to the speaker-adapted generative neural network model and receive response data imitating an expression style of the reference speaker;
- generate a synthesized audio signal based on the response data and the acoustic feature data;
- and
- transmit at least one of the response data and the synthesized audio signal to the terminal device via the communication interface.
10 more elements
A method comprising:
- acquiring, by circuitry, from a data storage device, communication record data associated with a reference speaker, the communication record data comprising character-based communication history data and audio record data;
- executing, by the circuitry, natural-language processing on the character-based communication history data to extract linguistic feature data specific to the reference speaker;
- executing, by the circuitry, audio signal processing on the audio record data to extract acoustic feature data specific to the reference speaker;
- constructing, by the circuitry, a speaker-adapted generative neural network model based on the linguistic feature data and the acoustic feature data;
- receiving, via a communication interface connected to a packet-switched network, input data from a terminal device;
- generating, by the circuitry, a prompt data structure based on the input data;
- transmitting the prompt data structure to the speaker-adapted generative neural network model and receiving response data comprising a text output that imitates an expression style of the reference speaker;
- and
- transmitting the response data to the terminal device via the communication interface.
6 more elements
Dependencies are inferred from the claim text.