Back to results
US 2026/0289883 A1Published application
System
AssigneeSoftBank Group Corp.
InventorYudai HATTA
Life of this patent
Estimating the term…
Abstract
A system comprising a processor, wherein the processor is configured to: collect, from a call, a voice characteristic and a speaking tone of a user and convert the collected voice characteristic and speaking tone into voice feature data, analyze text associated with the user to extract a personal text style feature of the user from the text and generate text style feature data, and generate a virtual person representing the user based on past image data associated with the user.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, acoustic information from a terminal device, convert the acoustic information into acoustic data in a format that excludes personally identifiable information, and store the acoustic data in a storage device;
- apply an acoustic analysis program to the acoustic data to compute acoustic feature quantities comprising pitch, speaking rate, intonation, intensity, and pausing pattern, compute characteristic quantities indicative of a speaking tone, and structure the characteristic quantities as non-personal acoustic feature data;
- apply a document analysis program to document data to extract document feature quantities indicative of writing style, vocabulary selection, and syntactic structure, and store the document feature quantities as non-personal document feature data in association with the non-personal acoustic feature data in the storage device;
- apply an image analysis program to image data to extract appearance feature quantities of a person and generate virtual person generation data defining at least an appearance and a behavior of a virtual person based on the appearance feature quantities, the non-personal acoustic feature data, and the non-personal document feature data;
- and
- generate a prompt sentence using the non-personal document feature data, input the prompt sentence to a generative neural network model to obtain generated document data reflecting the document feature quantities, and store the generated document data in association with the virtual person generation data in the storage device.
4 more elements
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, acoustic information from a terminal device, apply a signal processing pipeline to compute acoustic feature quantities comprising pitch contours, speaking rate statistics, intonation profiles, intensity envelopes, and pausing patterns, and structure the computed quantities as non-personal acoustic feature data by replacing source identifiers with an anonymized session identifier;
- apply a natural language processing pipeline comprising tokenization, part-of-speech tagging, dependency parsing, and vocabulary frequency analysis to document data to extract document feature quantities, and compute writing style feature vectors using term frequency-inverse document frequency weighting and syntactic complexity statistics;
- apply a convolutional neural network to image data to extract appearance feature vectors and generate virtual person generation data comprising a parametric appearance model, a motion behavior model derived from the non-personal acoustic feature data, and a speech behavior model derived from the acoustic feature quantities;
- generate a prompt sentence embedding the writing style feature vectors and syntactic structure features as structured input sections and input the prompt sentence to a generative neural network model to produce generated document data conditioned on lexical density and syntactic complexity targets;
- and
- associate the generated document data with the virtual person generation data by synchronizing text tokens with animation frame intervals derived from the motion behavior model, and store the associated data in a storage device.
4 more elements
A method comprising:
- receiving, via a communication interface coupled to a packet-switched network, acoustic information from a terminal device, converting the acoustic information into acoustic data excluding personally identifiable information, and applying an acoustic analysis program to compute acoustic feature quantities comprising pitch, speaking rate, intonation, intensity, and pausing pattern;
- applying a document analysis program to document data to extract document feature quantities indicative of writing style, vocabulary selection, and syntactic structure;
- applying an image analysis program to image data to extract appearance feature quantities and generating virtual person generation data based on the appearance feature quantities, the acoustic feature quantities, and the document feature quantities;
- generating a prompt sentence using the document feature quantities and inputting the prompt sentence to a generative neural network model to produce generated document data reflecting the document feature quantities;
- and
- storing the generated document data in association with the virtual person generation data.
3 more elements
Dependencies are inferred from the claim text.