Back to results
US 2026/0290369 A1Published application
System
AssigneeSoftBank Group Corp.
InventorYuta ARUGA
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to collect information based on a user request by using an information retrieval means, generate a prompt for instructing a generative AI model to convert the collected information into audio data, and add music and sound effects to the generated audio data.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, input data from a terminal device;
- generate query data based on the input data and transmit the query data to an information providing apparatus via the packet-switched network;
- receive document data from the information providing apparatus, and extract text data from the document data;
- generate an instruction sequence based on the text data and input the instruction sequence into a generative neural network model to cause the generative neural network model to generate structured output data, the structured output data including position information indicating insertion locations for supplementary signal segments;
- convert the structured output data into first signal data by synthesis processing and acquire time information associated with the first signal data;
- and
- generate edited signal data by combining the first signal data with a plurality of supplementary signal segments retrieved from a storage device based on the time information, the position information, and amplitude parameters defining volume relationships between the first signal data and each supplementary signal segment, and transmit the edited signal data to the terminal device via the communication interface.
5 more elements
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, topic information and preference parameters from a terminal device operated by a user;
- generate search condition information based on the topic information including at least a query string and a language restriction, and transmit the search condition information to an external information providing apparatus via the packet-switched network to acquire a plurality of document data items;
- extract text data from the plurality of document data items by a parsing operation that removes non-content regions and normalizes character encoding, and select a subset of the text data based on a relevance score;
- construct a prompt sentence that defines contents, narrative style, structure, and output length based on the text data and the topic information, and input the prompt sentence and the text data into a transformer-based generative neural network model to cause the transformer-based generative neural network model to generate script information divided into a plurality of sections together with instruction information indicating insertion positions for supplementary signal segments;
- convert the script information into narration signal data by a speech synthesis technique that generates phoneme sequences and produces waveform samples, and acquire alignment data indicating temporal positions within the narration signal data;
- and
- retrieve, from a storage device, background signal data and effect signal data corresponding to the instruction information, generate edited signal data by combining the narration signal data with the background signal data and the effect signal data based on the alignment data, the insertion positions, and volume parameters that set the background signal data at a lower amplitude than the narration signal data, and transmit the edited signal data to the terminal device via the communication interface.
5 more elements
A method performed by circuitry of a server coupled to a packet-switched network via a communication interface, the method comprising:
- receiving, via the communication interface, input data from a terminal device;
- generating query data based on the input data and transmitting the query data to an information providing apparatus via the packet-switched network;
- receiving document data from the information providing apparatus, and extracting text data from the document data;
- generating an instruction sequence based on the text data and inputting the instruction sequence into a generative neural network model to cause the generative neural network model to generate structured output data, the structured output data including position information indicating insertion locations for supplementary signal segments;
- converting the structured output data into first signal data by synthesis processing and acquiring time information associated with the first signal data;
- and
- generating edited signal data by combining the first signal data with a plurality of supplementary signal segments retrieved from a storage device based on the time information, the position information, and amplitude parameters defining volume relationships between the first signal data and each supplementary signal segment, and transmitting the edited signal data to the terminal device via the communication interface.
4 more elements
Dependencies are inferred from the claim text.