Back to results
US 2026/0290291 A1Published application
System
AssigneeSoftBank Group Corp.
InventorMasahiro OKUI
Life of this patent
Estimating the term…
Abstract
A system includes a processor that is configured to receive, as inputs, a user voice, text data, a humming melody, and a type of music, analyze the text data using natural language processing techniques and generate formatted text data, analyze music data based on music theory and generate an arranged piece of music, and generate a prompt sentence by using a generative AI model, perform sentiment analysis based on the generated prompt sentence, and reflect a result of the sentiment analysis in generation of the arranged piece of music.
Claims20
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, user voice information, character information, melody information represented by voice, and music type information from a terminal device;
- convert the user voice information and the melody information represented by voice into character information using a speech recognition component, and generate basic data by integrating the converted character information with the received character information;
- construct, based on the basic data and the music type information, a prompt sentence in a natural language including emotion information and structure information, and transmit model input information including the prompt sentence to a generative neural network model;
- obtain, from the generative neural network model, music information including musical structure information and performance information, and output the music information as symbolic information or waveform information;
- when the music information is the symbolic information, convert the symbolic information into an acoustic waveform by a synthesis process and encode the acoustic waveform as a digital music file in a standardized acoustic data format;
- and
- store the digital music file in a storage device associated with identification information and attribute information to generate distribution information enabling an external terminal to access the digital music file, and accumulate record information representing a correspondence among the basic data, the prompt sentence, identification information of the generative neural network model, and the digital music file.
5 more elements
A system comprising:
- circuitry configured to:
- receive, via a communication interface coupled to a packet-switched network, user voice information, character information, melody information represented by voice, and music type information from a terminal device;
- convert the user voice information and the melody information into character information using a speech recognition component and generate basic data by integrating the converted character information with the received character information;
- analyze the user voice information and the melody information in a time domain or a frequency domain to extract melody feature information and rhythm feature information, analyze the character information using a natural language processing program to generate shaped character information, and construct a prompt sentence including the melody feature information, the rhythm feature information, the shaped character information, and the music type information;
- transmit the prompt sentence to a generative neural network model and obtain music design information including musical structure information, chord progression information, and arrangement instruction information;
- generate musical description information including pitch information and time information from the music design information, execute a music encoding program to generate control information sequences, and convert the control information sequences into an acoustic waveform by a synthesis process;
- extract speaker feature information from the user voice information, execute a voice synthesis process based on the speaker feature information to synthesize a vocal audio signal, mix the vocal audio signal with an accompaniment audio signal to produce a digital music file;
- and
- store the digital music file with identification information and distribution information in a storage device, and transmit distribution information enabling access to the digital music file to the terminal device via the communication interface.
6 more elements
A method comprising:
- receiving, via a communication interface coupled to a packet-switched network, user voice information, character information, melody information represented by voice, and music type information from a terminal device;
- converting the user voice information and the melody information represented by voice into character information using a speech recognition component, and generating basic data by integrating the converted character information with the received character information;
- constructing, based on the basic data and the music type information, a prompt sentence in a natural language including emotion information and structure information, and transmitting model input information including the prompt sentence to a generative neural network model;
- obtaining, from the generative neural network model, music information including musical structure information and performance information, and outputting the music information as symbolic information or waveform information;
- when the music information is the symbolic information, converting the symbolic information into an acoustic waveform by a synthesis process and encoding the acoustic waveform as a digital music file in a standardized acoustic data format;
- and
- storing the digital music file in a storage device associated with identification information and attribute information to generate distribution information enabling an external terminal to access the digital music file, and accumulating record information representing a correspondence among the basic data, the prompt sentence, identification information of the generative neural network model, and the digital music file.
4 more elements
Dependencies are inferred from the claim text.