Information processing method and information processing system for sound synthesis utilizing identification data associated with sound source and performance styles

An information processing system comprising:

• at least one memory storing a program;
• and
• at least one processor that implements the program to:
• provide a piece of sound source data, which has been obtained by encoding first identification data that identifies a sound source, wherein the piece of sound source data represents acoustic features of the sound source, represented as an embedding vector in a first multidimensional space;
• provide a piece of style data, which has been obtained by encoding second identification data that identifies a performance style, wherein the piece of style data represents acoustic features of sound generated by the sound source in the performance style, represented as an embedding vector in a second multidimensional space;
• generate, using a synthesis model generated by machine learning, feature data representative of acoustic features of a target sound of the sound source to be generated in the performance style and according to sound conditions, by inputting into the synthesis model:
• the piece of sound source data,
• the piece of style data, and
• generate an audio signal corresponding to the target sound using the generated feature data.

A non-transitory medium storing a program executable by a computer to execute a method comprising:

• providing a piece of sound source data by encoding first identification data that identifies a sound source, wherein the piece of sound source data represents acoustic features of the sound source, represented as an embedding vector in a first multidimensional space;
• providing a piece of style data by encoding second identification data that identifies a performance style, wherein the piece of style data represents acoustic features of sound generated by the sound source in the performance style, represented as an embedding vector in a second multidimensional space;
• generating, using a synthesis model generated by machine learning, feature data representative of acoustic features of a target sound of the sound source to be generated in the performance style and according to sound conditions, by inputting into the synthesis model:
• the piece of sound source data,
• the piece of style data, and
• synthesis data representative of the sounding conditions;
• and
• generating an audio signal corresponding to the target sound using the generated feature data.