AI-Based System for Vocal Lyric Modification
OwnerJohn Chowhan Parkinventor
Life of this patent
Estimating the term…
Abstract
A system and method leveraging artificial intelligence to modify song lyrics while preserving the unique vocal characteristics of the original artist, including pitch, timbre, and expressive style. The system processes an input music file, separates vocal and instrumental components, and uses a trained singing voice model to synthesize a modified vocal track that seamlessly integrates new lyrics. The output retains the original artist's distinct vocal qualities, ensuring a realistic and natural rendition. Applications include content localization, personalized music production, and media streaming, enabling efficient lyric customization without requiring re-recording by the artist.
Claims21
A system comprising:
- at least one processor;
- and
- memory including instructions operable to be executed by the at least one processor to configure the system to:
- identify a first voice part in first vocal data that needs to be replaced, wherein the first vocal data captures a singing or vocal performance by an artist;
- load or initialize a singing voice model, wherein the singing voice model is trained with at least one song or audio data containing the artist's voice, or is configured to take conditional data that includes the artist's voice or data specifying or capturing vocal characteristics of the artist;
- generate linguistic data from input data;
- generate a second voice part through a process that includes performing inference with the singing voice model conditioned on the linguistic data;
- and
- replace the first voice part in the first vocal data with the second voice part to generate second vocal data;
- wherein the singing voice model is developed, adapted, trained, or configured using neural network, machine learning, or artificial intelligence.
A system comprising:
- at least one processor;
- and
- memory including instructions operable to be executed by the at least one processor to configure the system to:
- load or initialize a singing voice model;
- generate a voice part through a process that includes performing inference with the singing voice model conditioned on input data;
- and
- serially extend a first audio segment with the voice part to generate a second audio segment, wherein the first audio segment captures a singing or vocal performance by an artist;
- wherein the singing voice model data is developed, adapted, trained, or configured using neural network, machine learning, or artificial intelligence.
Dependencies are inferred from the claim text.