Systems, devices, and methods for dynamic synchronization of a prerecorded vocal backing track to a vocal performance

Abstract

Disclosed are systems, methods, and devices, that overcome timing and self-expression limitations experienced by vocalists when using prerecorded vocal backing tracks. The disclosed system, devices, and methods, dynamically synchronizes prerecorded vocal backing tracks with a vocal stream by extracting vocal elements, such as phonemes, vector embeddings, or vocal audio spectra, from the vocal performance. These extracted vocal elements are matched against corresponding timestamped vocal elements previously derived from the prerecorded vocal backing track, enabling precise adjustment and alignment of the backing track timing to the vocalist's performance. Additionally, the system enhances expressive performance by identifying prosody factors, such as pitch, vibrato, accent, stress, dynamics, and level, in the vocal performance, and dynamically adjusting corresponding prerecorded prosody factors within predefined ranges. This maintains naturalness and spontaneity in the vocalist's performance, overcoming traditional limitations associated with prerecorded vocal backing tracks.

Dependencies are inferred from the claim text.