Beatboxing transcription
AssigneeLemon Inc.
InventorsBochen Li, Rodrigo Castellon, Daiyu Zhang, Jitong Chen
Life of this patent
Estimating the term…
Abstract
Methods, systems, and storage media for generating a beatbox transcript are disclosed. Some examples may include: receiving an audio signal having a plurality of beatbox sounds, generating a spectrogram of the audio signal, processing the spectrogram of the audio signal with a neural network model trained on training samples including beatbox sounds, generating, by the neural network model a beatbox sound activation map including a plurality of activation times for a plurality of beatbox sounds, decoding the beatbox sound activation map into a beatbox transcript and providing the beatbox transcript as an output.
Claims20
A method for generating a beatbox transcript, the method comprising:
- receiving an audio signal having a plurality of beatbox sounds, wherein the plurality of beatbox sounds include beatbox vocals;
- generating a spectrogram of the audio signal;
- generating a beatbox sound activation map including a plurality of activation times for the plurality of beatbox sounds based on the spectrogram of the audio signal, further comprising processing the spectrogram of the audio signal with a neural network model trained on training samples that include sample beatbox sounds to generate the beatbox sound activation map including the plurality of activation times;
- decoding the beatbox sound activation map into a beatbox transcript;
- and
- providing the beatbox transcript as an output, wherein the beatbox transcript includes instrumental music matching the beatbox sound activation map.
A system, comprising:
- one or more hardware processors configured by machine-readable instructions to:
- receive an audio signal having a plurality of beatbox sounds, wherein the plurality of beatbox sounds include beatbox vocals;
- generate a spectrogram of the audio signal;
- generate a beatbox sound activation map including a plurality of activation times for the plurality of beatbox sounds based on the spectrogram of the audio signal by processing the spectrogram of the audio signal with a neural network model trained on training samples including sample beatbox sounds;
- decode the beatbox sound activation map into a beatbox transcript;
- and
- provide the beatbox transcript as an output, wherein the beatbox transcript includes instrumental music matching the beatbox sound activation map.
A non-transient computer-readable storage medium comprising instructions being executable by one or more processors, that when executed by the one or more processors, cause the one or more processors to:
- receive an audio signal having a plurality of beatbox sounds, wherein the plurality of beatbox sounds include beatbox vocals;
- generate a spectrogram of the audio signal;
- generate a beatbox sound activation map including a plurality of activation times for the plurality of beatbox sounds based on the spectrogram of the audio signal by processing the spectrogram of the audio signal with a neural network model trained on training samples including sample beatbox sounds;
- decode the beatbox sound activation map into a beatbox transcript;
- and
- provide the beatbox transcript as an output, wherein the beatbox transcript includes instrumental music matching the beatbox sound activation map.
Dependencies are inferred from the claim text.