Back to results
US 12,640,127 B2Granted
Interactive movement audio engine
AssigneeLemon Inc.
InventorsBochen Li, Daiyu Zhang, Shawn Chan Zhen Yi, Jitong Chen
Life of this patent
Estimating the term…
Abstract
A method for generating an audio output is described. Image inputs of interactive movements by a user captured by an image sensor are received. The interactive movements are mapped to a sequence of audio element identifiers. The sequence of audio element identifiers are processed to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers. An audio output that represents the musical sequence is generated.
Claims20
A method for generating an audio output, the method comprising:
- receiving image inputs of interactive movements by a user captured by an image sensor;
- displaying to the user an output image that comprises a graphical user interface overlaid on the image inputs, wherein the interactive movements comprise a plurality of user elements of the user that overlap with a corresponding plurality of icons the graphical user interface;
- mapping each of the plurality of user elements of the interactive movements so that the user element overlaps with the corresponding icon of the plurality of icons of the graphical user interface to a sequence of audio element identifiers;
- processing the sequence of audio element identifiers to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers, wherein processing the audio element identifiers comprises:
- receiving one or more selectable music theory rules that enforce corresponding elements of music theory;
- modifying at least one audio element identifier of the sequence of audio element identifiers that violates a music theory rule when the violated music theory rule is at least one of the one or more received selectable music theory rules;
- and
- generating the musical sequence based on the modified audio element identifier;
- and
- generating an audio output that represents the musical sequence.
7 more elements
A system for generating an audio output, the system comprising:
- one or more hardware processors configured by machine-readable instructions to:
- receive image inputs of interactive movements by a user captured by an image sensor;
- display to the user an output image that comprises a graphical user interface overlaid on the image inputs, wherein the interactive movements comprise a plurality of user elements of the user that overlap with a corresponding plurality of icons the graphical user interface;
- map each of the plurality of user elements of the interactive movements so that the user element overlaps with the corresponding icon of the plurality of icons of the graphical user interface to a sequence of audio element identifiers;
- process the sequence of audio element identifiers to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers, wherein processing the audio element identifiers comprises:
- receive one or more selectable music theory rules that enforce corresponding elements of music theory;
- modify at least one audio element identifier of the sequence of audio element identifiers that violates a music theory rule when the violated music theory rule is at least one of the one or more received selectable music theory rules;
- and
- generate the musical sequence based on the modified audio element identifier;
- and
- generate an audio output that represents the musical sequence.
8 more elements
A non-transient computer-readable storage medium comprising instructions being executable by one or more processors, that when executed by the one or more processors, cause the one or more processors to:
- receive image inputs of interactive movements by a user captured by an image sensor;
- display to the user an output image that comprises a graphical user interface overlaid on the image inputs, wherein the interactive movements comprise a plurality of user elements of the user that overlap with a corresponding plurality of icons the graphical user interface;
- map each of the plurality of user elements of the interactive movements so that the user element overlaps with the corresponding icon of the plurality of icons of the graphical user interface to a sequence of audio element identifiers;
- process the sequence of audio element identifiers to generate a musical sequence by performing music theory rule enforcement on the sequence of audio element identifiers, wherein processing the audio element identifiers comprises:
- receive one or more selectable music theory rules that enforce corresponding elements of music theory;
- modify at least one audio element identifier of the sequence of audio element identifiers that violates a music theory rule when the violated music theory rule is at least one of the one or more received selectable music theory rules;
- and
- generate the musical sequence based on the modified audio element identifier;
- and
- generate an audio output that represents the musical sequence.
7 more elements
Dependencies are inferred from the claim text.