Audiovisual sampling for percussion-type instrument with crowd-sourced content sourcing and distribution
AssigneeSmule, Inc.
InventorsNick Kruge, Ge Wang, Perry R. Cook
Life of this patent
Estimating the term…
Abstract
Building on a set of captured audiovisual segments clipped to provide a palette of audio and synched video, techniques and implementations described herein facilitate a new and highly-personalized (and in some cases crowd-sourced or sourcable) genre of audiovisual sampling and musical performance. Using a palette of captured and/or imported audio and associated video, users can remix to create a coordinated audiovisual performance. Because the audiovisual sampling and musical performance capabilities can be hosted on ubiquitous handheld or other portable computing devices such as smartphones and/or pad-type computers, user/musicians can, in essence, creatively remix their life.
Claims24
A method comprising:
- using a portable computing device for capture and performance of a coordinated plurality of audiovisual clips, the portable computing device having a multi-touch display surface, and video camera and microphone interfaces;
- responsive to a first user selection and to detection of an audio trigger in a first audio stream of an audiovisual performance captured from the video camera and microphone interfaces, selecting first audiovisual clip thereof;
- responsive to further successive user selections and to further successive detections of the audio trigger in audio streams of respective further audiovisual performances captured from the video camera and microphone interfaces, selecting additional audiovisual clips thereof;
- on the multi-touch display surface, presenting the user with a palette of display tiles each corresponding to an audiovisual clip, wherein at least some of the display tiles respectively correspond to the first and additional audiovisual clips,
- the display tiles each being independently and concurrently selectable based on user interface gestures of the user on the multi-touch display surface to render the corresponding audiovisual clips as a coordinated performance of the audio and visual portions of the audiovisual clips.
A portable computing device comprising:
- a multi-touch display surface;
- video camera and microphone interfaces;
- and storage;
- audiovisual clip selection code executable on the portable computing device, the audiovisual clip selection code responsive to user selection and to detection of an audio trigger in an audio stream of an audiovisual performance captured from the video camera and microphone interfaces to select respective audiovisual clips of the audiovisual performance and store media encodings thereof in the storage;
- and
- user interface code executable on the portable computing device to present, on the multi-touch display surface, the user with a palette of display tiles each corresponding to an audiovisual clip, wherein at least some of the display tiles respectively correspond to the audiovisual clips from the captured the audiovisual performance, the display tiles each being independently and concurrently selectable based on user interface gestures of the user on the multi-touch display surface to render the corresponding audiovisual clips as a coordinated performance of the audio and visual portions of the audiovisual clips.
Dependencies are inferred from the claim text.