# US 2021/0174837 A1 · Template-Based Excerpting and Rendering of Multimedia Performance

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0174837 A1
- Document ID: US20210174837A1
- Status: Published application
- Kind: A1
- Application number: 16/939,679
- Filed: 2020-07-27
- Published: 2021-06-10
- Earliest claimed: 2019-07-12
- Assignees: Smule, Inc.
- Applicants: Smule, Inc.
- Inventors: Jeffrey Christopher SMITH; Perry Raymond Cook; David Adam Steinwedel; Ka Yee Chan
- Web page: https://patentgrep.com/patent/US20210174837A1

## CPC

- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/036: Insert-editing
- G10H 1/366: {with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice}
- H04N 9/8715: {involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal}
- G10H 2210/091: for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
- G10H 2210/331: Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale
- G10H 2240/175: for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor
- G10H 2240/251: Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analogue or digital, e.g. DECT, GSM, UMTS
- G10H 2250/311: Neural networks for electrophonic musical instruments or musical processing, e.g. for musical recognition or control, automatic composition or improvisation
- H04N 21/2187: Live feed
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G10H: ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed herein are computer-implemented method, system, and computer-readable storage-medium embodiments for implementing template-based excerpting and rendering of multimedia performances technologies. An embodiment includes at least one computer processor configured to retrieve a first content instance and corresponding first metadata. The first content instance may include a first plurality of structural elements, with at least one structural element corresponding to at least part of the first metadata. The first content instance may be transformed by a rendering engine running on the at least one computer processor and/or transmitted to a content-playback device.

## Claims

### Claim 1

A computer-implemented method, comprising:
retrieving, by at least one computer processor, a first content instance and corresponding first metadata, wherein the first content instance comprises a first plurality of structural elements, and wherein at least one structural element of the first plurality of structural elements corresponds to at least part of the first metadata;
transforming, by a rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to at least an applicable parameter of a first template and the first metadata; and
transmitting, by the at least one computer processor, the first content instance, as transformed, to a content-playback device.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising:
retrieving, by the at least one computer processor, a second content instance and corresponding second metadata, wherein the first content instance further comprises a second plurality of structural elements, and wherein at least one structural element of the second plurality of structural elements corresponds to at least part of the second metadata; and
transforming, by the rendering engine running on the at least one computer processor, the second content instance, wherein the transforming comprises configuring the at least one structural element of the second content instance to be played back according to the applicable parameter of the first template.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, further comprising:
applying, by the at least one computer processor, a logic-based filter, a machine-learning process, or a combination thereof, to select a segment of the first content instance or of the second content instance, as at least part of the at least one structural element.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the logic-based filter, the machine-learning process, or the combination thereof, comprise at least one key performance indicator (KPI)-style input configured to measure user engagement.

### Claim 5 (depends on 2)

The computer-implemented method of claim 2, further comprising receiving, by the at least one computer processor, a recording created by an end user, wherein the recording corresponds to at least one of the first content instance or the second content instance.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, further comprising:
selecting, by the at least one computer processor, a second template comprising a set of parameters, wherein a given parameter of the set of parameters is applicable to the at least one structural element of the first plurality of structural elements; and
transforming, by the rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to the given parameter of the second template.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the first template has been generated via an end user.

### Claim 8

A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed by at least one computer processor, cause the at least one computer processor to perform operations comprising:
retrieving a first content instance and corresponding first metadata, wherein the first content instance comprises a first plurality of structural elements, and wherein at least one structural element of the first plurality of structural elements corresponds to at least part of the first metadata;
transforming, by a rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to at least an applicable parameter of a first template and the first metadata; and
transmitting the first content instance, as transformed, to a content-playback device.

### Claim 9 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the operations further comprising:
retrieving a second content instance and corresponding second metadata, wherein the first content instance further comprises a second plurality of structural elements, and wherein at least one structural element of the second plurality of structural elements corresponds to at least part of the second metadata; and
transforming, by the rendering engine running on the at least one computer processor, the second content instance, wherein the transforming comprises configuring the at least one structural element of the second content instance to be played back according to the applicable parameter of the first template.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, the operations further comprising:
applying, by the at least one computer processor, a logic-based filter, a machine-learning process, or a combination thereof, to select a segment of the first content instance or of the second content instance, as at least part of the at least one structural element.

### Claim 11 (depends on 10)

The non-transitory computer-readable storage medium of claim 10, wherein the logic-based filter, the machine-learning process, or the combination thereof, comprise at least one key performance indicator (KPI)-style input configured to measure user engagement.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, the operations further comprising receiving, by the at least one computer processor, a recording created by an end user, wherein the recording corresponds to at least one of the first content instance or the second content instance.

### Claim 13 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, the operations further comprising:
selecting a second template comprising a set of parameters, wherein a given parameter of the set of parameters is applicable to the at least one structural element of the first plurality of structural elements; and
transforming, by the rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to the given parameter of the second template, and wherein the first template or the second template has been generated via an end user.

### Claim 14 (depends on 8)

The non-transitory computer-readable storage medium of claim 8, wherein the first template has been generated via an end user.

### Claim 15

A system comprising, comprising memory and at least one computer processor configured to perform operations comprising:
retrieving a first content instance and corresponding first metadata, wherein the first content instance comprises a first plurality of structural elements, and wherein at least one structural element of the first plurality of structural elements corresponds to at least part of the first metadata;
transforming, by a rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to at least an applicable parameter of a first template and the first metadata; and
transmitting the first content instance, as transformed, to a content-playback device.

### Claim 16 (depends on 15)

The system of claim 15, the operations further comprising:
retrieving a second content instance and corresponding second metadata, wherein the first content instance further comprises a second plurality of structural elements, and wherein at least one structural element of the second plurality of structural elements corresponds to at least part of the second metadata; and
transforming, by the rendering engine running on the at least one computer processor, the second content instance, wherein the transforming comprises configuring the at least one structural element of the second content instance to be played back according to the applicable parameter of the first template.

### Claim 17 (depends on 16)

The system of claim 16, the operations further comprising:
applying, by the at least one computer processor, a logic-based filter, a machine-learning process, or a combination thereof, to select a segment of the first content instance or of the second content instance, as at least part of the at least one structural element.

### Claim 18 (depends on 17)

The system of claim 17, wherein the logic-based filter, the machine-learning process, or the combination thereof, comprise at least one key performance indicator (KPI)-style input configured to measure user engagement.

### Claim 19 (depends on 16)

The system of claim 16, the operations further comprising receiving, by the at least one computer processor, a recording created by an end user, wherein the recording corresponds to at least one of the first content instance or the second content instance.

### Claim 20 (depends on 15)

The system of claim 15, the operations further comprising:
selecting a second template comprising a set of parameters, wherein a given parameter of the set of parameters is applicable to the at least one structural element of the first plurality of structural elements; and
transforming, by the rendering engine running on the at least one computer processor, the first content instance, wherein the transforming comprises configuring the at least one structural element of the first content instance to be played back according to the given parameter of the second template.

### Claim 21 (depends on 15)

The system of claim 15, wherein the first template has been generated via an end user.
