# US 2020/0219536 A1 · Methods and apparatus for using edit operations to perform temporal track derivations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0219536 A1
- Document ID: US20200219536A1
- Status: Published application
- Kind: A1
- Application number: 16/737,349
- Filed: 2020-01-08
- Published: 2020-07-09
- Earliest claimed: 2019-01-09
- Assignees: MediaTek Singapore Pte. Ltd.
- Applicants: MEDIATEK Singapore Pte. Ltd.
- Inventors: Xin Wang; Lulin Chen
- Web page: https://patentgrep.com/patent/US20200219536A1

## CPC

- G11B 20/1217: {on discs}
- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- G11B 27/329: {on a disc [VTOC]}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- G11B 2020/10611: {3D video data}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

The techniques described herein relate to methods, apparatus, and computer readable media configured to access multimedia data comprising a hierarchical track structure with a first track of a first sequence of temporally-related media units at a first level, and a second track at a second level comprising metadata specifying a temporal track derivation operation. The metadata includes a set of one or more operations to perform on the first track, each operation including a unit duration of the first sequence and a start unit in the first sequence. The temporal track derivation operation is performed on a set of media units comprising at least the first sequence, and includes applying the set of one or more operations to temporally modify the first sequence to generate second media data for the second track that includes a second sequence of temporally-related media units from the set of media units.

## Claims

### Claim 1

A method implemented by at least one processor in communication with a memory, wherein the memory stores computer-readable instructions that, when executed by the at least one processor, cause the at least one processor to perform:
accessing multimedia data comprising a hierarchical track structure comprising at least:
a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of temporally-related media units; and
a second track at a second level in the hierarchical track structure that is different than the first level of the first track, the second track comprising metadata specifying a temporal track derivation operation, wherein the metadata comprises a set of one or more operations to perform on the first track, each operation of the set of one or more operations comprising:
a unit duration of the first sequence of temporally-related media units; and
a start unit in the first sequence of temporally-related media units; and
performing the temporal track derivation operation on a set of media units comprising at least the first sequence of temporally-related media units, comprising applying the set of one or more operations to temporally modify the first sequence of temporally-related media units to generate second media data for the second track, wherein the second media data comprises a second sequence of temporally-related media units from the set of media units.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the set of one or more operations remove a set of one or more media units of the first sequence of temporally-related media units; and
said performing the temporal track derivation operation on the set of media units comprises applying the set of one or more operations to remove the set of one or more media units from the first sequence of temporally-related media units to generate the second sequence of temporally-related media units.

### Claim 3 (depends on 2)

The method of claim 2, wherein:
the set of one or more operations comprise a first operation specifying a trim operation comprising:
a first unit duration of zero; and
a first unit specifying a last media unit of the set of one or more media units of the first sequence of temporally-related media units; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first operation to remove the set of one or more media units from a beginning portion of the first sequence of temporally-related media units through the unit.

### Claim 4 (depends on 2)

The method of claim 2, wherein:
the set of one or more operations comprise a first operation specifying a trim operation comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units; and
a first unit of zero; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first operation to remove the set of one or more media units from an end portion of the first sequence of temporally-related media units starting from the last media unit.

### Claim 5 (depends on 2)

The method of claim 2, wherein:
the set of one or more operations comprise:
a first operation specifying a first portion of a cut operation, comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units before the cut operation; and
a first unit of zero; and
a second operation specifying a second portion of the cut operation, comprising:
a second unit duration of zero; and
a second unit specifying a starting media unit of the first sequence of temporally-related media units after the cut operation, which is determined based on the last media unit plus the set of one or more media units; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first and second operations to remove the set of one or more media units from a middle portion of the first sequence of temporally-related media units starting after the last media unit and ending before the starting media unit.

### Claim 6 (depends on 1)

The method of claim 1, wherein:
the set of one or more operations comprise:
a first operation specifying a first portion of a cut operation, comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units before the cut operation; and
a first unit of zero; and
a second operation specifying a second portion of the cut operation, comprising:
a second unit duration of zero; and
a second unit specifying a starting media unit of the first sequence of temporally-related media units after the cut operation, which is determined based on the last media unit plus the set of one or more media units;
said performing the temporal track derivation operation on the set of media units comprises applying the first and second operations to generate the second sequence of temporally-related media units to include the set of one or more media units.

### Claim 7 (depends on 6)

The method of claim 6, wherein said performing the temporal track derivation operation on the set of media units comprises generating third media data for a third track at the second level in the hierarchical track structure that is different than the first level of the first track, the third media data comprising a third sequence of temporally-related media units, wherein the second sequence of temporally-related media units comprises a first set of all media units of the first sequence of temporally-related media units before the cut operation and the third sequence of temporally-related media units comprises a second set of all media units after a second cut operation.

### Claim 8 (depends on 7)

The method of claim 7, wherein:
the set of one or more operations comprise:
a third operation specifying a first portion of the second cut operation, comprising:
a third unit duration specifying a second last media unit of the first sequence of temporally-related media units before the cut operation; and
a third unit of zero; and
a fourth operation specifying a second portion of the second cut operation, comprising:
a fourth unit duration of zero; and
a fourth unit specifying a second starting media unit of the first sequence of temporally-related media units after the second cut operation, which is determined based on the second last media unit plus a second set of one or more media units; and
generating the third media data for the third track comprises applying the third and fourth operations to generate the third sequence of temporally-related media units to comprise the second set of one or more media units.

### Claim 9 (depends on 1)

The method of claim 1, wherein:
the hierarchical track structure further comprises a third track at a third level below the second level comprising third media data, wherein the third media data comprises a third sequence of temporally-related media units;
the metadata comprises a second set of one or more operations to perform on the third track, each operation comprising:
a second unit duration of the third sequence of temporally-related media units; and
a second unit in the third sequence of temporally-related media units; and
the set of media units further comprises the third sequence of temporally-related media units.

### Claim 10 (depends on 9)

The method of claim 9, wherein:
the set of one or more operations and the second set of one or more operations comprise empty operation sets; and
performing the temporal track derivation operation on the set of media units comprises joining the first sequence of temporally-related media units and the third sequence of temporally-related media units to generate the second sequence of temporally-related media units.

### Claim 11 (depends on 9)

The method of claim 9, wherein:
the set of one or more operations comprise a first operation specifying a first cut operation comprising:
a first unit duration specifying a first media unit representative of an end of a first set of the first sequence of temporally-related media units; and
a first unit of zero;
the second set of one or more operations comprising a second operation specifying a second cut operation comprising:
a second unit duration specifying a second media unit representative of an end of a second set of the third sequence of temporally-related media units; and
a second unit of zero; and
the metadata further comprises a third set of one or more operations to perform on the first track, the third set of one or more operations comprising a third operation specifying a third cut operation comprising:
a third unit duration of zero; and
a third unit specifying a third media unit representative of a beginning of a third set of the first sequence of temporally-related media units; and
said performing the temporal track derivation operation on the set of media units comprises:
applying the first operation to cut the first set of the first sequence of temporally-related media units from the first sequence of temporally-related media units;
applying the second operation to cut the second set of the third sequence of temporally-related media units from the third sequence of temporally-related media units;
applying the third operation to cut the third set of the first sequence of temporally-related media units from the first sequence of temporally-related media units; and
joining the first set, the second set, and the third set, so that the second set is between the first set and the second set.

### Claim 12

An apparatus comprising a processor in communication with memory, the processor being configured to execute instructions stored in the memory that cause the processor to perform:
accessing multimedia data comprising a hierarchical track structure comprising at least:
a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of temporally-related media units; and
a second track at a second level in the hierarchical track structure that is different than the first level of the first track, the second track comprising metadata specifying a temporal track derivation operation, wherein the metadata comprises a set of one or more operations to perform on the first track, each operation of the set of one or more operations comprising:
a unit duration of the first sequence of temporally-related media units; and
a start unit in the first sequence of temporally-related media units; and
performing the temporal track derivation operation on a set of media units comprising at least the first sequence of temporally-related media units, comprising applying the set of one or more operations to temporally modify the first sequence of temporally-related media units to generate second media data for the second track, wherein the second media data comprises a second sequence of temporally-related media units from the set of media units.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein:
the set of one or more operations remove a set of one or more media units of the first sequence of temporally-related media units; and
said performing the temporal track derivation operation on the set of media units comprises applying the set of one or more operations to remove the set of one or more media units from the first sequence of temporally-related media units to generate the second sequence of temporally-related media units.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein:
the set of one or more operations comprise a first operation specifying a trim operation comprising:
a first unit duration of zero; and
a first unit specifying a last media unit of the set of one or more media units of the first sequence of temporally-related media units; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first operation to remove the set of one or more media units from a beginning portion of the first sequence of temporally-related media units through the unit.

### Claim 15 (depends on 13)

The apparatus of claim 13, wherein:
the set of one or more operations comprise a first operation specifying a trim operation comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units; and
a first unit of zero; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first operation to remove the set of one or more media units from an end portion of the first sequence of temporally-related media units starting from the last media unit.

### Claim 16 (depends on 13)

The apparatus of claim 13, wherein:
the set of one or more operations comprise:
a first operation specifying a first portion of a cut operation, comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units before the cut operation; and
a first unit of zero; and
a second operation specifying a second portion of the cut operation, comprising:
a second unit duration of zero; and
a second unit specifying a starting media unit of the first sequence of temporally-related media units after the cut operation, which is determined based on the last media unit plus the set of one or more media units; and
said removing the set of one or more media units from the first sequence of temporally-related media units comprises applying the first and second operations to remove the set of one or more media units from a middle portion of the first sequence of temporally-related media units starting after the last media unit and ending before the starting media unit.

### Claim 17 (depends on 12)

The apparatus of claim 12, wherein:
the set of one or more operations comprise:
a first operation specifying a first portion of a cut operation, comprising:
a first unit duration specifying a last media unit of the first sequence of temporally-related media units before the cut operation; and
a first unit of zero; and
a second operation specifying a second portion of the cut operation, comprising:
a second unit duration of zero; and
a second unit specifying a starting media unit of the first sequence of temporally-related media units after the cut operation, which is determined based on the last media unit plus the set of one or more media units;
said performing the temporal track derivation operation on the set of media units comprises applying the first and second operations to generate the second sequence of temporally-related media units to include the set of one or more media units.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein said performing the temporal track derivation operation on the set of media units comprises generating third media data for a third track at the second level in the hierarchical track structure that is different than the first level of the first track, the third media data comprising a third sequence of temporally-related media units, wherein the second sequence of temporally-related media units comprises a first set of all media units of the first sequence of temporally-related media units before the cut operation and the third sequence of temporally-related media units comprises a second set of all media units after a second cut operation.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein:
the set of one or more operations comprise:
a third operation specifying a first portion of the second cut operation, comprising:
a third unit duration specifying a second last media unit of the first sequence of temporally-related media units before the cut operation; and
a third unit of zero; and
a fourth operation specifying a second portion of the second cut operation, comprising:
a fourth unit duration of zero; and
a fourth unit specifying a second starting media unit of the first sequence of temporally-related media units after the second cut operation, which is determined based on the second last media unit plus a second set of one or more media units; and
generating the third media data for the third track comprises applying the third and fourth operations to generate the third sequence of temporally-related media units to comprise the second set of one or more media units.

### Claim 20 (depends on 11)

The apparatus of claim 11, wherein:
the hierarchical track structure further comprises a third track at a third level below the second level comprising third media data, wherein the third media data comprises a third sequence of temporally-related media units;
the metadata comprises a second set of one or more operations to perform on the third track, each operation comprising:
a second unit duration of the third sequence of temporally-related media units; and
a second unit in the third sequence of temporally-related media units; and
the set of media units further comprises the third sequence of temporally-related media units.

### Claim 21

At least one computer readable storage medium storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to perform:
accessing multimedia data comprising a hierarchical track structure comprising at least:
a first track at a first level of the hierarchical track structure comprising first media data, wherein the first media data comprises a first sequence of temporally-related media units; and
a second track at a second level in the hierarchical track structure that is different than the first level of the first track, the second track comprising metadata specifying a temporal track derivation operation, wherein the metadata comprises a set of one or more operations to perform on the first track, each operation of the set of one or more operations comprising:
a unit duration of the first sequence of temporally-related media units; and
a start unit in the first sequence of temporally-related media units; and
performing the temporal track derivation operation on a set of media units comprising at least the first sequence of temporally-related media units, comprising applying the set of one or more operations to temporally modify the first sequence of temporally-related media units to generate second media data for the second track, wherein the second media data comprises a second sequence of temporally-related media units from the set of media units.
