# US 2015/0104153 A1 · Multimedia Distribution System

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0104153 A1
- Document ID: US20150104153A1
- Status: Published application
- Kind: A1
- Application number: 14/281,791
- Filed: 2014-05-19
- Published: 2015-04-16
- Earliest claimed: 2003-12-08
- Assignees: Sonic IP, Inc.
- Applicants: Sonic IP, Inc.
- Inventors: Jason Braness; Christopher Durham; Timothy Sayre; Benjamin Cote; Darrius Nguyen Thompson; Jerome Rota; Alastair Mayo; Eric William Grab; Jerald Donaldson; Heather Hitchcock; Damien Chavarria; Michael John Floyd; Ashan Butt; Brian Fudge; Adam H. Li
- Web page: https://patentgrep.com/patent/US20150104153A1

## CPC

- H04N 5/278: Subtitling
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- G11B 20/00086: {Circuits for prevention of unauthorised reproduction or copying, e.g. piracy (indicating unauthorised use of record carriers in general G11B23/28; scrambling for television signal recording H04N5/913; network architectures or network protocols for network security H04L63/00; cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00)}
- G11B 20/00731: {involving a digital rights management system for enforcing a usage restriction}
- H04N 5/265: Mixing
- H04N 5/85: on discs or drums
- H04N 5/92: Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N 9/8047: {using transform coding}
- H04N 19/44: Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
- H04N 21/4856: {for language selection, e.g. for the menu or subtitles}
- H04N 21/845: Structuring of content, e.g. decomposing content into time segments
- G11B 20/00739: {wherein the usage restriction is associated with a specific geographical region}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A multimedia file and methods of generating, distributing and using the multimedia file are described. Multimedia files in accordance with embodiments of the present invention can contain multiple video tracks, multiple audio tracks, multiple subtitle tracks, data that can be used to generate a menu interface to access the contents of the file and ‘meta data’ concerning the contents of the file. Multimedia files in accordance with several embodiments of the present invention also include references to video tracks, audio tracks, subtitle tracks and ‘meta data’ external to the file. One embodiment of a multimedia file in accordance with the present invention includes a series of encoded video frames and encoded menu information.

## Claims

### Claim at position 1

1-10. (canceled)

### Claim 11

A system for decoding multimedia files, comprising a processor configured by software to extract information from the multimedia file;
characterized in that the processor is configured by software to inspect the multimedia file to determine if there is at least one subtitle track;
wherein the multimedia file includes:
a header for identifying said file and providing the residual length of said file after said header;
a plurality of chunks for carrying information, said chunks including a plurality of video chunks, a plurality of audio chunks, a plurality of subtitle chunks, and an index chunk;
said video chunks being portions of at least one video track, said video track comprising a series of encoded video frames;
said audio chunks being portions of at least one audio track;
said subtitle chunks being portions of at least one subtitle track, said subtitle chunks including information concerning a start time and a stop time;
said index chunk carrying information supplying references to the location within said file of each of said video chunks;
wherein said audio chunks, subtitle chunks, and video chunks are interleaved so that the audio and subtitle chunks are located within the file prior to the video chunks containing information concerning the video frames to which they correspond;
and wherein the video chunk following a subtitle chunk includes the portion of said video track that occurs at the start time of the particular subtitle contained within said subtitle chunk and the audio chunk preceding a video chunk contains the portion of the audio track corresponding to the portion of the video track contained in said video chunk;
wherein the processor is configured and instructed to access information from the multimedia file using software to:
decode a video chunk and identify a previous subtitle chunk that contains subtitle information for the decoded video chunk to construct a frame of video for display by superimposing the subtitle from the identified subtitle chunk on the decoded video frame, by:
making a determination as to whether the previous video frame included a subtitle;
if the timing information for the subtitle indicates that the subtitle should be displayed with the current frame, then the subtitle is superimposed on the decoded video frame; and
if the previous frame did not include a subtitle or the timing information for the subtitle on the previous frame indicates that the subtitle should not be displayed in conjunction with the currently decoded frame, then a subtitle chunk for a selected subtitle track is sought and, if a subtitle chunk is located, then the subtitle is superimposed on the decoded video.

### Claim 12 (depends on 11)

The system for decoding multimedia files of claim 11, wherein:
each subtitle chunk includes information concerning the position within a frame in which the subtitle should be located; and
the processor is configured by software to superimpose the subtitle in the position within each video frame indicated by the information within the subtitle chunk.

### Claim 13 (depends on 11)

The system for decoding multimedia files of claim 11, wherein:
a subtitle chunk includes information concerning the color of the subtitle; and
the processor is configured by software to superimpose the subtitle in the color indicated by the color information within the subtitle chunk.

### Claim 14 (depends on 11)

The system of claim 11, wherein the video chunks 1 through n−1 contain sufficient information for a decoder to decode the video frame n.

### Claim 15 (depends on 11)

The system of claim 11, wherein the audio chunks are interleaved between the video chunks such that the video chunks are separated by audio chunk from each of the audio tracks and the audio chunks separating the video chunks contain audio information for the portions of the audio tracks corresponding to the video information contained within the video chunk following the audio chunk.

### Claim 16 (depends on 11)

The system of claim 11, wherein the encoded audio track is provided in chunks that do not contain audio information corresponding to the contents of a corresponding video chunk, and encoding the at least one encoded audio track encoded as audio chunks involve identifying the audio information in the encoded audio track that accompanies the video chunk and extracting the audio information from the existing audio chunks to create a new audio chunk.

### Claim 17 (depends on 11)

The system of claim 11, wherein the audio and subtitle chunks are interleaved between the video chunks such that each particular audio/subtitle chunk is placed relative to a corresponding video chunk based on an amount of video capable of being buffered by a device capable of displaying the multimedia file.

### Claim 18

A multimedia file including:
a header for identifying said file and providing the residual length of said file after said header;
a plurality of chunks for carrying information, said chunks including a plurality of video chunks, a plurality of audio chunks, a plurality of subtitle chunks, and an index chunk;
said audio chunks being portions of at least one audio track;
said subtitle chunks being portions of at least one subtitle track, said subtitle chunks including information concerning a start time and a stop time for the particular subtitle contained within said subtitle chunk;
said video chunks being portions of at least one video track, said video track comprising a series of encoded video frames;
said index chunk carrying information supplying references to the location within said file of each of said video chunks;
wherein said audio chunks, subtitle chunks, and video chunks are interleaved so that the audio and subtitle chunks are located within the file prior to the video chunks containing information concerning the video frames to which they correspond; and
wherein the video chunk following a subtitle chunk includes the portion of said video track that occurs at the start time of the particular subtitle contained within said subtitle chunk and the audio chunk preceding a video chunk contains the portion of the audio track corresponding to the portion of the video track contained in said video chunk.

### Claim 19 (depends on 18)

The multimedia file of claim 18, wherein a subtitle chunk includes information capable of being represented as text on a display.

### Claim 20 (depends on 19)

The multimedia file of claim 19, wherein a subtitle chunk includes information concerning the position of the subtitle on a screen where the subtitle should be located.

### Claim 21 (depends on 18)

The multimedia file of claim 18, wherein the audio chunks are interleaved between the video chunks such that the video chunks are separated by audio chunks from each of the audio tracks and the audio chunks separating the video chunks contain audio information for the portions of the audio tracks corresponding to the video information contained within the video chunk following the audio chunk.

### Claim 22 (depends on 18)

The multimedia file of claim 18, wherein the audio and subtitle chunks are interleaved between the video chunks such that each particular audio/subtitle chunk is placed relative to a corresponding video chunk based on an amount of video capable of being buffered by a device capable of displaying the multimedia file.

### Claim 23 (depends on 18)

The multimedia file of claim 18, wherein video chunks 1 through n−1 contain sufficient information for a decoder to decode the video frame n.

### Claim 24

A system for encoding multimedia files, characterized by a processor configured to:
encode at least one video track as a plurality of video chunks;
encode at least one audio track as audio chunks;
encode at least one subtitle track as a plurality of subtitle chunks, wherein each subtitle chunk includes information concerning a subtitle, each subtitle chunk includes information concerning a start time and a stop time for the subtitle;
encode at least one index chunk that includes information concerning the location of video chunks within the multimedia file;
interleave said audio chunks, subtitle chunks, and video chunks so that the audio and subtitle chunks are located within the file prior to the video chunks containing information concerning the video frames to which they correspond, and so that the video chunk following a subtitle chunk includes the portion of said video track that occurs at the start time of the particular subtitle contained within said subtitle chunk and the audio chunk preceding a video chunk contains the portion of the audio track corresponding to the portion of the video track contained in said video chunk; and
write the interleaved chunks to a single file.

### Claim 25 (depends on 24)

The system of claim 24, wherein a plurality of subtitle tracks is encoded as a plurality of subtitle chunks.

### Claim 26 (depends on 24)

The system of claim 24, wherein the audio, video and subtitle chunks are interleaved such that the video chunk immediately following the audio and subtitle chunk contains the first video frame corresponding to the audio or subtitle.

### Claim 27 (depends on 24)

The system of claim 24, wherein the encoded audio track is provided in chunks that do not contain audio information corresponding to the contents of a corresponding video chunk, and encoding the at least one encoded audio track encoded as audio chunks involve identifying the audio information in the encoded audio track that accompanies the video chunk and extracting the audio information from the existing audio chunks to create a new audio chunk.

### Claim 28 (depends on 24)

The system of claim 24, wherein the audio chunks are interleaved between the video chunks such that the video chunks are separated by audio chunks from each of the audio tracks and the audio chunks separating the video chunks contain audio information for the portions of the audio tracks corresponding to the video information contained within the video chunk following the audio chunk.

### Claim 29 (depends on 24)

The system of claim 24, wherein the audio and subtitle chunks are interleaved between the video chunks such that each particular audio/subtitle chunk is placed relative to a corresponding video chunk based on an amount of video capable of being buffered by a device capable of displaying the multimedia file.

### Claim 30 (depends on 24)

The system of claim 24, wherein video chunks 1 through n−1 contain sufficient information for a decoder to decode the video frame n.
