# US 2006/0067580 A1 · Consumer electronic device supporting navigation of multimedia content across multiple camera views of a scene

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0067580 A1
- Document ID: US20060067580A1
- Status: Published application
- Kind: A1
- Application number: 10/932,658
- Filed: 2004-09-01
- Published: 2006-03-30
- Earliest claimed: 2004-09-01
- Inventors: C.C. Lee; Mohammed Visharam; Ali Tabatabai
- Web page: https://patentgrep.com/patent/US20060067580A1

## CPC

- G06F 16/483: using metadata automatically derived from the content
- G06F 16/40: of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70)
- G11B 27/105: {of operating discs}
- G11B 27/322: {used signal is digitally coded}
- H04N 5/9205: {the additional signal being at least another television signal}
- H04N 5/9206: {the additional signal being a character code signal}
- H04N 7/163: {by receiver means only}
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)}
- H04N 21/458: Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules {; time-related management operations (arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10)}
- H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A consumer electronic device includes a storage sub-system to store multimedia data associated with multiple camera views of a scene and metadata describing the multimedia data in separate tracks defined by a media file format. Each of the separate tracks corresponds to one of the multiple camera views of the scene. The consumer electronic device also includes a content processor to switch between the multiple camera views at run time using the metadata stored in the separate tracks.

## Claims

### Claim 1

A consumer electronic device comprising:
a storage sub-system to store multimedia data associated with a plurality of camera views of a scene and metadata describing the multimedia data associated with the plurality of camera views of the scene in separate tracks defined by a media file format, each of the separate tracks corresponding to one of the plurality of camera views of the scene; and
a content processor to switch between the plurality of views at run time using the metadata stored in the separate tracks.

### Claim 2 (depends on 1)

The device of claim 1 wherein the consumer electronic device is anyone of a personal video recorder (PVR) and a set-top box.

### Claim 3 (depends on 1)

The device of claim 1 wherein the storage sub-system comprises a hard drive.

### Claim 4 (depends on 1)

The device of claim 1 wherein metadata stored in each of the separate tracks comprises a random access table providing a list of random access frames for a corresponding one of the plurality of camera views of the scene.

### Claim 5 (depends on 4)

The device of claim 4 wherein the metadata stored in each of the separate tracks further comprises a timestamp table providing a timestamp for all frames including the random access frames in the list.

### Claim 6 (depends on 1)

The device of claim 1 wherein the media file format is an International Organization for Standardization (ISO) base file format.

### Claim 7 (depends on 1)

The device of claim 1 wherein each of the separate metadata tracks is associated with a camera position used for a corresponding one of the plurality of camera views.

### Claim 8 (depends on 1)

The device of claim 1 wherein the content processor is to switch between the plurality of views by receiving a request to switch from a first view of the plurality of camera views to a second view of the plurality of camera views at run time, identifying a current frame of the first view, accessing a track associated with the second view to find a random access frame in the second view that is close in time to the current frame of the first view, and switching to the second view at the found random access frame.

### Claim 9 (depends on 8)

The device of claim 8 wherein the request to switch pertains to a real-time mode.

### Claim 10 (depends on 9)

The device of claim 9 wherein the content processor is to find the random access frame in the second view by searching a random access table associated with the second view for a random access frame following the current frame of the first view, determining whether any intermediate frames exist between the current frame of the first view and the following random access frame of the second view, and switching to the second view at the following random access frame if no intermediate frames exist between the current frame of the first view and the following random access frame of the second view.

### Claim 11 (depends on 10)

The device of claim 10 further comprising:
a decoder to decode frames of the second view, starting with the following random access frame; and
a display controller to provide the decoded frames to a display system.

### Claim 12 (depends on 10)

The device of claim 10 wherein the content processor is further to determine that at least one intermediate frame exists between the current frame of the first view and the following random access frame of the second view, and to search the random access table for a random access frame preceding the current frame of the first view.

### Claim 13 (depends on 12)

The device of claim 12 further comprising:
a decoder to decode frames of the second camera view, starting with the preceding random access frame; and
a display controller to skip decoded frames until a timestamp of the current frame of the first view is reached, and to begin providing decoded frames to a display system when the timestamp following the current frame of the first view is reached.

### Claim 14 (depends on 8)

The device of claim 8 wherein the request to switch pertains to a pause mode.

### Claim 15 (depends on 14)

The device of claim 14 wherein the content processor is to find a random access frame in the second view by searching a random access table associated with the second view for a random access frame matching the current frame of the first camera view, and to switch to the second camera view at the matching random access frame if the matching random access frame exists in the random access table.

### Claim 16 (depends on 15)

The device of claim 15 further comprising:
a decoder to decode the matching random access frame; and
a display controller to provide the decoded frame to a display system.

### Claim 17 (depends on 15)

The device of claim 15 wherein the content processor is further to determine that a matching random access frame does not exist in the random access table, and to search the random access table associated with the second view for a random access frame preceding the current frame of the first view.

### Claim 18 (depends on 17)

The device of claim 17 further comprising:
a decoder to decode intermediate frames of the second view, starting with the preceding random access frame and until reaching a frame that matches the current frame of the first camera view, and to decode the matching frame of the second camera view; and
a display controller to skip the decoded intermediate frames and to provide the decoded matching frame to a display system.

### Claim 19

A method for a consumer electronic device, comprising:
storing multimedia data associated with a plurality of camera views of a scene and metadata describing the multimedia data associated with the plurality of camera views of the scene in separate tracks defined by a media file format, each of the separate tracks corresponding to one of the plurality of camera views of the scene; and
switching between the plurality of views at run time using the metadata.

### Claim 20 (depends on 19)

The method of claim 19 wherein switching between the plurality of views comprises:
receiving a request to switch from a first camera view of the plurality of camera views to a second camera view of the plurality of camera views;
accessing one of the separate tracks storing metadata for the second camera view;
using the one of the separate tracks to find a random access frame in the second camera view that is close in time to a current frame of the first camera view; and
switching, at run time, to the second camera view at the found random access frame.

### Claim 21 (depends on 20)

The method of claim 20 wherein the request to switch pertains to any one of a real-time mode, a pause mode, and a playback mode.

### Claim 22

An apparatus comprising:
means for storing multimedia data associated with a plurality of camera views of a scene and metadata describing the multimedia data associated with the plurality of camera views of the scene in separate tracks defined by a media file format, each of the separate tracks corresponding to one of the plurality of camera views of the scene; and
means for switching between the plurality of views at run time using the metadata.

### Claim 23 (depends on 22)

The apparatus of claim 22 wherein means for switching between the plurality of views comprises:
means for receiving a request to switch from a first camera view of the plurality of camera views to a second camera view of the plurality of camera views;
means for accessing one of the separate tracks storing metadata for the second camera view;
means for using the one of the separate tracks to find a random access frame in the second camera view that is close in time to a current frame of the first camera view; and
means for switching, at run time, to the second camera view at the found random access frame.

### Claim 24 (depends on 23)

The apparatus of claim 23 wherein the request to switch pertains to any one of a real-time mode, a pause mode, and a playback mode.

### Claim 25

A computer readable medium that provides instructions, which when executed on a processor cause the processor to perform a method comprising:
storing multimedia data associated with a plurality of camera views of a scene and metadata describing the multimedia data associated with the plurality of camera views of the scene in separate tracks defined by a media file format, each of the separate tracks corresponding to one of the plurality of camera views of the scene; and
switching between the plurality of views at run time using the metadata.

### Claim 26 (depends on 25)

The computer readable medium of claim 25 wherein switching between the plurality of views comprises:
receiving a request to switch from a first camera view of the plurality of camera views to a second camera view of the plurality of camera views;
accessing one of the separate tracks storing metadata for the second camera view;
using the one of the separate tracks to find a random access frame in the second camera view that is close in time to a current frame of the first camera view; and
switching, at run time, to the second camera view at the found random access frame.

### Claim 27 (depends on 26)

The computer readable medium of claim 26 wherein the request to switch pertains to any one of a real-time mode, a pause mode, and a playback mode.

### Claim 28

A system comprising:
a memory; and
at least one processor coupled to the memory, the processor executing a set of instructions which cause the processor to
store multimedia data associated with a plurality of camera views of a scene and metadata describing the multimedia data associated with the plurality of camera views of the scene in separate tracks defined by a media file format, each of the separate tracks corresponding to one of the plurality of camera views of the scene, and
switch between the plurality of views at run time using the metadata.

### Claim 29 (depends on 28)

The system of claim 28 wherein the processor is to switch between the plurality of views by receiving a request to switch from a first camera view of the plurality of camera views to a second camera view of the plurality of camera views, accessing one of the separate tracks storing metadata for the second camera view, using the one of the separate tracks to find a random access frame in the second camera view that is close in time to a current frame of the first camera view, and switching, at run time, to the second camera view at the found random access frame.

### Claim 30 (depends on 29)

The system of claim 29 wherein the request to switch pertains to any one of a real-time mode, a pause mode, and a playback mode.
