# US 2010/0247061 A1 · Collection and concurrent integration of supplemental information related to currently playing media

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0247061 A1
- Document ID: US20100247061A1
- Status: Published application
- Kind: A1
- Application number: 12/696,394
- Filed: 2010-01-29
- Published: 2010-09-30
- Earliest claimed: 2009-03-31
- Assignees: Broadcom Corporation
- Inventors: James D. Bennett; Jeyhan Karaoguz
- Web page: https://patentgrep.com/patent/US20100247061A1

## CPC

- H04N 21/47: End-user applications
- G06F 16/4393: {Multimedia presentations, e.g. slide shows, multimedia albums}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- H04N 9/79: Processing of colour television signals in connection with recording
- H04N 9/8715: {involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal}
- H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)}
- H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)}
- H04N 21/4722: for requesting additional data associated with the content
- H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application}
- H04N 21/8133: {specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video programme}
- G11B 2220/2562: DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 5/775: between a recording apparatus and a television receiver
- H04N 7/0122: {the input and the output signals having different aspect ratios}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

Collection and concurrent integration of supplemental information related to currently playing media. Based on certain characteristics associated with the media, additional information related thereto is identified and output along with the media itself. This provides an enhanced experience for a user, in that, this supplemental information augments the presentation of the media to the user. Such supplemental content can be any one or combination of a wide variety of types including textual information, image content, audio content, video content, etc. This supplemental content may be output automatically in conjunction with the media (e.g., when such media is being output). Alternatively, the supplemental content may be output upon the authorization of a user. The supplemental content may be output in a predetermined location (e.g., location within a video display). Alternatively, such supplemental content may be output within an unused (or infrequently used) area of such a video display.

## Claims

### Claim 1

An apparatus, comprising:
a memory circuitry;
a media playback circuitry that is operative to output media having associated meta data; and
a search circuitry that, based on the meta data, is operative to identify first supplemental content related to the media;
a media processing circuitry that is operative to combine the first supplemental content with the media; and
a meta data circuitry that is operative to modify the meta data, based on the first supplemental content, thereby generating modified meta data; and wherein:
the modified meta data is stored in the memory circuitry;
the search circuitry, based on the modified meta data, is operative to identify second supplemental content related to the media;
the media processing circuitry combines the second supplemental content with the media; and
the media playback circuitry outputs the combination of first supplemental content and media or the combination of second supplemental content and media.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising:
a video display coupled to the media playback circuitry; and wherein:
the media includes video media;
at least one of the first supplemental content and the second supplemental content includes at least one of textual content, image content, and video content; and
at least one of the combination of first supplemental content and media and the combination of second supplemental content and media is output via the video display.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein:
the video media occupies a first region of the video display; and
at least one of the first supplemental content and the second supplemental content occupies at least one of the first region and a second region of the video display.

### Claim 4 (depends on 2)

The apparatus of claim 2, wherein:
the video media occupies less than all of the video display; and
at least one of the first supplemental content and the second supplemental content occupies a region of the video display not occupied by the video media.

### Claim 5 (depends on 2)

The apparatus of claim 2, wherein:
the video media occupies a first region of the video display; and
the media playback circuitry modifies the first region of the video display thereby generating a second region of the video display; and
at least one of the first supplemental content and the second supplemental content occupies the second region of the video display.

### Claim 6 (depends on 1)

The apparatus of claim 1, further comprising:
a video display coupled to the media playback circuitry;
an audio output circuitry coupled to the media playback circuitry; and wherein:
the media includes audio media that is output via the audio output circuitry; and
at least one of the first supplemental content and the second supplemental content includes at least one of textual content, image content, and video content that is output via the video display while the audio media is output via the audio output circuitry.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein:
the search circuitry searches at least one of a local database and a remote database to identify at least one of the first supplemental content and the second supplemental content; and
the search circuitry retrieves at least one of the first supplemental content and the second supplemental content from at least one of the local database and the remote database.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein:
when the media playback circuitry outputs the media during a subsequent playback, the search circuitry is operative to identify third supplemental content related to the media based on the modified meta data.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein:
the meta data circuitry is operative to analyze the media to generate the meta data or the modified meta data.

### Claim 10 (depends on 1)

The apparatus of claim 1, further comprising:
user interface implemented to receive user information related to at least one of the media, the first supplemental information, and the second supplemental information; and
a meta data circuitry that is operative to modify at least one of the meta data and the modified meta data based on the user information related to at least one of the media, the first supplemental information, and the second supplemental information.

### Claim 11

An apparatus, comprising:
a media playback circuitry that is operative to output media having associated meta data;
a search circuitry that, based on the meta data, is operative to identify supplemental content related to the media;
a media processing circuitry that is operative to combine the supplemental content with the media; and wherein:
the media playback circuitry outputs the combination of supplemental content and media.

### Claim 12 (depends on 11)

The apparatus of claim 11, further comprising:
a video display coupled to the media playback circuitry; and wherein:
the media includes video media;
the supplemental content includes at least one of textual content, image content, and video content; and
the combination of supplemental content and media is output via the video display.

### Claim 13 (depends on 12)

The apparatus of claim 12, wherein:
the video media occupies a first region of the video display; and
the supplemental content occupies at least one of the first region and a second region of the video display.

### Claim 14 (depends on 12)

The apparatus of claim 12, wherein:
the video media occupies less than all of the video display; and
the supplemental content occupies a region of the video display not occupied by the video media.

### Claim 15 (depends on 12)

The apparatus of claim 12, wherein:
the video media occupies a first region of the video display; and
the media playback circuitry modifies the first region of the video display thereby generating a second region of the video display; and
the supplemental occupies the second region of the video display.

### Claim 16 (depends on 11)

The apparatus of claim 11, further comprising:
a video display coupled to the media playback circuitry;
an audio output circuitry coupled to the media playback circuitry; and wherein:
the media includes audio media that is output via the audio output circuitry; and
the supplemental content includes at least one of textual content, image content, and video content that is output via the video display while the audio media is output via the audio output circuitry.

### Claim 17 (depends on 11)

The apparatus of claim 11, wherein:
the search circuitry searches at least one of a local database and a remote database to identify the supplemental content; and
the search circuitry retrieves the supplemental content from at least one of the local database and the remote database.

### Claim 18 (depends on 11)

The apparatus of claim 11, further comprising:
a memory circuitry, coupled to the search circuitry, that includes the supplemental content; and wherein:
the search circuitry accesses the memory circuitry to identify and retrieve the supplemental content.

### Claim 19 (depends on 11)

The apparatus of claim 11, further comprising:
a meta data circuitry that is operative to modify the meta data based on the supplemental content.

### Claim 20 (depends on 11)

The apparatus of claim 11, further comprising:
a meta data circuitry;
a memory circuitry, coupled to the search circuitry, that is operative to store the supplemental content; and
when the media playback circuitry outputs the media during a subsequent playback, the search circuitry is operative to identify at least one additional supplemental content related to the media; and
the meta data circuitry is operative to modify the supplemental content stored in the memory circuitry based on the at least one additional supplemental content.

### Claim 21 (depends on 11)

The apparatus of claim 11, wherein:
when the media playback circuitry outputs the media during a subsequent playback, the search circuitry is operative to identify at least one additional supplemental content related to the media.

### Claim 22 (depends on 11)

The apparatus of claim 11, wherein:
when the media playback circuitry outputs the media during a subsequent playback, the search circuitry is operative to identify at least one additional supplemental content related to the media; and
during the subsequent playback, the media playback circuitry outputs the at least one additional supplemental content.

### Claim 23 (depends on 11)

The apparatus of claim 11, further comprising:
a meta data circuitry that is operative to analyze the media to generate or modify the meta data.

### Claim 24 (depends on 23)

The apparatus of claim 23, wherein:
the media includes video media;
the meta data circuitry identifies an object within the video media; and
the meta data circuitry modifies the meta data based on the object identified within the video media.

### Claim 25 (depends on 11)

The apparatus of claim 11, further comprising:
user interface implemented to receive user information related to at least one of the media and the supplemental information; and
a meta data circuitry that is operative to modify the meta data based on the user information related to at least one of the media and the supplemental information.

### Claim 26

A method, comprising:
outputting media, having associated meta data, via an output circuitry;
based on the meta data, searching a database to identify supplemental content related to the media;
combining the supplemental content with the media; and
outputting the combination of supplemental content and media via the output circuitry.

### Claim 27 (depends on 26)

The method of claim 26, wherein:
the searching a database to identify supplemental content related to the media includes:
searching a remote database to identify first supplemental content related to the media; and
searching a local database to identify second supplemental content related to the media;
the combining the supplemental content with the media includes combining the first supplemental content and the second supplemental content with the media; and
the outputting the combination of supplemental content and the media via the output circuitry includes outputting combination of the first supplemental content, the second supplemental, and the media.

### Claim 28 (depends on 26)

The method of claim 26, wherein:
the output circuitry includes a video display;
the media includes video media;
the supplemental content includes at least one of textual content, image content, and video content; and
the combination of supplemental content and media is output via the video display.

### Claim 29 (depends on 26)

The method of claim 26, wherein:
the output circuitry includes a video display and an audio output circuitry;
the media includes audio media that is output via the audio output circuitry; and
the supplemental content includes at least one of textual content, image content, and video content that is output via the video display while the audio media is output via the audio output circuitry.

### Claim 30 (depends on 26)

The method of claim 26, further comprising:
during a subsequent outputting of the media via the output circuitry, searching the database or at least one additional database to identify at least one additional supplemental content related to the media.

### Claim 31 (depends on 26)

The method of claim 26, further comprising:
via a user interface, receiving user information related to at least one of the media and the supplemental information; and
modifying the meta data based on the user information related to at least one of the media and the supplemental information.
