# US 2010/0302443 A1 · Method of constructing information on associate meanings between segments of multimedia stream and method of browsing video using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0302443 A1
- Document ID: US20100302443A1
- Status: Published application
- Kind: A1
- Application number: 12/843,623
- Filed: 2010-07-26
- Published: 2010-12-02
- Earliest claimed: 1999-09-22
- Assignees: LG Electronics Inc.
- Inventors: Sung Bae Jun; Kyoung Ro Yoon
- Web page: https://patentgrep.com/patent/US20100302443A1

## CPC

- H04H 60/37: for identifying segments of broadcast information, e.g. scenes or extracting programme ID
- G06F 16/745: {the internal structure of a single video sequence}
- G11B 27/105: {of operating discs}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)}
- H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments}
- H04H: BROADCAST COMMUNICATION (multiplex communication H04J; pictorial communication aspects of broadcast systems H04N)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Disclosed are a method of constructing information on associate meanings between segments of a multimedia stream, which can describe the cause/effect or abstract/detail relationship between segments of the video streams to efficiently browse the video stream and a method of browsing a video using the same. The present invention defines the cause/effect or abstract/detail relationship between the segments, event intervals, scenes, shots, etc. existing within one video stream or between the video streams, and provides a method of describing the relationship in a data region based on the content of a video stream as well as a method of browsing a video by using the information on the cause/effect or abstract/detail relationship obtained by the aforementioned method. Accordingly, a video browsing on associate meanings is available with easy manipulation and easy access to a desired part, thereby providing an effective video browsing interface for easy browsing of desired segments in a short period of time.

## Claims

### Claim 1

An apparatus for displaying at least one representative frame based on semantic relations information between frames of a multimedia stream, comprising
a display unit having a prescribed display area, a plurality of representative frames including at least a first representative frame and a second representative frame, the representative frame being a frame representative of a predetermined range of a multimedia stream, wherein the first and second representative frames are provided on the prescribed display area of the display unit; and
a unit configured to:
obtain the representative frame from the plurality of representative frames,
obtain semantic relations information between the first representative frame and the second representative frame, the semantic relations information includes information on a relationship between the first representative frame and the second representative frame, and
obtain information on an additional weight value indicating a weight on the second representative influenced by the first representative frame,
wherein the second representative frame is influenced by the first representative frame based on a cause and effect relationship.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein frame locators identify locations of the first representative frame and the second representative frame.

### Claim 3 (depends on 2)

The apparatus of claim 2, wherein the frame locators include information on intervals and information on the multimedia stream.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the information on the multimedia stream is an information on relative or absolute locations of the multimedia stream.

### Claim 5 (depends on 3)

The apparatus of claim 3, wherein the information on the multimedia stream comprises a unique identifier (ID) for the multimedia stream.

### Claim 6 (depends on 3)

The apparatus of claim 3, wherein the information on intervals is described as a starting point and an ending point of the representative frames.

### Claim 7 (depends on 3)

The apparatus of claim 3, wherein the information on intervals is described as information on a starting point and a length of the representative frames.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein each representative frame is expressed by a node, and the relationship between the representative frames is expressed by a link in a region displaying the semantic relations information between representative frames.

### Claim 9 (depends on 8)

The apparatus of claim 8, wherein each node is expressed by using the representative frame, a key region or a text in the region displaying the semantic relations information between the representative frames.

### Claim 10 (depends on 8)

The apparatus of claim 8, wherein the corresponding node and the link are displayed in a graphic structure in the region displaying the semantic relations information between the representative frames.

### Claim 11 (depends on 8)

The apparatus of claim 8, wherein the corresponding node and the link are displayed in a tree structure in the region displaying the semantic relations information between the representative frames.

### Claim 12 (depends on 8)

The apparatus of claim 8, wherein the corresponding node and the link are displayed in other structures than a graphic structure or a tree structure in the region displaying the semantic relations information between the representative frames, a corresponding representative frame and the representative frames related to the semantic relations being dynamically converted and displayed when the desired representative frame is selected.

### Claim 13 (depends on 8)

The apparatus of claim 8, wherein a shift is made to a corresponding representative frame if each node of a graphic view of semantic relations information is selected.

### Claim 14 (depends on 8)

The apparatus of claim 8, wherein the region displaying the semantic relations information displays the region displaying the semantic relations information between frames centering around a representative frame currently being displayed.

### Claim 15 (depends on 8)

The apparatus of claim 8, wherein a graphic view displays the semantic relations information and includes a plurality of nodes, and the representative frame corresponding to a selected node are automatically linked and reproduced.
