# US 7,412,152 B2 · Recording medium, reproduction apparatus, recording method, program, and reproduction method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 7,412,152 B2
- Document ID: US7412152B2
- Status: Granted
- Kind: B2
- Application number: 11/212,387
- Filed: 2005-08-26
- Published: 2006-03-02
- Granted: 2008-08-12
- Earliest claimed: 2003-02-28
- Assignees: Matsushita Electric Co., Ltd.
- Inventors: Hiroshi Yahata; Tomoyuki Okada; Wataru Ikeda; Joseph McCrossan
- Web page: https://patentgrep.com/patent/US7412152B2

## CPC

- G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence)
- G09G 5/42: characterised by the display of patterns using a display memory without fixed position correspondence between the display memory contents and the display position on the screen
- G11B 19/025: {'Virtual' control panels, e.g. Graphical User Interface [GUI]}
- G11B 19/027: {Remotely controlled (remote control systems in general G08C)}
- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B 27/105: {of operating discs}
- G11B 27/3027: {used signal is digitally coded}
- G11B 27/3036: {Time code signal}
- G11B 27/329: {on a disc [VTOC]}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/85: on discs or drums
- H04N 9/8227: {the additional signal being at least another television signal}
- H04N 21/4135: {external recorder (interface circuits between an apparatus for recording television signals and a television receiver H04N5/775)}
- H04N 21/426: Internal components of the client {; Characteristics thereof} (H04N5/44 takes precedence)
- H04N 21/43072: {of multiple content streams on the same device}
- H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window}
- H04N 21/4348: {Demultiplexing of additional data and video streams}
- G09G 5/40: characterised by the way in which both a pattern determined by character code and another pattern are displayed simultaneously, or either pattern is displayed selectively, e.g. with character code memory and APA, i.e. all-points-addressable, memory
- G11B 2220/213: Read-only discs
- G11B 2220/216: Rewritable discs
- G11B 2220/218: Write-once discs
- G11B 2220/2541: Blu-ray discs; Blue laser DVR discs
- G11B 2220/2545: CDs
- G11B 2220/2562: DVDs [digital versatile discs]; Digital video discs; MMCDs; HDCDs
- G11B 2220/2575: DVD-RAMs
- H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits}
- H04N 5/775: between a recording apparatus and a television receiver
- H04N 5/781: on disks or drums
- H04N 5/907: using static stores, e.g. storage tubes or semiconductor memories (H04N5/91 takes precedence)
- H04N 9/8042: {involving data reduction}
- H04N 9/8063: {using time division multiplex of the PCM audio and PCM video signals}
- H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal}
- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- H04N 21/42213: {for facilitating data entry}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A BD-ROM has recorded therein an AV Clip generated by multiplexing a video stream and an interactive graphics stream. The video stream representing a motion picture made of a plurality of pictures, and the interactive graphics stream representing an interactive display to be overlayed on the motion picture, where the interactive graphics stream includes state control information (ICS) stored in a packet and a graphics data sequence (ODS), and the packet includes a time stamp that indicates a time at which the initial display is performed, the time being obtained by adding a predetermined duration to a decode ending time (PTS) of graphics data positioned midway through the graphics data sequence (S-ODSsfirst, S-ODSslast).

## Claims

### Claim 1

A reproduction apparatus for reproducing a digital stream generated by multiplexing a video stream and a graphics stream, said reproduction apparatus comprising:
a video decoder operable to decode the video stream into a motion picture made of a plurality of pictures; and
a graphics decoder operable to decode the graphics stream to obtain an interactive display to be overlaid on the motion picture;
wherein:
the interactive display contains a plurality of graphical buttons each of which is presented in any of a normal state, a selected state, and an activated state;
the graphics stream includes state control information stored in a packet and a plurality of sets of graphics data stored in a plurality of packets;
the plurality of sets of graphics data include:
a first set of graphics data for rendering the normal state of the respective button materials;
a second set of graphics data for rendering the selected state of the respective button materials; and
a third set of graphics data for rendering the activated state of the respective button materials;
the first, second, and third sets of graphics data are sequentially arranged in the stated order;
the packet storing the state control information includes a time stamp that indicates a time at which an initial display of the interactive display is to be performed, the time being obtained by adding a predetermined duration to a decode ending time of graphics data that is included in the first and second sets of graphics data and that constitutes the initial display; and,
the reproduction apparatus, when a reproduction time of the video stream reaches the time indicated by the time stamp, performs the initial display of the interactive display using the graphics data that is included in the first and second sets of graphics data and that constitutes the initial display, and when a user operation is performed, updates the interactive display using remaining of the graphics data.

### Claim 2

A recording method for a recording medium, said recording method comprising:
creating application data; and
recording the created application data to the recording medium;
wherein:
the application data includes a digital stream generated by multiplexing a video stream and a graphics stream, the video stream representing a motion picture made of a plurality of pictures, and the graphics stream representing an interactive display to be overlaid on the motion picture;
the graphics stream includes state control information stored in a packet and a plurality of sets of graphics data stored in a plurality of packets,
the interactive display contains a plurality of graphical button materials each of which is presented in any of a normal state, a selected state, and an activated state;
the plurality of sets of graphics data include;
a first set of graphics data for rendering the normal state of the respective button materials;
a second set of graphics data for rendering the selected state of the respective button materials; and
a third set of graphics data for rendering the activated state of the respective button materials;
the first, second, and third sets of graphics data are sequentially arranged in the stated order; and
the packet storing the state control information includes a time stamp that indicates a time at which an initial display of the interactive display is to be performed, the time being obtained by adding a predetermined duration to a decode ending time of graphics data that is included in the first and second sets of graphics data and that constitutes the initial display.

### Claim 3 (depends on 1)

The reproduction apparatus of claim 1, wherein
the predetermined duration includes a time required for writing decompressed graphics data constituting the initial display and into the plane memory.

### Claim 4

A computer readable medium comprising a program for enabling a computer to reproduce a digital stream generated by multiplexing a video stream and a graphics stream, said program comprising computer executable code operable to cause the computer to perform:
decoding of the video stream into a motion picture made of a plurality of pictures; and
decoding of the graphics stream to obtain an interactive display to be overlaid on the motion picture;
wherein:
the interactive display contains a plurality of graphical buttons each of which is presented in any of a normal state, a selected state, and an activated state,
the graphics stream includes state control information stored in a packet and a plurality of sets of graphics data stored in a plurality of packets,
the plurality of sets of graphics data include;
a first set of graphics data for rendering the normal state of the respective button materials;
a second set of graphics data for rendering the selected state of the respective button materials; and
a third set of graphics data for rendering the activated state of the respective button materials;
the first, second, and third sets of graphics data are sequentially arranged in the stated order,
the packet storing the state control information includes a time stamp that indicates a time at which an initial display of the interactive display is to be performed, the time being obtained by adding a predetermined duration to a decode ending time of graphics data that is included in the first and second sets of graphics data and that constitutes the initial display; and
said program further comprises computer executable code operable to cause the computer to perform:
when a reproduction time of the video stream reaches the time indicated by the time stamp, performing the initial display of the interactive display using the graphics data that is included in the first and second sets of graphics data and that constitutes the initial display, and when a user operation is performed, updating the interactive display remaining of the graphics data.

### Claim 5

A reproduction method for a digital stream generated by multiplexing a video stream and a graphics stream, said reproduction method comprising:
decoding the video stream into a motion picture made of a plurality of pictures; and
decoding of the graphics stream to obtain an interactive display to be overlaid on the motion picture;
wherein:
the interactive display contains graphical buttons each of which is presented in any of a normal state, a selected state, and an activated state,
the graphics stream includes state control information stored in a packet and a plurality of sets of graphics data stored in a plurality of packets,
the plurality of sets of graphics data include;
a first set of graphics data for rendering the normal state of the respective button materials;
a second set of graphics data for rendering the selected state of the respective button materials; and
a third set of graphics data for rendering the activated state of the respective button materials;
the first, second, and third sets of graphics data are sequentially arranged in the stated order,
the packet storing the state control information includes a time stamp that indicates a time at which an initial display of the interactive display is to be performed, the time being obtained by adding a predetermined duration to a decode ending time of graphics data that is included in the first and second sets of graphics data and that constitutes the initial display; and
said reproduction method further comprises:
when a reproduction time of the video stream reaches the time indicated by the time stamp, performing the initial display of the interactive display using the graphics data that is included in the first and second sets of graphics data and that constitutes the initial display, and when a user operation is performed, updating the interactive display using remaining of the graphics data.