# US 7,609,943 B2 · Method and apparatus of recording graphic data on a recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 7,609,943 B2 - Document ID: US7609943B2 - Status: Granted - Kind: B2 - Application number: 10/759,269 - Filed: 2004-01-20 - Published: 2004-07-29 - Granted: 2009-10-27 - Earliest claimed: 2003-01-20 - Assignees: LG Electronics Inc. - Inventors: Kang Soo Seo; Byung Jin Kim; Chang Bum Kim - Web page: https://patentgrep.com/patent/US7609943B2 ## CPC - H04N 9/8042: {involving data reduction} - G11B 27/034: on discs (G11B27/036, G11B27/038 take precedence) - G11B 27/105: {of operating discs} - G11B 27/329: {on a disc [VTOC]} - G11B 2020/1288: {Formatting by padding empty spaces with dummy data, e.g. writing zeroes or random data when de-icing optical discs} - G11B 2220/20: Disc-shaped record carriers - G11B 2220/2541: Blu-ray discs; Blue laser DVR discs - H04N 5/85: on discs or drums - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 9/8227: {the additional signal being at least another television signal} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract The present invention relates to method and apparatus of recording graphic data constituting sub-pictures in a main video on a high-density recording medium such as a Blu-ray Disk ROM (BD-ROM) disk. In the present invention, when a plurality of graphic objects, namely, images are received, the plurality of graphic objects and their color control information are organized into a PES (Packetized Elementary Stream) packet and then recorded on a recording medium, wherein the color control information is used in common for screen display by the plurality of graphic objects. ## Claims ### Claim 1 A method of recording graphic data on a recording medium, comprising: receiving graphic data including a plurality of graphic objects; and organizing the plurality of graphic objects and color control information into a PES (Packetized Elementary Stream) packet and recording the PES packet on the recording medium, wherein the color control information is used in common for screen display by the plurality of graphic objects so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 2 (depends on 1) The method of claim 1, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 3 (depends on 1) The method of claim 1, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet. ### Claim 4 (depends on 1) The method of claim 1, wherein said organizing step slices the PES packet, converts each slice to a transport packet and records the transport packets on the recording medium. ### Claim 5 (depends on 4) The method of claim 4, wherein said organizing step further converts inputted video and/or audio stream to transport packets, and multiplexes the converted video and/or audio stream with the transport packets including the graphic objects and recording the multiplexed transport packets on the recording medium. ### Claim 6 (depends on 1) The method of claim 1, wherein said organizing step inserts a decoding time stamp (DTS) and a presentation time stamp (PTS) for the graphic objects while organizing the PES packet. ### Claim 7 (depends on 1) The method of claim 1, wherein said organizing step inserts display effect information for at least one graphic object while organizing the PES packet. ### Claim 8 (depends on 7) The method of claim 7, wherein said display effect information includes time information of display start and end of any of the graphic objects. ### Claim 9 (depends on 8) The method of claim 8, wherein the time information is expressed in the number of ticks and has value of a multiple of N ticks where the N is the number of ticks for while a single video frame keeps displayed. ### Claim 10 (depends on 1) The method of claim 1, wherein a structure for one of the graphic objects comprises an ID of object, an ID of actual image data, and actual image data. ### Claim 11 A computer readable medium having an executable data structure recorded thereon for managing reproduction of images by a reproducing device, comprising: a data area storing video and/or audio and graphic data in the form of transport packets, a PES (Packetized Elementary Stream) packet made from some of the transport packets containing the graphic data includes a plurality of graphic objects and color control information that is used in common for screen display by the plurality of graphic objects; and an information area storing information files for managing reproduction of the video and/or audio and graphic data by the reproducing device so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 12 (depends on 11) The computer readable medium of claim 11, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 13 (depends on 11) The computer readable medium of claim 11, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet. ### Claim 14 (depends on 11) The computer readable medium of claim 11, wherein the PES packet includes a decoding time stamp (DTS) and a presentation time stamp (PTS) for the included graphic objects. ### Claim 15 (depends on 11) The computer readable medium of claim 11, wherein the PES packet comprises display effect information for at least one graphic object included therein. ### Claim 16 (depends on 15) The computer readable medium of claim 15, wherein said display effect information includes time information of display start and end of any of the graphic objects. ### Claim 17 (depends on 11) The computer readable medium of claim 11, wherein a structure for one of the graphic objects comprises an ID of object, an ID of actual image data, and actual image data. ### Claim 18 An apparatus of recording graphic data on a recording medium, comprising: a receiving unit configured to receive video and/or audio data, and graphic data including a plurality of graphic objects; a packetizer configured to organize the video and/or audio data into a series of PES (Packetized Elementary Stream) packets and to organize the received plurality of graphic objects and color control information into a PES packet, wherein the color control information is used in common for screen display by the plurality of graphic objects; and a multiplexer configured to multiplex the series of video and/or audio PES packets and the PES packet including graphic objects in the unit of transport packet; and a driver configured to record the unit of transport packet on a recording medium so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 19 (depends on 18) The apparatus of claim 18, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 20 (depends on 18) The apparatus of claim 18, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet. ### Claim 21 (depends on 18) The apparatus of claim 18, wherein said packetizer inserts a decoding time stamp (DTS) and a presentation time stamp (PTS) for the graphic objects while organizing the PES packet with graphic objects. ### Claim 22 (depends on 18) The apparatus of claim 18, wherein said packetizer inserts time information on display start and end of any of the graphic objects while organizing the PES packet with graphic objects. ### Claim 23 (depends on 18) The recording medium of claim 18, wherein a structure for one of the graphic objects comprises an ID of object, an ID of actual image data, and actual image data. ### Claim 24 A method of reproducing graphic data on a recording medium, comprising: reproducing a PES (Packetized Elementary Stream) packet from the recording medium, the PES packet including a plurality of graphic objects and color information organized into the PES packet, wherein the color information is used in common for screen display by the plurality of graphic objects so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 25 (depends on 24) The method of claim 24, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 26 (depends on 24) The method of claim 24, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet. ### Claim 27 An apparatus for recording graphic data on a recording medium, comprising: an optical recording device configured to record data on the recording medium; and a controller configured to control the optical recording device to record video and/or audio data, and graphic data including a plurality of graphic objects on the recording medium, the video and/or audio data organized into a series of PES (Packetized Elementary Stream) packets and the plurality of graphic objects and color control information organized into a PES packet, wherein the color information is used in common for screen display by the plurality of graphic objects, and the series of video and/or audio PES packets and the PES packet including graphic objects are multiplexed in the unit of transport packet so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 28 (depends on 27) The apparatus of claim 27, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 29 (depends on 27) The apparatus of claim 27, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet. ### Claim 30 An apparatus for reproducing graphic data on a recording medium, comprising: an optical reproducing device configured to reproduce data on the recording medium; a controller configured to control the optical reproducing device to reproduce video and/or audio data, and graphic data including a plurality of graphic objects from the recording medium, the video and/or audio data organized into a series of PES (Packetized Elementary Stream) packets and the plurality of graphic objects and color control information organized into a PES packet, wherein the color information is used in common for screen display by the plurality of graphic objects, and the series of video and/or audio PES packets and the PES packet including graphic objects are multiplexed in the unit of transport packet so that the graphic objects are changed in color or display effects by using the common color control information. ### Claim 31 (depends on 30) The apparatus of claim 30, wherein the plurality of graphic objects are an object set that is to be displayed on a single video page. ### Claim 32 (depends on 30) The apparatus of claim 30, wherein the color control information includes a global palette table and a global transparency array that defines transparent grade of every graphic object included in the PES packet.