Data multiplexing method, method and device for reproducing multiplexed data, and recording medium containing the data multiplexed by said method

A method of multiplexing digital data to a bitstream, the digital data including at least one of audio data and picture data, said method comprising the steps of:

• (a) multiplexing first digital data “p1” and second digital data “d1” to produce a first object data “o1”;
• (b) multiplexing third digital data “p2” and fourth digital data “d2” to produce a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to form a third object data “o3”.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) packetizing the object data “o1” into a packet to produce a first packet data “op1”;
• (c) packetizing digital data “p2” into a packet to produce a second packet data “op2”;
• and
• (d) further multiplexing the first packet data “op1” and the second packet data “op2” to produce a third packet data “op3”,
• wherein a packet number identifying the packet is assigned to the first packet data “op1” and the second packet data “op2” respectively.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) packetizing the object data “o1” into a packet to produce a first packet data “op1”;
• (c) multiplexing digital data “p2” and digital data “d2” to produce a second object data “o2”;
• (d) packetizing the second object data “o2” into a packet to produce a second packet data “op2”;
• and
• (e) further multiplexing the first packet data “op1” and the second packet data “op2” to produce a third packet data “op3”,
• wherein a packet number identifying the packet is assigned to the first packet data “op1” and the second packet data “op2” respectively.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) packetizing the object data “o1” into a packet to produce a first packet data “op1”;
• (c) multiplexing digital data “p2” and digital data “d2” to produce a second object data “o2”;
• (d) packetizing the second object data “o2” into a packet to produce a second packet data “op2”;
• and
• (e) further multiplexing the first packet data “op1” and the second packet data “op2” to produce a third packet data “op3”,
• wherein a first packet number is assigned to the third packet data “op3”, and different packet numbers, i.e., a second and a third packet numbers different from the first packet number are assigned to the packet data “op1” and “op2”.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) packetizing the first object data “op1” into a packet to produce a first packet data “op1”;
• (c) multiplexing a first table packet that indicates details and a packet number of the first packet data “op1” onto the first packet data “op1”;
• (d) multiplexing digital data “p2” and digital data “d2” to produce a second object data “o2”;
• (e) packetizing the second object data “o2” into a packet to produce a second packet data “op2”;
• (f) multiplexing a second table packet that indicates details and a packet number of the second packet data “op2” onto the second packet data “op2”;
• and
• (g) further multiplexing the first packet data “op1” and the second packet data “op2” to produce a third packet data “op3”;
• wherein the third packet data “op3” is further multiplexed with a third table packet that indicates details and a packet number of the third packet data “op3”, and packet numbers of the first and second table packets are described in the third table packet.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) identifying digital data “p2” as a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to form a third object data “o3”;
• wherein the first object data “o1” is multiplexed data including first time information necessary for synchronized reproduction of the digital data “p1” and the digital data “d1”, and
• wherein the third object data “d3” to be multiplexed includes second time information necessary for synchronized reproduction of the third object data “d3”.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing digital data “p1” and digital data “d1” to produce a first object data “o1”;
• (b) packetizing the object data “o1” into a packet to produce a first packet data “op1”;
• (c) identifying a digital data “p2” as a second object data “o2”;
• (d) packetizing the second object data “o2” into a packet to produce a second packet data “op2”;
• (e) further multiplexing the first packet data “op1” and the second packet data “op2” to produce a third packet data “op3”;
• and
• (f) assigning different priority orders to the first, second and third packet data “op1”, “op2” and “op3” respectively.

A method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) multiplexing first digital data “p1” and second digital data “d1” to produce a first object data “o1”;
• (b) making a third digital data “p2” as a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to produce a third object data “o3” and wherein the third object data “o3” is multiplexed by scenario data having both reproduction time and reproduction location of one of the object data “o1”, “o2” and “o3”.

A method of multiplexing data, wherein a picture is treated as an aggregate of a plurality of objects, and the picture data are processed on an object-oriented basis, then the processed data is multiplexed, and wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said method comprising the steps of:

• (a) dividing the picture into a plurality of master objects, and identifying themselves as the master objects;
• (b) dividing the identified master object into smaller slave objects when necessary, and identifying themselves as the slave objects, whereby a hierarchy is formed;
• (c) packetizing one of the identified master object, the identified master and slave objects, and the identified slave object into a packet, then assigning a packet number to the packet, and
• (d) adding the hierarchical details as hierarchical information to the multiplexed data.

A reproducing method of data multiplexed through a method of multiplexing data, wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said multiplexing method comprising the steps of:

• (a) multiplexing first digital data “p1” and second digital data “d1” to produce a first object data “o1”;
• (b) making a third digital data “p2” as a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to produce a third object data “o3”, wherein the multiplexed data is reproduced based on one of time information among a plurality of time information having different time bases.

A data reproducing apparatus that reproduces data multiplexed according to a data multiplexing method wherein a plurality of picture elements made of digital data undergo at least one of overlaying and mixing to complete a picture, and the digital data of each picture element is multiplexed, said multiplexing method comprising the steps of:

• (a) multiplexing first digital data “p1” and second digital data “d1” to produce a first object data “o1”;
• (b) making a third digital data “p2” as a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to produce a third object data “o3”, wherein one of a picture, audio and data predetermined by the reproducing apparatus replaces a corresponding picture, audio and data when one of these is unable to be reproduced.

A recording medium on which multiplexed data are recorded, the data being multiplexed according to a method of multiplexing digital data to a bitstream, the digital data including at least one of audio and picture data, said method comprising the steps of:

• (a) multiplexing first digital data “p1” and second digital data “d1” to produce a first object data “o1”;
• (b) making a third digital data “p2” as a second object data “o2”;
• and
• (c) further multiplexing the first object data “o1” and the second object data “o2” to produce a third object data “o3”.