# US 8,786,593 B2 · Method for recording three-dimensional video data and medium recording the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,786,593 B2 - Document ID: US8786593B2 - Status: Granted - Kind: B2 - Application number: 12/135,274 - Filed: 2008-06-09 - Published: 2008-12-11 - Granted: 2014-07-22 - Earliest claimed: 2007-06-08 - Assignees: Samsung Electronics Co., Ltd.; University-Industry Cooperation Group of Kyung Hee University - Applicants: Do-Young Joung; Tae-Sung Park; Yun-Je Oh; Doug-Young Suh; Gwang-Hoon Park; Kyu-Heon Kim; Yoon-Jin Lee - Inventors: Do-Young Joung; Tae-Sung Park; Yun-Je Oh; Doug-Young Suh; Gwang-Hoon Park; Kyu-Heon Kim; Yoon-Jin Lee - Web page: https://patentgrep.com/patent/US8786593B2 ## CPC - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04N 13/178: Metadata, e.g. disparity information - H04N 13/189: Recording image signals; Reproducing recorded image signals - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 21/23412: {for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects} - H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)} - H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs} - H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04N 21/84: Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} - H04N 21/85406: {involving a specific file format, e.g. MP4 format} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Disclosed is a method of storing scene comprising a three-dimensional image, which has been generated by converting an image input an apparatus supporting photographing of the three-dimensional image, into a recording medium. The method includes: loading, in a predetermined file type field, image type information indicating one of a single stereoscopic image and a synthetic image including a monoscopic image and a stereoscopic image; loading, in a configurative information container field, scene descriptor information indicating temporal and spatial relations between a plurality of media objects included in the three-dimensional image, object configurative information indicating object attributes of each media object of said plurality of media objects and a configurative relation between encoded streams of each of the media objects of said plurality, configurative information of the encoded streams, first metadata between the plurality of media objects, and second metadata between each media object of the plurality and the encoded stream thereof, and loading, in a media data container field, a bit stream of each media object included in the three-dimensional image, a bit stream for the first metadata, and a bit stream for the second metadata. ## Claims ### Claim 1 A method of storing a three-dimensional image, which has been generated by converting an image input by an apparatus supporting photographing of an object, into a recording medium, the method comprising: loading, in a predetermined file type field, image type information indicating a single stereoscopic image when the single stereoscopic image is to be stored, and indicating a combined video image when the combined video image is to be stored, the combined video image including a monoscopic image of the photographed object and a stereoscopic image of the photographed object which are temporally separated, wherein the stereoscopic image being of a type having a left image and a right image of the photographed object captured from different sensor modules; loading, in a configurative information container field, scene descriptor information indicating temporal and spatial relations between at least one of medias included in the three-dimensional image, configurative information indicating attributes of the at least one of medias and a configurative relation between encoded streams of the at least one of medias; and loading, in a media data container field, a bit stream of the at least one of medias included in the three-dimensional image, wherein the configurative information container field further comprises iloc information indicating a location of the bit stream and information indicating a stream type of the bit stream, wherein the iloc information comprises information indicating a length of the bit stream, an offset of the bit stream, and an identifier of the bit stream, and wherein the configurative information container field further comprising an information item indicating a difference between frame rates of the left image and right image; and an information item indicating a synchronization method when the frame rates of the left and right images are different. ### Claim 2 (depends on 1) The method of claim 1, wherein the configurative information container field comprises: information indicating the number of the at least one of medias included in a scene; information indicating whether the at least one of medias is a stereoscopic image; information indicating whether the at least one of medias requires metadata; information indicating the number of encoded streams included in the at least one of medias; when metadata is applied to the at least one of medias, information indicating a track including a metadata to be applied; and information indicating a track including an encoded stream. ### Claim 3 (depends on 2) The method of claim 2, wherein the configurative information container field further comprises information indicating a track including metadata applicable to an overall stereoscopic image. ### Claim 4 (depends on 1) The method of claim 1, wherein the configurative information container field further comprises loading configurative information of the combined image, when combined image data is indicated. ### Claim 5 (depends on 1) The method of claim 1, wherein the monoscopic image and stereoscopic image are temporally separated in the combined image by periodic time intervals. ### Claim 6 (depends on 1) The method of claim 1, wherein the monoscopic image and stereoscopic image are temporally separated in the combined image according to a property or type of a photographed object. ### Claim 7 A method of storing a three-dimensional image, which has been generated by converting an image input by an apparatus supporting photographing of an object, into a recording medium, the method comprising: loading, in a predetermined file type field, image type information indicating a single stereoscopic image when the single stereoscopic image is to be stored, and indicating a combined video image when the combined video image is to be stored, the combined video image including a monoscopic image of the photographed object and a stereoscopic image of the photographed object which are temporally separated, wherein the stereoscopic image being of a type having a left image and a right image of the photographed object captured from different sensor modules; loading, in a configurative information container field, configurative information indicating attributes of at least one of medias and a configurative relation between encoded streams of at least one of medias included in the three-dimensional image; and loading, in a media data container field, a bit stream of at least one of medias included in the three-dimensional image, wherein scene descriptor information of a scene indicating temporal and spatial relations between the at least one of medias included in the three-dimensional image is selectively loaded in the configurative information container field, wherein the configurative information container field further comprises iloc information indicating a location of the bit stream and information indicating a stream type of the bit stream, wherein the iloc information comprises information indicating a length of the bit stream, an offset of the bit stream, and an identifier of the bit stream, and wherein the configurative information container field further comprising an information item indicating a difference between frame rates of the left image and right image; and an information item indicating a synchronization method when the frame rates of the left and right images are different. ### Claim 8 (depends on 7) The method of claim 7, wherein the scene descriptor information comprises: an initial scene descriptor information field containing information on initial access pointer and scene description; a scene information field containing information on a configurative relation of the at least one of medias included in the scene; and an object configurative information field containing information on attributes of the at least one of medias included in the scene. ### Claim 9 (depends on 8) The method of claim 8, wherein, when the configurative information container field includes the initial scene descriptor information, the configurative information container field contains decoder information on the at least one of medias included in the initial scene descriptor information. ### Claim 10 (depends on 8) The method of claim 8, wherein, when the configurative information container field does not include the initial scene descriptor information, the configurative information container field contains decoder information on the at least one of medias included in the stereoscopic image. ### Claim 11 (depends on 10) The method of claim 10, wherein the decoder information on the at least one of medias included in the stereoscopic image comprises types of the encoded streams, media types of the encoded streams, profile information, and detailed information on an image. ### Claim 12 (depends on 11) The method of claim 11, wherein the media types correspond to information set based on Object Type Indication (OTI) defined by an ISO/IEC 14496 MPEG-4 system. ### Claim 13 (depends on 7) The method of claim 7, wherein the configurative information container field comprises first metadata on the at least one of medias and second metadata on correlation between the at least one of medias and the encoded stream thereof. ### Claim 14 (depends on 13) The method of claim 13, wherein the first metadata comprises information on a length of a bit stream of an encoded stream and an identifier of the encoded stream, and the second metadata comprises information on a name and a content type of each encoded stream, and encoding information. ### Claim 15 (depends on 7) The method of claim 7, wherein the monoscopic image and stereoscopic image are temporally separated in the combined image by periodic time intervals. ### Claim 16 (depends on 7) The method of claim 7, wherein the monoscopic image and stereoscopic image are temporally separated in the combined image according to a property or type of a photographed object. ### Claim 17 A method of storing a three-dimensional image, which has been generated by converting an image input by an apparatus supporting photographing of the three-dimensional image, into a recording medium, the method comprising: loading, in a predetermined file type field, image type information indicating one of a single stereoscopic image and a combined video image including a monoscopic image and a stereoscopic image, each stereoscopic image being of a type having a left image and a right image of a photographing object captured from different sensor modules; loading, in a configurative information container field, configurative information indicating attributes of at least one of medias and a configurative relation between encoded streams of at least one of medias included in the three-dimensional image; and loading, in a media data container field, a bit stream of at least one of medias included in the three-dimensional image, wherein scene descriptor information of a scene indicating temporal and spatial relations between the at least one of medias included in the three-dimensional image is selectively loaded in the configurative information container field, wherein the configurative information container field further comprises: iloc information indicating a location of the bit stream of the at least one of medias, the iloc information comprising information on a length of the bit stream, an offset of the bit stream, and an identifier of the bit stream; information indicating a stream type of the bit stream; first metadata on the at least one of medias and second metadata on correlation between the at least one of medias and the encoded stream thereof, the first metadata comprising information on a length of a bit stream of an encoded stream and an identifier of the encoded stream, and the second metadata comprising information on a name and a content type of each encoded stream, and encoding information thereof; a StereoScopic_Composition Type information item including information on an image configuration of stereoscopic data including one ES (Elementary Stream), and having a first value for indicating stereoscopic data having frames crossing according to time; a second value for indicating stereoscopic data configured side by side, a third value for indicating stereoscopic data configured in a top-down manner, a fourth value for indicating stereoscopic data having frames vertically crossing according to field; and a fifth value for indicating stereoscopic data having frames horizontally crossing according to field; an information item indicating a difference between frame rates of the left image and right image; and an information item indicating a synchronization method when the frame rates of the left and right images are different. ### Claim 18 A method of storing a three-dimensional image, which has been generated by converting an image input by an apparatus supporting photographing of the three-dimensional image, into a recording medium, the method comprising: loading, in a predetermined file type field, image type information indicating one of a single stereoscopic image and a combined video image including a monoscopic image and a stereoscopic image, wherein each stereoscopic image being of a type having a left image and a right image of a photographing object captured from different sensor modules; loading, in a configurative information container field, configurative information indicating attributes of at least one of medias and a configurative relation between encoded streams of at least one of medias included in the three-dimensional image; and loading, in a media data container field, a bit stream of at least one of medias included in the three-dimensional image, wherein scene descriptor information of a scene indicating temporal and spatial relations between the at least one of medias included in the three-dimensional image is selectively loaded in the configurative information container field, wherein the configurative information container field further comprises: iloc information indicating a location of the bit stream of the at least one of medias, an offset of the bit stream, and information indicating a stream type of the bit stream, an information item indicating a difference between frame rates of the left image and right image; and an information item indicating a synchronization method when the frame rates of the left and right images are different. ### Claim 19 A stereoscopic image photographing apparatus comprising: an image input unit configured to generate three-dimensional image including a left image and a right image using image data of a photographed object input from different sensor modules; an encoder to encode the image data; a data storage controller; a memory; and a display to display the three-dimensional image; wherein the data storage controller is configured to store the image data in the memory by: loading, in a predetermined file type field, image type information indicating a single stereoscopic image when the single stereoscopic image is to be stored, and indicating a combined video image when the combined video image is to be stored, the combined video image including a monoscopic image of the photographed object and a stereoscopic image of the photographed object which are temporally separated, wherein the stereoscopic image being of a type having a left image and a right image of the photographed object captured from the different sensor modules; loading, in a configurative information container field, scene descriptor information indicating temporal and spatial relations between at least one of medias included in the three-dimensional image, configurative information indicating attributes of the at least one of medias and a configurative relation between encoded streams of the at least one of medias; and loading, in a media data container field, a bit stream of the at least one of medias included in the three-dimensional image, wherein the configurative information container field further comprises iloc information indicating a location of the bit stream, an offset of the bit stream, and information indicating a stream type of the bit stream, and wherein the configurative information container field further comprising an information item indicating a difference between frame rates of the left image and right image; and an information item indicating a synchronization method when the frame rates of the left and right images are different.