# US 8,570,365 B2 · Method and apparatus for generating stereoscopic file > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,570,365 B2 - Document ID: US8570365B2 - Status: Granted - Kind: B2 - Application number: 13/839,196 - Filed: 2013-03-15 - Published: 2013-08-15 - Granted: 2013-10-29 - Earliest claimed: 2007-09-07 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Gun-Ill Lee; Jae-Yeon Song; Seo-Young Hwang - Web page: https://patentgrep.com/patent/US8570365B2 ## CPC - H04N 13/189: Recording image signals; Reproducing recorded image signals - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/302: for viewing without the aid of special glasses, i.e. using autostereoscopic displays - H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A method and apparatus for generating a stereoscopic file defined based on a conventional International Standardization Organization (ISO) based media file format. The apparatus includes an encoder encoding first video data and second video data that are included in three-dimensional (3D) video data; and a file generating unit arranging the encoded first video data and second video data according to the information of a stereoscopic file format including boxes that are selected from boxes included in a conventional International Standardization Organization (ISO) based media file format in order to store and generate the stereoscopic file, and generating the stereoscopic file. ## Claims ### Claim 1 An apparatus for producing a stereoscopic file, the apparatus comprising: an encoder to encode video data; and a file generating unit to generate the stereoscopic file based on the encoded video data, wherein the stereoscopic file includes: a value indicating a first type representing stereoscopic content with one elementary stream or a second type representing stereoscopic content with two elementary streams; and an svmi box for stereoscopic video media information. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the svmi box includes a stereoscopic_composition_type indicating a type of frame composition of the stereoscopic file. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the stereoscopic_composition_type is one of a side-by-side type, a vertical line interleaved type and a frame sequential type. ### Claim 4 (depends on 2) The apparatus of claim 2, wherein the svmi box further includes at least one of an is_left_first value indicating which one of a left image and a right image is first encoded, a sample_count value indicating the number of successive samples, and a stereo_flag value indicating if a current frame is stereo or mono. ### Claim 5 (depends on 1) The apparatus of claim 1, wherein the stereoscopic file includes an scdi box for a stereoscopic camera and display information. ### Claim 6 (depends on 5) The apparatus of claim 5, wherein the scdi box includes at least one of an is_cam_params value indicating if camera parameter information is included, a focal_length value indicating a distance from an optical center to an image plane, a convergence_distance value indicating a distance from a center of baseline to a convergence point, and an is_camera_cross value indicating arrangement of a camera. ### Claim 7 (depends on 5) The apparatus of claim 5, wherein the scdi box includes at least one of an is_display_safety_info value indicating if display safety information is included, a value indicating a distance between a user and a display device, a value indicating screen size of the display device, a min_of_disparity value indicating a minimum disparity between a left image and a right image, and a max_of_disparity value indicating a maximum disparity between the left image and the right image. ### Claim 8 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file includes an ftyp box indicating a file type and compatibility, an moov box being a container for media data, an mvhd box indicating a movie header, a trak box being a container for each track or stream, a tkhd box having information regarding a track, an mdia box being a container for media data information included in a track, an mdhd box indicating a media header, an hdlr box being a handler defining a type of media, an minf box being a container for the media data information, a vmhd box having video media header information, an smhd box having sound media header information, an hmhd box having hint media header information, an nmhd box having Null media header information, a dinf box being a data information container, a dref box being a data reference box defining sources of media in a track, an stbl box being a sample table box, an stsd box being a sample description box for information, an stts box being a time-to-sample box for decoding, an stsc box being a sample-to-chunk box, an stsz box indicating bitstream sizes of samples, an stco box being a chunk offset box, and an mdat box being a container including media data. ### Claim 9 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file includes two Elementary Streams (ESs) each including left view video data and right view video data. ### Claim 10 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file includes an Elementary Stream (ES) in which samples or frames of left view video data and samples or frames of right view video data are interleaved in a frame unit. ### Claim 11 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file includes an ftyp box indicating a file type and compatibility, a pdin box having information necessary for file download, an moov box being a container for media data, an mvhd box indicating a movie header, a trak box being a container for each track or stream, a tkhd box with a track header having information regarding a track, a tref box being a reference track container, an edts box being an edit list container, an elst box having an edit list, an mdia box being a container for media data information included in a track, an mdhd box indicating a media header, an hdlr box being a handler defining a type of media, an minf box being a container for the media data information, a vmhd box having video media header information, an smhd box having sound media header information, an hmhd box having hint media header information, an nmhd box having Null media header information, a dinf box being a data information container, a dref box being a data reference box defining sources of media in a track, an stbl box being a sample table box, an stsd box being a sample description box for information, an stts box being a time-to-sample box for decoding, an stsc box being a sample-to-chunk, an stsz box indicating bitstream sizes of samples, an stz2 box indicating compact bitstream sizes of samples, an stco box being a chunk offset box, a co64 box being a chunk offset box represented by 64-bit, an stss box being a sync sample table box, an ipmc box being a control box, an mdat box being a container including media data, a meta box being a container for storing metadata, an hdlr box being a handler box defining the type of metadata, an iloc box being a box specifying an item location, an iinf box being a box specifying item information, an xml box being a container for xml, and a bxml box being a container for binary xml. ### Claim 12 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file has a structure for stereoscopic content defined by assembling stereoscopic data and monoscopic data. ### Claim 13 (depends on 5) The apparatus of claim 5, wherein the stereoscopic file has a structure for stereoscopic content including stereoscopic data. ### Claim 14 A method of producing a stereoscopic file, the method comprising: encoding video data; and generating the stereoscopic file based on the encoded video data, wherein the stereoscopic file includes: a value indicating a first type representing stereoscopic content with one elementary stream or a second type representing stereoscopic content with two elementary streams; and an svmi box for stereoscopic video media information. ### Claim 15 (depends on 14) The method of claim 14, wherein the svmi box includes a stereoscopic_composition_type indicating a type of frame composition of the stereoscopic file. ### Claim 16 (depends on 15) The method of claim 15, wherein the stereoscopic_composition_type is one of a side-by-side type, a vertical line interleaved type and a frame sequential type. ### Claim 17 (depends on 15) The method of claim 15, wherein the svmi box further includes at least one of an is_left_first value indicating which one of a left image and a right image is first encoded, a sample_count value indicating the number of successive samples, and a stereo_flag value indicating if a current frame is stereo or mono. ### Claim 18 (depends on 14) The method of claim 14, wherein the stereoscopic file includes an scdi box for stereoscopic camera and display information. ### Claim 19 (depends on 18) The method of claim 18, wherein the scdi box includes at least one of an is_cam_params value indicating if camera parameter information is included, a focal_length value indicating a distance from an optical center to an image plane, a convergence_distance value indicating a distance from a center of baseline to a convergence point, and an is_camera_cross value indicating arrangement of a camera. ### Claim 20 (depends on 18) The method of claim 18, wherein the scdi box includes at least one of an is_display_safety_info value indicating if display safety information is included, a value indicating a distance between a user and a display device, a value indicating screen size of the display device, a min_of_disparity value indicating a minimum disparity between a left image and a right image, and a max_of_disparity value indicating a maximum disparity between the left image and the right image. ### Claim 21 (depends on 18) The method of claim 18, wherein the stereoscopic file includes an ftyp box indicating a file type and compatibility, an moov box being a container for media data, an mvhd box indicating a movie header, a trak box being a container for each track or stream, a tkhd box having information regarding a track, an mdia box being a container for media data information included in a track, an mdhd box indicating a media header, an hdlr box being a handler defining a type of media, an minf box being a container for the media data information, a vmhd box having video media header information, an smhd box having sound media header information, an hmhd box having hint media header information, an nmhd box having Null media header information, a dinf box being a data information container, a dref box being a data reference box defining sources of media in a track, an stbl box being a sample table box, an stsd box being a sample description box for information, an stts box being a time-to-sample box for decoding, an stsc box being a sample-to-chunk box, an stsz box indicating bitstream sizes of samples, an stco box being a chunk offset box, and an mdat box being a container including media data. ### Claim 22 (depends on 18) The method of claim 18, wherein the stereoscopic file includes two Elementary Streams (ESs) each including left view video data and right view video data. ### Claim 23 (depends on 18) The method of claim 18, wherein the stereoscopic file includes an Elementary Stream (ES) in which samples or frames of left view video data and samples or frames of right view video data are interleaved in a frame unit. ### Claim 24 (depends on 18) The method of claim 18, wherein the stereoscopic file format includes an ftyp box indicating a file type and compatibility, a pdin box having information necessary for file download, an moov box being a container for media data, an mvhd box indicating a movie header, a trak box being a container for each track or stream, a tkhd box with a track header having information regarding a track, a tref box being a reference track container, an edts box being an edit list container, an elst box having an edit list, an mdia box being a container for media data information included in a track, an mdhd box indicating a media header, an hdlr box being a handler defining a type of media, an minf box being a container for the media data information, a vmhd box having video media header information, an smhd box having sound media header information, an hmhd box having hint media header information, an nmhd box having Null media header information, a dinf box being a data information container, a dref box being a data reference box defining sources of media in a track, an stbl box being a sample table box, an stsd box being a sample description box for information, an stts box being a time-to-sample box for decoding, an stsc box being a sample-to-chunk, an stsz box indicating bitstream sizes of samples, an stz2 box indicating compact bitstream sizes of samples, an stco box being a chunk offset box, a co64 box being a chunk offset box represented by 64-bit, an stss box being a sync sample table box, an ipmc box being a control box, an mdat box being a container including media data, a meta box being a container for storing metadata, an hdlr box being a handler box defining the type of metadata, an iloc box being a box specifying an item location, an iinf box being a box specifying item information, an xml box being a container for xml, and a bxml box being a container for binary xml. ### Claim 25 (depends on 18) The method of claim 18, wherein the stereoscopic file has a structure for stereoscopic content defined by assembling stereoscopic data and monoscopic data. ### Claim 26 (depends on 18) The method of claim 18, wherein the stereoscopic file has a structure for stereoscopic content including stereoscopic data.