# US 2020/0288171 A1 · Apparatus, a method and a computer program for omnidirectional video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0288171 A1 - Document ID: US20200288171A1 - Status: Published application - Kind: A1 - Application number: 16/626,726 - Filed: 2018-05-22 - Published: 2020-09-10 - Earliest claimed: 2017-07-03 - Assignees: Nokia Technologies Oy - Applicants: Nokia Technologies Oy - Inventors: Miska HANNUKSELA; Sebastian SCHWARZ - Web page: https://patentgrep.com/patent/US20200288171A1 ## CPC - H04N 19/124: Quantisation - H04N 19/597: specially adapted for multi-view video sequence encoding - H04N 13/128: Adjusting depth or disparity - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/243: using three or more two-dimensional [2D] image sensors - H04N 13/296: Synchronisation thereof; Control thereof - H04N 19/167: Position within a video image, e.g. region of interest [ROI] - H04N 19/176: the region being a block, e.g. a macroblock - H04N 19/187: the unit being a scalable video layer - H04N 19/70: characterised by syntax aspects related to video coding, e.g. related to compression standards - H04N 23/60: Control of cameras or camera modules - H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - G03B 37/04: with cameras or projectors providing touching or overlapping fields of view - H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras} - H04N 21/816: {involving special video data, e.g 3D video} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a bitstream comprising a coded first-view picture and a coded second-view picture is encoded or encapsulated. The coded second-view picture represents a smaller field of view than the coded first-view picture, wherein decoding of the coded first-view picture results in a decoded first-view picture, and decoding of the coded second-view picture results in a decoded second-view picture. An indication is inserted in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture. ## Claims ### Claim at position 1 1-23. (canceled) ### Claim 24 An apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least: encode or encapsulating a bitstream comprising a coded first-view picture and a coded second-view picture, wherein: the coded second-view picture represents a smaller field of view than the coded first-view picture; decode of the coded first-view picture results in a decoded first-view picture; and decode of the coded second-view picture results in a decoded second-view picture; and indicate in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture. ### Claim 25 (depends on 24) The apparatus of claim 24 further comprising: decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and indicating in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture. ### Claim 26 (depends on 24) The apparatus of claim 24, wherein the decoded first-view picture and the reconstructed second-view picture comprise a monoscopic area, the apparatus further comprising: encoding or encapsulating the monoscopic area into the coded first-view picture and excluding the monoscopic area from the coded second-view picture. ### Claim 27 (depends on 26) The apparatus of claim 26, wherein the mapping comprises: a first region of the decoded picture covering the decoded first-view picture mapped to the first-view constituent picture of the frame-packed picture; a second region of the decoded picture covering a left-side of the monoscopic area of the decoded first-view picture mapped to a second region within the second-view constituent picture of the frame-packed picture; a third region of the decoded picture covering a right-side of the monoscopic area of the decoded first-view picture mapped to a third region within the second-view constituent picture of the frame-packed picture; and a fourth region of the decoded picture covering the decoded second-view picture, which excludes the monoscopic area, mapped to a fourth region within the second-view constituent picture of the frame-packed picture. ### Claim 28 (depends on 24) The apparatus claim 24, further comprising: indicating, in or along the bitstream, a spherical coverage of the coded first-view picture and the coded second-view picture separately for each view. ### Claim 29 (depends on 24) The apparatus claim 24, further comprising: indicating, in or along the bitstream, one-dimensional coordinate indicative of a location of a border between an overlapping area and a non-overlapping area in the coded first-view picture. ### Claim 30 (depends on 28) The apparatus of claim 28, further comprising: indicating in or along the bitstream that for the non-overlapping spherical coverage or area, content from the first view is copied for reconstructing the reconstructed second-view picture. ### Claim 31 (depends on 26) The apparatus claim 26, further comprising: encoding at least a part of the monoscopic area within the coded first-view picture as one or more motion-constrained tile sets, which do not contain any stereoscopic areas. ### Claim 32 (depends on 24) The apparatus of the claim 24, further comprising: encapsulating the coded first-view into a first track; and encapsulating the coded second-view is into a second track. ### Claim 33 An apparatus comprising at least one processor and at least one memory, said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least: receive a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded second-view picture represents a smaller field of view than the coded first-view picture; decode the coded first-view picture, wherein the decoding results into a decoded first-view picture; decode the coded second-view picture, wherein the decoding results into a decoded second-view picture; decode from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and reconstruct the reconstructed second-view picture accordingly. ### Claim 34 (depends on 33) The apparatus of claim 33, further comprising: decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and decoding in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture. ### Claim 35 (depends on 33) The apparatus of claim 33, wherein the field of view comprises a monoscopic area, the apparatus further comprising: decoding or decapsulating the monoscopic area from the coded first-view picture. ### Claim 36 (depends on 33) The apparatus of claim 33, further comprising: decoding, from or along the bitstream, a separate indication of a spherical coverage of the coded first-view picture and the coded second-view picture for each view. ### Claim 37 (depends on 33) The apparatus of claim 33, further comprising: decoding, from or along the bitstream, one-dimensional coordinate indicative of a location of a border between an overlapping area and a non-overlapping area in the coded first-view picture. ### Claim 38 (depends on 36) The apparatus of claim 36, further comprising: decoding from or along the bitstream an indication that for non-overlapping spherical coverage or area, content from the first view is copied for reconstructing the reconstructed second-view picture. ### Claim 39 A method, comprising: encoding or encapsulating a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded second-view picture represents a smaller field of view than the coded first-view picture, decoding of the coded first-view picture results in a decoded first-view picture, decoding of the coded second-view picture results in a decoded second-view picture; and indicating in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture. ### Claim 40 A method, comprising: receiving a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded second-view picture represents a smaller field of view than the coded first-view picture, decoding the coded first-view picture, wherein the decoding results into a decoded first-view picture, decoding the coded second-view picture, wherein the decoding results into a decoded second-view picture, decoding from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and reconstructing the reconstructed second-view picture accordingly. ### Claim 41 (depends on 40) The method of claim 40, further comprising: decoding of a coded picture to form a decoded picture, wherein the coded picture comprises the decoded first-view picture and the decoded second-view picture; and decoding in or along the bitstream a mapping between respective regions of the decoded picture and regions of a frame-packed picture, wherein the decoded first-view picture and the reconstructed second-view picture jointly form a frame-packed picture comprising a first-view constituent picture and a second-view constituent picture. ### Claim 42 A computer readable storage medium comprising code for use by an apparatus, which when executed by a processor, causes the apparatus to perform at least: obtain a first coded tile or sub-picture track and a second coded tile or sub-picture track, the first and second coded tile or sub-picture tracks representing a different spatial part of an input video sequence, and the first and second coded tile or sub-picture tracks having the same width and height in pixels; encode or encapsulate a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded second-view picture represents a smaller field of view than the coded first-view picture, decoding of the coded first-view picture results in a decoded first-view picture, decoding of the coded second-view picture results in a decoded second-view picture, and indicate in or along the bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture. ### Claim 43 A computer readable storage medium comprising code for use by an apparatus, which when executed by a processor, causes the apparatus to perform at least: receive a bitstream comprising a coded first-view picture and a coded second-view picture, wherein the coded second-view picture represents a smaller field of view than the coded first-view picture, decode the coded first-view picture, wherein the decoding results into a decoded first-view picture, decode the coded second-view picture, wherein the decoding results into a decoded second-view picture, decode from or along a bitstream that a reconstructed second-view picture comprises the decoded second-view picture and at least one region of the decoded first-view picture, wherein the reconstructed second-view picture represents the same field of view as the decoded first-view picture, and reconstruct the reconstructed second-view picture accordingly.