# US 2020/0288114 A1 · Multi-Resolution Multi-View Video Rendering > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2020/0288114 A1 - Document ID: US20200288114A1 - Status: Published application - Kind: A1 - Application number: 16/809,397 - Filed: 2020-03-04 - Published: 2020-09-10 - Earliest claimed: 2019-03-04 - Assignees: Dolby Laboratories Licensing Corporation - Applicants: Dolby Laboratories Licensing Corporation - Inventors: Haricharan LAKSHMAN; Wenhui JIA; Jasper CHAO; Shwetha RAM; Domagoj BARICEVIC; Ajit NINAN - Web page: https://patentgrep.com/patent/US20200288114A1 ## CPC - H04N 13/351: for displaying simultaneously - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 13/344: with head-mounted left-right displays - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A device and method for video rendering. The device includes a memory and an electronic processor. The electronic processor is configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, and determine, for each target image region, a proxy image region larger than the corresponding target image region. The electronic processor is configured to determine, for each target image region, a plurality of reference pixels that fit within the corresponding proxy image region, project, for each target image region, the plurality of reference pixels that fit within the corresponding proxy image region to the target image region, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering. ## Claims ### Claim 1 A device for video rendering, the device comprising: a memory; and an electronic processor configured to receive, from a source device, video data including multiple reference viewpoints, determine a target image plane corresponding to a target viewpoint, determine, within the target image plane, one or more target image regions, determine, for each target image region within the target image plane, a proxy image region, the proxy image region being larger than the corresponding target image region by a margin surrounding the corresponding target image region, determine, for each target image region within the target image plane, a plurality of reference pixels that fit within the corresponding proxy image region, from one or more of the multiple reference viewpoints, project, for each target image region within the target image plane, the plurality of reference pixels that fit within the corresponding proxy image region, from the one or more multiple reference viewpoints, to the target image region within the target image plane, producing a rendered target region from each target image region, and composite one or more of the rendered target regions to create video rendering for the target image plane. ### Claim 2 (depends on 1) The device of claim 1, wherein the at least one target image region is a plurality of target image regions, and respective ones of the plurality of target image regions are rendered with different resolutions. ### Claim 3 (depends on 1) The device of claim 1, wherein the at least one target image region is a plurality of target image regions, and a number of reference viewpoints is different for each target image region. ### Claim 4 (depends on 1) The device of claim 1, wherein the proxy image region is determined based on at least one of a depth range, a virtual camera array layout, or real camera array layout. ### Claim 5 (depends on 1) The device of claim 1, wherein the margin is predetermined. ### Claim 6 (depends on 1) The device of claim 1, wherein at least one target image region is determined based on a focus area of a viewer. ### Claim 7 (depends on 6) The device of claim 6, wherein the focus area is a foveation area having a resolution greater than a resolution of a peripheral area within the target image region. ### Claim 8 A method for video rendering, the method comprising: receiving, from a source device, video data including multiple reference viewpoints; determining a target image plane corresponding to a target viewpoint, determining, within the target image plane, one or more target image regions, determining, for each target image region within the target image plane, a proxy image region, the proxy image region being larger than the corresponding target image region by a margin surrounding the corresponding target image region; determining, for each target image region within the target image plane, a plurality of reference pixels that fit within the corresponding proxy image region, from one or more of the multiple reference viewpoints; projecting, for each target image region within the target image plane, the plurality of reference pixels that fit within the corresponding proxy image region, from the one or more multiple reference viewpoints, to the target image region within the target image plane, producing a rendered target region from each target image region; and compositing one or more of the rendered target regions to create video rendering for the target image plane. ### Claim 9 (depends on 8) The method of claim 8, wherein the at least one target image region is a plurality of target image regions, and respective ones of the plurality of target image regions are is a plurality of target image regions, and respective ones of the plurality of target image regions are rendered with different resolutions. ### Claim 10 (depends on 8) The method of claim 8, wherein the at least one target image region is a plurality of target image regions, and a number of reference viewpoints is different for each target image region. ### Claim 11 (depends on 8) The method of claim 8, wherein the proxy image region is determined based on at least one of a depth range, a virtual camera array layout, or real camera array layout. ### Claim 12 (depends on 8) The method of claim 8, wherein the margin is predetermined. ### Claim 13 (depends on 8) The method of claim 8, wherein at least one target image region is determined based on a focus area of a viewer. ### Claim 14 (depends on 13) The method of claim 13, wherein the focus area is a foveation area having a resolution greater than a resolution of a peripheral area within the target image region. ### Claim 15 A device for video rendering, the device comprising: a memory; and an electronic processor configured to receive source content including multiple reference viewpoints, map the source content using a projective mapping technique, partition the mapped source content into a plurality of tiles, determine a subset of the plurality of regions for synthesis of a target view based on a proxy image region surrounding each target image region, and render the subset of the plurality of regions. ### Claim 16 (depends on 15) The device of claim 15, wherein a respective size of a respective tile is based on the resolution of the tile. ### Claim 17 (depends on 15) The device of claim 15, wherein a number of reference viewpoints is different for each target image region. ### Claim 18 (depends on 15) The device of claim 15, wherein the projective mapping technique is an equirectangular mapping or a cube mapping.