# US 2008/0187222 A1 · Rendering Images Based On Image Segmentation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2008/0187222 A1 - Document ID: US20080187222A1 - Status: Published application - Kind: A1 - Application number: 11/718,917 - Filed: 2005-11-08 - Published: 2008-08-07 - Earliest claimed: 2004-11-16 - Assignees: Koninklijke Philips Electronics N.V. - Inventors: Fabian Edgar Ernst; Peter-Andre Redert - Web page: https://patentgrep.com/patent/US20080187222A1 ## CPC - G06T 15/20: Perspective computation - G06T 7/12: Edge-based segmentation - G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)} - G06T 2207/20228: Disparity calculation for image-based rendering - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The invention relates to a method for providing rendered images based on image segmentation with determining an edge within the image introduced by boundaries of image segments. To allow shift-based rendering, the invention provides determining an edge within the image introduced by boundaries of image segments, determining an edge region around the edge, determining a first displacement field for the segments, determining a second displacement field for the edge region, merging the first and the second displacement field into a third displacement field having a displacement of the first displacement field for the segments and a displacement of the second displacement field for the edge region, such that the edge region is treated as a separate object with a separate displacement, and shifting the image pixels according to the third displacement field. ## Claims ### Claim 1 A method for providing rendered images based on image segmentation with determining an edge within the image introduced by boundaries of image segments, determining an edge region around the edge, determining a first displacement field for the segments, determining a second displacement field for the edge region, merging the first and the second displacement field into a third displacement field having a displacement of the first displacement field for the segments and a displacement of the second displacement field for the edge region, such that the edge region is treated as a separate object with a separate displacement, and shifting the image pixels according to the third displacement field. ### Claim 2 (depends on 1) The method of claim 1, with filling the hole after having shifted the pixels with pixel values. ### Claim 3 (depends on 2) The method of claim 2, with calculating the pixel values for hole filling from pixel values of pixels bordering the hole from at least one of the segments or from pixel values of pixels from the edge region bordering the hole. ### Claim 4 (depends on 1) The method of claim 1, with determining the edge by detecting boundaries between image segments. ### Claim 5 (depends on 1) The method of claim 1, with determining the edge region by assigning to each edge all pixels which are closer to said edge than a threshold number of pixels. ### Claim 6 (depends on 1) The method of claim 1, with determining the edge region such that edge blur lies within the edge region. ### Claim 7 (depends on 1) The method of claim 1, with providing a 2,5 dimensional image signal with an original image information and an original depth information for shift based rendering. ### Claim 8 (depends on 7) The method of claim 7, with detecting discontinuities within the depth information of the 2,5 dimensional image for determining the first and/or the second displacement field. ### Claim 9 (depends on 1) The method of claim 1, with determining the first and/or the second displacement field from motion estimation of the segments and/or the edge regions. ### Claim 10 (depends on 1) The method of claim 1, with determining the second displacement field such that only pixels within the edge region have a displacement. ### Claim 11 (depends on 1) The method of claim 1, with determining the second displacement field such that the displacement is between the displacement values of the two corresponding segments ### Claim 12 (depends on 1) The method of claim 1, with determining the third displacement field by taking for at least parts of pixels in the edge region the displacements from the second displacement field and for all other pixels the displacement from the first displacement field. ### Claim 13 (depends on 1) The method claim 1, with determining the third displacement field directly by motion estimation of the segments and the edge region. ### Claim 14 (depends on 1) The method of claim 1, with shifting the pixels according to the third displacement field such that the segments are shifted first. ### Claim 15 A system arranged for providing rendered images based on image segmentation comprising: determination means arranged to determine an edge within the image introduced by boundaries of image segments, to determine an edge region around the edge, to determine a first displacement field for the segments, and to determine a second displacement field for the edge region, merging means arranged to merge the first and the second displacement field into a third displacement field having a displacement of the first displacement field for the segments and a displacement of the second displacement field for the edge region, such that the edge region is treated as a separate object with a separate displacement, and shifting means arranged to shift the image pixels according to the third displacement field. ### Claim 16 A computer program product for providing rendered images based on image segmentation with a computer program operable to cause a processor to: determine an edge within the image introduced by boundaries of image segments, determine an edge region around the edge, determine a first displacement field for the segments, determine a second displacement field for the edge region, merge the first and the second displacement field into a third displacement field having a displacement of the first displacement field for the segments and a displacement of the second displacement field for the edge region, such that the edge region is treated as a separate object with a separate displacement, and shift the image pixels according to the third displacement field.