# US 2018/0322689 A1 · Visualization and rendering of images to enhance depth perception > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0322689 A1 - Document ID: US20180322689A1 - Status: Published application - Kind: A1 - Application number: 15/972,809 - Filed: 2018-05-07 - Published: 2018-11-08 - Earliest claimed: 2017-05-05 - Assignees: University of Maryland, College Park - Applicants: University of Maryland, College Park - Inventors: Sujal BISTA; Amitabh VARSHNEY - Web page: https://patentgrep.com/patent/US20180322689A1 ## CPC - G06T 15/205: {Image-based rendering} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/579: from motion - G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation} - G06T 2207/10016: Video; Image sequence - G06T 2207/10024: Color image - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Various communication systems may benefit from improved depth perception of images. For example, it may be helpful to enhance depth perception of a three-dimensional rendering of an image. A method, according to certain embodiments, may include acquiring at an apparatus a pair of images. The method may also include computing an energy map based on one or more kinetic parameters of the pair of images. In addition, the method may include generating a kinetic depth image based on the energy map. ## Claims ### Claim 1 An apparatus comprising: at least one memory comprising computer program code; at least one processor; wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to: acquire a pair of images; compute an energy map based on one or more kinetic parameters of the pair of images; and generate a kinetic depth image based on the energy map. ### Claim 2 (depends on 1) The apparatus according to claim 1, wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to: calculate an optical flow and a depth map based on the acquired pair of images; and generate a depth mesh by remapping the depth map based on the optical flow, wherein the depth mesh is used to generate the kinetic depth image. ### Claim 3 (depends on 1) The apparatus according to claim 1, wherein the kinetic depth image is generated based on at least one image of the pair of images and a depth map, and wherein the depth map is hand drawn or generated by depth sensors. ### Claim 4 (depends on 1) The apparatus according to claim 1, wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to: compute a motion of the apparatus to maximize a kinetic depth effect used to generate the kinetic depth image, wherein the generated kinetic depth image uses the computed motion. ### Claim 5 (depends on 4) The apparatus according to claim 4, wherein the motion is angular or conical. ### Claim 6 (depends on 1) The apparatus according to claim 1, wherein the one or more kinetic parameters comprises at least one of depth, centrality, or saliency. ### Claim 7 (depends on 6) The apparatus according to claim 6, wherein the depth, centrality, and saliency are calculated based on at least one of depth energy, radial energy, and saliency energy, respectively. ### Claim 8 (depends on 2) The apparatus according to claim 2, wherein the remapping of the depth map to achieve the depth mesh enhances depth perception of the kinetic depth image, wherein the depth perception depends on a relative velocity of the kinetic depth image. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the depth perception of the generated kinetic depth image is a non-linearly varying depth perception. ### Claim 10 (depends on 8) The apparatus according to claim 8, wherein a maximum of the relative velocity is optimized at 1.25 visual angle per second. ### Claim 11 (depends on 1) The apparatus according to claim 1, wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to: calculate a pivot point based on the one or more kinetic parameters, wherein the generated kinetic depth image is rotated around an axis that passes through the pivot point. ### Claim 12 (depends on 11) The apparatus according to claim 11, wherein the pivot point may have a lower velocity than other parts of the kinetic depth image. ### Claim 13 (depends on 1) The apparatus according to claim 1, wherein the pair of images are included as part of a collection of images. ### Claim 14 (depends on 1) The apparatus according to claim 1, wherein the pair of images includes at least one of a still image, a video image, a vector graphic, a three dimensional gestural drawing, or a light field. ### Claim 15 (depends on 2) The apparatus according to claim 2, wherein the depth mesh is produced using an optimized depth compression based on at least one of saliency of the pair of images or chosen edges of the pair of images. ### Claim 16 (depends on 1) The apparatus according to claim 1, wherein the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to: project the kinetic depth image on a screen of the apparatus or another apparatus. ### Claim 17 A method comprising: acquiring at an apparatus a pair of images; computing an energy map based on one or more kinetic parameters of the pair of images; and generating a kinetic depth image based on the depth mesh and the energy map. ### Claim 18 (depends on 17) The method according to claim 17, further comprising: calculating an optical flow and a depth map based on the acquired pair of images; and generating a depth mesh by remapping the depth map based on the optical flow, wherein the depth mesh is used to generate the kinetic depth image. ### Claim 19 (depends on 17) The method according to claim 17, wherein the kinetic depth image is generated based on at least one image of the pair of images and a depth map, and wherein the depth map is hand drawn or generated by depth sensors. ### Claim 20 (depends on 17) The method according to claim 17, further comprising: computing a motion to maximize a kinetic depth effect used to generate the kinetic depth image, wherein the generated kinetic depth image uses the computed motion. ### Claim 21 (depends on 20) The method according to claim 20, wherein the motion is angular or conical. ### Claim 22 (depends on 17) The method according to claim 17, wherein the one or more kinetic parameters comprises at least one of depth, centrality, or saliency. ### Claim 23 (depends on 22) The method according to claim 22, wherein the depth, centrality, and saliency are calculated based on at least one of depth energy, radial energy, and saliency energy, respectively. ### Claim 24 (depends on 18) The method according to claim 18, wherein the remapping of the depth map to achieve the depth mesh enhances depth perception of the kinetic depth image, wherein the depth perception depends on a relative velocity of the kinetic depth image. ### Claim 25 (depends on 24) The method according to claim 24, wherein the depth perception of the generated kinetic depth image is a non-linearly varying depth perception. ### Claim 26 (depends on 24) The method according to claim 24, wherein a maximum of the relative velocity is optimized at 1.25 visual angle per second. ### Claim 27 (depends on 17) The method according to claim 17, further comprising: calculating a pivot point based on the one or more kinetic parameters, wherein the generated kinetic depth image is rotated around an axis that passes through the pivot point. ### Claim 28 (depends on 27) The method according to claim 27, wherein the pivot point may have a lower velocity than other parts of the kinetic depth image. ### Claim 29 (depends on 17) The method according to claim 17, wherein the pair of images are included as part of a collection of images. ### Claim 30 (depends on 17) The method according to claim 17, wherein the pair of images includes at least one of a still image, a video image, a vector graphic, a three dimensional gestural drawing, or a light field. ### Claim 31 (depends on 17) The method according to claim 17, wherein the depth mesh is produced using an optimized depth compression based on at least one of saliency of the pair of images or chosen edges of the pair of images. ### Claim 32 (depends on 17) The method according to claim 17, further comprising: projecting the kinetic depth image on a screen of the apparatus or another apparatus.