# US 2022/0044472 A1 · Method and device for visualization of three-dimensional objects > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0044472 A1 - Document ID: US20220044472A1 - Status: Published application - Kind: A1 - Application number: 17/388,123 - Filed: 2021-07-29 - Published: 2022-02-10 - Earliest claimed: 2020-08-07 - Assignees: Siemens Healthcare GmbH - Applicants: Siemens Healthcare GmbH - Inventors: Klaus ENGEL - Web page: https://patentgrep.com/patent/US20220044472A1 ## CPC - G06T 15/08: Volume rendering - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 5/20: using local operators - G06T 15/06: Ray-tracing - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer-implemented method is for visualization of a three-dimensional object represented by volume data for a user in the form of a two-dimensional visualization image including a plurality of visualization pixels. In an embodiment, the method includes: providing an image synthesis algorithm designed for visualization of the three-dimensional object by mapping the volume data onto the visualization pixels; detecting an instantaneous viewing direction of the user; determining a focus area defined as a region of the visualization image, upon which the user focuses based upon the instantaneous viewing direction; adjusting the image synthesis algorithm such that the computing effort required for the mapping for visualization pixels outside of the focus area is lower than for visualization pixels inside of the focus area; and mapping volume data onto the visualization pixels with the adjusted image synthesis algorithm. ## Claims ### Claim 1 A computer-implemented method for visualization of a three-dimensional object represented by volume data for a user in a form of a two-dimensional visualization image including a plurality of visualization pixels, the method comprising: providing an image synthesis algorithm designed for visualization of the three-dimensional object by mapping the volume data onto the visualization pixels; detecting an instantaneous viewing direction of the user; determining a focus area defined as a region of the visualization image, which the user focuses on based upon the instantaneous viewing direction; adjusting the image synthesis algorithm such that computing effort required for mapping for visualization pixels outside of the focus area is relatively lower than for visualization pixels inside of the focus area, to produce an adjusted image synthesis algorithm; and mapping the volume data onto the visualization pixels with the adjusted image synthesis algorithm. ### Claim 2 (depends on 1) The method of claim 1, wherein: the visualization image includes a uniform spatial resolution of the visualization pixels. ### Claim 3 (depends on 1) The method of claim 1, wherein the adjusting includes: adjusting the image synthesis algorithm such that the computing effort relatively decreases as a distance from the focus area relatively increases. ### Claim 4 (depends on 3) The method of claim 3, wherein at least one of: at least some sections of the computing effort continuously decreases, as the distance from the focus area relatively increases, and at least some sections of the computing effort discontinuously decreases, as the distance from the focus area relatively increases. ### Claim 5 (depends on 1) The method of claim 1, wherein: the image synthesis algorithm includes a first mapping algorithm and a second mapping algorithm, different from the first mapping algorithm; and wherein the adjusting includes marking the first mapping algorithm, for mapping the volume data onto visualization pixels, inside of the focus area and marking the second mapping algorithm, for mapping the volume data onto visualization pixels, outside of the focus area. ### Claim 6 (depends on 5) The method of claim 5, wherein: the first mapping algorithm implements a path tracing method; and the second mapping algorithm implements a ray casting method. ### Claim 7 (depends on 1) The method of claim 1, wherein: the image synthesis algorithm is based on tracing of simulated rays in the object volume spanned by the volume data; and the adjusting of the image synthesis algorithm includes adjusting a rate at which the object volume is sampled along the simulated rays. ### Claim 8 (depends on 1) The method of claim 1, wherein: in the image synthesis algorithm, a plurality of different visualization modules are implemented, each of the respective different visualization modules taking into account respectively different mapping effects during the mapping of the volume data; and wherein the adjusting includes at least one of selectively adjusting, selectively activating, and selectively deactivating the respective different visualization modules. ### Claim 9 (depends on 8) The method of claim 8, wherein: a prioritization is allocated to the visualization modules; and wherein the at least one of selectively adjusting, selectively activating and selectively deactivating takes place based upon the prioritization. ### Claim 10 (depends on 1) The method of claim 1, wherein: the adjusting includes adjusting the shading quality. ### Claim 11 (depends on 1) The method of claim 1, further comprising: adapting resolution of the volume data such that, in the mapping, for visualization pixels outside of the focus area, a relatively lower resolution of the volume data is used than for visualization pixels inside of the focus area. ### Claim 12 (depends on 1) The method of claim 1, wherein the adjusting includes: determining at least one of a time budget and an available computing power for creating a visualization image by mapping the volume data set; and adjusting the image synthesis algorithm based upon the at least one of time budget and available computing power. ### Claim 13 (depends on 1) The method of claim 1, further comprising: generating an improved visualization image by applying a trained function to the visualization image, wherein the trained function is configured to improve image quality of the visualization image. ### Claim 14 (depends on 1) The method of claim 1, further comprising: applying a filter algorithm to the visualization image, the filter algorithm including at least one of Gaussian, bilinear, and low-pass filter elements. ### Claim 15 A visualization system for visualization of a three-dimensional object represented by volume data, the visualization taking place for a user in a form of a two-dimensional visualization image including a plurality of visualization pixels, the visualization system comprising: an interface designed to receive the volume data and detection information, the detection information including information about an instantaneous viewing direction of the user; and an arithmetic unit designed to: determine a focus area based upon the detection information, the focus area being defined as a region of the visualization image upon which the user focuses; map the volume data for creation of the visualization image onto the visualization pixels and adjust mapping such that computing effort for visualization pixels outside of the focus area is relatively lower than computing effort for visualization pixels inside of the focus area. ### Claim 16 (depends on 1) A non-transitory computer program product storing a computer program, which can be loaded directly into a storage device of a visualization system, including program segments to carry out the method for visualization of a three-dimensional object of claim 1 when the program segments are run by the visualization system. ### Claim 17 (depends on 1) A non-transitory computer-readable storage medium storing program segments, readable and runable by a visualization system, to carry out the method for visualization of a three-dimensional object of claim 1 when the program segments are run by the visualization system. ### Claim 18 (depends on 2) The method of claim 2, wherein the adjusting includes: adjusting the image synthesis algorithm such that the computing effort relatively decreases as a distance from the focus area relatively increases. ### Claim 19 (depends on 18) The method of claim 18, wherein at least one of: at least some sections of the computing effort continuously decreases, as the distance from the focus area relatively increases, and at least some sections of the computing effort discontinuously decreases, as the distance from the focus area relatively increases. ### Claim 20 (depends on 2) The method of claim 2, wherein: the image synthesis algorithm includes a first mapping algorithm and a second mapping algorithm, different from the first mapping algorithm; and wherein the adjusting includes marking the first mapping algorithm, for mapping the volume data onto visualization pixels, inside of the focus area and marking the second mapping algorithm, for mapping the volume data onto visualization pixels, outside of the focus area. ### Claim 21 (depends on 20) The method of claim 20, wherein: the first mapping algorithm implements a path tracing method; and the second mapping algorithm implements a ray casting method. ### Claim 22 (depends on 13) The method of claim 13, wherein the trained function is configured to improve image quality of the visualization image by a correction of effects of the adjusting of the image synthesis algorithm. ### Claim 23 A visualization system for visualization of a three-dimensional object represented by volume data, the visualization taking place for a user in a form of a two-dimensional visualization image including a plurality of visualization pixels, the visualization system comprising: an interface to receive the volume data and detection information, the detection information including information about an instantaneous viewing direction of the user; and at least one processor to: determine a focus area based upon the detection information, the focus area being defined as a region of the visualization image upon which the user focuses; map the volume data for creation of the visualization image onto the visualization pixels and adjust mapping such that computing effort for visualization pixels outside of the focus area is relatively lower than computing effort for visualization pixels inside of the focus area.