# US 10,373,375 B2 · Image processing system and method using device rotation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,373,375 B2 - Document ID: US10373375B2 - Status: Granted - Kind: B2 - Application number: 14/007,698 - Filed: 2012-03-30 - Published: 2014-01-23 - Granted: 2019-08-06 - Earliest claimed: 2011-04-08 - Assignees: Koninklijke Philips N.V. - Applicants: Fabian Wenzel; Roel Truyen; Jean-Pierre Franciscus Alexander Maria Ermes; Johan Michiel Den Harder - Inventors: Fabian Wenzel; Roel Truyen; Jean-Pierre Franciscus Alexander Maria Ermes; Johan Michiel Den Harder - Web page: https://patentgrep.com/patent/US10373375B2 ## CPC - G06T 19/003: {Navigation within 3D models or images} - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06T 15/20: Perspective computation - H04N 13/349: Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking (for viewing without the aid of special glasses using fly-eye lenses H04N13/307) - H04N 13/398: Synchronisation thereof; Control thereof - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Image processing system 100 for enabling a user to navigate through image data having at least three spatial dimensions by displaying views 155 of the image data, the image processing system comprising an image device 110 comprising a display 130 for displaying the views of the image data and an orientation sensor 120 for measuring an orientation of the image device with respect to a reference orientation for providing rotation data 125 indicative of a device rotation of the image device, means 140 for establishing a center of rotation in the image data, and an image processor 150 for establishing the views of the image data in relation to the device rotation by, for establishing a current view, (i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing the current view in dependence on the view rotation around the center of rotation with respect to a reference view. ## Claims ### Claim 1 An image processing system for enabling a user to navigate through image data having at least three spatial dimensions by displaying views of the image data, the image processing system comprising: an image device comprising a display for displaying the views of the image data and an orientation sensor for measuring an orientation of the image device with respect to a reference orientation and for providing rotation data indicative of a device rotation of the image device; means for establishing, in the image data, a center of rotation about which the views of the image data from the image device rotate in the device rotation; and an image processor for establishing the views of the image data in relation to the device rotation by: (i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing a current view in dependence on the view rotation around the center of rotation with respect to a reference view; wherein: the means for establishing the center of rotation comprises a region of interest detector for detecting a medical anomaly as a region of interest in the image data, enabling the means for establishing the center of rotation to establish the center of the region of interest as the center of rotation, and the region of interest is imagery of a physical object within the image data. ### Claim 2 (depends on 1) The image processing system according to claim 1, wherein: the image processing system further comprises a user input for receiving selection data from the user, and the means for establishing the center of rotation is arranged for establishing the center of rotation in further dependence on the selection data so as to enable the user to influence a manner in which the center of rotation is established. ### Claim 3 (depends on 2) The image processing system according to claim 2, wherein: the user input is arranged for receiving navigation data from the user, and the image processor is arranged for establishing the views of the image data in dependence on the navigation data. ### Claim 4 (depends on 3) The image processing system according to claim 3, wherein the navigation data comprises a pan or a zoom navigation command. ### Claim 5 (depends on 1) The image processing system according to claim 1, wherein the image data comprises volumetric image data and the image processor is arranged for said establishing the current view by using at least one of a group of: multi-planar reformatting, volume rendering, and surface rendering, to generate the current view. ### Claim 6 (depends on 1) The image processing system according to claim 1, wherein the image data comprises three-dimensional graphics data and the image processor is arranged for said establishing the current view by using graphics rendering to generate the current view. ### Claim 7 (depends on 1) The image processing system according to claim 1, wherein said establishing the current view comprises (i) establishing a 4×4 transformation matrix in dependence on the view rotation and the center of rotation, and (ii) generating the current view using the 4×4 transformation matrix. ### Claim 8 (depends on 1) The image processing system according to claim 1, wherein the image processor is arranged for establishing the view rotation in relation to the device rotation by applying a direct mapping to the device rotation to obtain the view rotation. ### Claim 9 (depends on 1) The image processing system according to claim 1, wherein the image processing system is arranged for receiving a reset command from the user for resetting the reference orientation or the reference view. ### Claim 10 (depends on 1) The image processing system according to claim 1, wherein the image processing system is arranged for receiving a pause command from the user for pausing said establishing the views of the image data in relation to the device rotation. ### Claim 11 (depends on 1) The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a gain to the device rotation to obtain the view rotation. ### Claim 12 (depends on 1) The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying an offset to the device rotation to obtain the view rotation. ### Claim 13 (depends on 1) The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a threshold to the device rotation to obtain the view rotation. ### Claim 14 (depends on 1) The image processing system of claim 1, wherein the image processor establishes the view rotation in relation to the device rotation by applying a non-linear function to the device rotation to obtain the view rotation. ### Claim 15 (depends on 1) A handheld device comprising the image processing system of claim 1. ### Claim 16 (depends on 1) A handheld or an imaging apparatus comprising the image processing system of claim 1. ### Claim 17 A method of enabling a user to navigate through image data having at least three spatial dimensions by displaying views of the image data on a display of an image device, the method comprising: measuring, by an orientation sensor, an orientation of the image device with respect to a reference orientation for providing rotation data indicative of a device rotation of the image device; establishing, in the image data, a center of rotation about which the views of the image data from the image device rotate in the device rotation; and establishing the views of the image data in relation to the device rotation by: (i) receiving the rotation data from the orientation sensor, (ii) establishing a view rotation in relation to the device rotation, and (iii) establishing a current view in dependence on the view rotation around the center of rotation with respect to a reference view, wherein: establishing the center of rotation in the image data comprises: automatically detecting a medical anomaly as a region of interest in the image data; identifying a center of the region of interest; and establishing the center of the region of interest as the center of rotation, and the region of interest is imagery of a physical object within the image data. ### Claim 18 (depends on 17) A non-transitory computer-readable medium executable on a processor of an image processing system, which when executed by the image processing system cause the image processing system to perform the method according to claim 17.