# US 10,372,288 B2 · Selection of objects in a three-dimensional virtual scene > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,372,288 B2 - Document ID: US10372288B2 - Status: Granted - Kind: B2 - Application number: 14/343,500 - Filed: 2012-09-05 - Published: 2014-09-04 - Granted: 2019-08-06 - Earliest claimed: 2011-09-08 - Assignees: Airbus Defence and Space GmbH - Applicants: Leonhard Vogelmeier; David Wittmann - Inventors: Leonhard Vogelmeier; David Wittmann - Web page: https://patentgrep.com/patent/US10372288B2 ## CPC - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597) - H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking - H04N 13/363: using image projection screens (volumetric display H04N13/388) - H04N 13/383: for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes - H04N 13/388: Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A representation device for representing and interacting with a three-dimensional virtual scenario includes an input unit and at least one representation region for representing the three-dimensional scenario. A marking element may be moved on a virtual surface area with two translational degrees of freedom such that each virtual object in the three-dimensional virtual scenario may be selected with the marking element. ## Claims ### Claim 1 A representation device comprising a processor and configured for representing and interacting with a three-dimensional virtual scenario and for interacting therewith, the representation device comprising: at least one representation region configured to represent the three-dimensional scenario; and an input unit configured to select a virtual object in the three-dimensional virtual scenario by controlling a movement of a marking element in the three-dimensional virtual scenario, wherein the movement has two degrees of freedom, wherein the movement of the marking element with the two degrees of freedom occurs in a virtual surface area, wherein the selection of the virtual object in the three-dimensional virtual scenario is achieved by detecting at least one eye of a user and calculating a connecting line based on the detected position of the eye and the position of the marking element in the virtual surface area and extending the connecting line into the virtual three-dimensional scenario, wherein the marking element is moved on the virtual surface area such that, if the connecting line intersects the coordinates of the virtual object, the marking element can be represented in the three-dimensional scenario such that it adopts the virtual three-dimensional coordinates of the selected object with additional depth information, and wherein the virtual surface area is shaped in a circular or rounded manner, or as a hemisphere or sphere. ### Claim 2 (depends on 1) The representation device of claim 1, wherein the virtual surface area is a plane. ### Claim 3 (depends on 1) The representation device of claim 1, wherein the virtual surface area is a circular arc. ### Claim 4 (depends on 1) The representation device of claim 1, wherein the arrangement of the virtual surface area in the three-dimensional virtual scenario is changeable. ### Claim 5 A workstation device for representing and operating a three-dimensional virtual scenario, the workstation device comprising: a representation device, which includes a processor; at least one representation region configured to represent the three-dimensional scenario; and an input unit configured to select a virtual object in the three-dimensional virtual scenario by controlling a movement of a marking element in the three-dimensional virtual scenario, wherein the movement has two degrees of freedom, wherein the movement of the marking element with the two degrees of freedom occurs in a virtual surface area, wherein the selection of the virtual object in the three-dimensional virtual scenario is achieved by detecting at least one eye of a user and calculating a connecting line based on the detected position of the eye and the position of the marking element in the virtual surface area and extending the connecting line into the virtual three-dimensional scenario, wherein the marking element is moved on the virtual surface area such that, if the connecting line intersects the coordinates of the virtual object, the marking element can be represented in the three-dimensional scenario such that it adopts the virtual three-dimensional coordinates of the selected object with additional depth information, and wherein the virtual surface area is shaped in a circular or rounded manner, or as a hemisphere or sphere. ### Claim 6 (depends on 5) The workstation device of claim 5, wherein the workstation device is configured to represent and monitor air spaces. ### Claim 7 (depends on 5) The workstation device of claim 5, wherein the workstation device is an air traffic control workstation. ### Claim 8 (depends on 5) The workstation device of claim 5, wherein the workstation device is configured to monitor and control unmanned aircraft. ### Claim 9 A method for selecting virtual objects in a three-dimensional virtual scenario comprising the steps: reproducing a marking element in the three-dimensional virtual scenario; moving the marking element with two degrees of freedom along a virtual surface area; and selecting a virtual object in the three-dimensional virtual scenario by positioning the marking element in a certain region on the virtual surface area, wherein the selection of the virtual object in the three-dimensional virtual scenario is achieved by detecting at least one eye of a user and calculating a connecting line based on the detected position of the eye and the position of the marking element in the virtual surface area and extending the connecting line into the virtual three-dimensional scenario, wherein the marking element is moved on the virtual surface area such that, if the connecting line intersects the coordinates of the virtual object, the marking element can be represented in the three-dimensional scenario such that it adopts the virtual three-dimensional coordinates of the selected object with additional depth information, and wherein the virtual surface area is shaped in a circular or rounded manner, or as a hemisphere or sphere. ### Claim 10 (depends on 9) The method in accordance with claim 9, further comprising the step: determining a connecting line from an eye of the viewer to the marking element, wherein the determination of the connecting line occurs prior to the selection of the virtual object; wherein the object is selected by moving the marking element on the virtual surface area such that the connecting line intersects a virtual location of the virtual object in the three-dimensional virtual scenario. ### Claim 11 A non-transitory computer-readable medium, which when executed on a processor performs the steps: reproducing a marking element in the three-dimensional virtual scenario; moving the marking element with two degrees of freedom along a virtual surface area; and selecting a virtual object in the three-dimensional virtual scenario by positioning the marking element in a certain region on the virtual surface area, wherein the selection of the virtual object in the three-dimensional virtual scenario is achieved by detecting at least one eye of a user and calculating a connecting line based on the detected position of the eye and the position of the marking element in the virtual surface area and extending the connecting line into the virtual three-dimensional scenario, wherein the marking element is moved on the virtual surface area such that, if the connecting line intersects the coordinates of the virtual object, the marking element can be represented in the three-dimensional scenario such that it adopts the virtual three-dimensional coordinates of the selected object with additional depth information, and wherein the virtual surface area is shaped in a circular or rounded manner, or as a hemisphere or sphere. ### Claim 12 (depends on 11) The non-transitory computer-readable medium of claim 11, which when executed on a processor performs the further step: determining a connecting line from an eye of the viewer to the marking element, wherein the determination of the connecting line occurs prior to the selection of the virtual object; wherein the object is selected by moving the marking element on the virtual surface area such that the connecting line intersects a virtual location of the virtual object in the three-dimensional virtual scenario.