# US 2013/0159935 A1 · Gesture inputs for navigating in a 3d scene via a gui > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0159935 A1 - Document ID: US20130159935A1 - Status: Published application - Kind: A1 - Application number: 13/329,030 - Filed: 2011-12-16 - Published: 2013-06-20 - Earliest claimed: 2011-12-16 - Inventors: Garrick EVANS; Yoshihito KOGA; Michael BEALE - Web page: https://patentgrep.com/patent/US20130159935A1 ## CPC - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Techniques for manipulating a three-dimensional scene displayed via a multi-touch display include receiving information associated with an end-user touching a multi-touch display at one or more screen locations, determining a hand movement based on the information associated with the end-user touching the multi-touch display, determining a command associated with the hand movement, and causing the three-dimensional to be manipulated based on the command and the one or more screen locations. The disclosed techniques advantageously provide more intuitive and user-friendly approaches for interacting with a 3D scene displayed on a computing device that includes a multi-touch display. ## Claims ### Claim 1 A method for manipulating a three-dimensional scene displayed via a multi-touch display, the method comprising: receiving information associated with an end-user touching a multi-touch display at one or more screen locations; determining a hand movement based on the information associated with the end-user touching the multi-touch display; determining a command associated with the hand movement; and causing the three-dimensional to be manipulated based on the command and the one or more screen locations. ### Claim 2 (depends on 1) The method of claim 1, wherein: the hand movement comprises a touch at a first screen location; the command is determined to be a magnify and select command based on the hand movement being a touch at the first screen location; and causing comprises magnifying a subassembly associated with the three-dimensional scene, wherein the subassembly is selected from an object model hierarchy generated based on the first screen location. ### Claim 3 (depends on 2) The method of claim 2, wherein causing further comprises generating an exploded view of the subassembly and enabling the end-user to select an object associated with the subassembly via a touch event associated with the object. ### Claim 4 (depends on 2) The method of claim 2, wherein causing further comprises generating a secondary view of the subassembly and enabling the end-user to select an object associated with the subassembly via a touch event associated with the secondary view. ### Claim 5 (depends on 4) The method of claim 4, wherein the secondary view comprises a node tree representation of the subassembly or a flattened representation of the subassembly. ### Claim 6 (depends on 1) The method of claim 1, wherein: the three-dimensional scene includes an object having an interior; the hand movement includes a touch at a first screen location, a touch at a second screen location, and a touch at an intermediate screen location that is substantially between the first screen location and the second location and is associated with the object having the interior; the command is determined to be a slice-through command associated with the object having the interior. ### Claim 7 (depends on 6) The method of claim 6, wherein causing the three-dimensional scene to be manipulated comprises slicing the object having the interior with a slicing plan associated with the intermediate screen location. ### Claim 8 (depends on 7) The method of claim 7, wherein the slicing plane is cut perpendicularly into the three-dimensional scene at the intermediate screen location. ### Claim 9 (depends on 1) The method of claim 1, wherein the hand movement comprises a first touch-and-drag movement across the multi-touch display and along a surface of the three-dimensional scene and a second touch-and-drag movement across the multi-touch display and along the surface of the three-dimensional scene, and wherein the first touch-and-drag movement is substantially parallel to the second touch-and-drag movement. ### Claim 10 (depends on 9) The method of claim 9, wherein the command associated with the hand movement is determined to be a walk command in a direction of the first touch-and-drag movement and the second touch-and-drag movement. ### Claim 11 A non-transitory computer-readable medium storing instructions that, when executed by a processing unit, cause the processing unit to manipulate a three-dimensional scene displayed via a multi-touch display, by performing the steps of: receiving information associated with an end-user touching a multi-touch display at one or more screen locations; determining a hand movement based on the information associated with the end-user touching the multi-touch display; determining a command associated with the hand movement; and causing the three-dimensional to be manipulated based on the command and the one or more screen locations. ### Claim 12 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein: the hand movement comprises a touch at a first screen location; the command is determined to be a magnify and select command based on the hand movement being a touch at the first screen location; and causing comprises magnifying a subassembly associated with the three-dimensional scene, wherein the subassembly is selected from an object model hierarchy generated based on the first screen location. ### Claim 13 (depends on 12) The non-transitory computer-readable medium of claim 12, wherein causing further comprises generating an exploded view of the subassembly and enabling the end-user to select an object associated with the subassembly via a touch event associated with the object. ### Claim 14 (depends on 12) The non-transitory computer-readable medium of claim 12, wherein causing further comprises generating a secondary view of the subassembly and enabling the end-user to select an object associated with the subassembly via a touch event associated with the secondary view. ### Claim 15 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the secondary view comprises a node tree representation of the subassembly or a flattened representation of the subassembly. ### Claim 16 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein: the three-dimensional scene includes an object having an interior; the hand movement includes a touch at a first screen location, a touch at a second screen location, and a touch at an intermediate screen location that is substantially between the first screen location and the second location and is associated with the object having the interior; the command is determined to be a slice-through command associated with the object having the interior. ### Claim 17 (depends on 16) The non-transitory computer-readable medium of claim 16, wherein causing the three-dimensional scene to be manipulated comprises slicing the object having the interior with a slicing plan associated with the intermediate screen location. ### Claim 18 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the slicing plane is cut perpendicularly into the three-dimensional scene at the intermediate screen location ### Claim 19 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the hand movement comprises a first touch-and-drag movement across the multi-touch display and along a surface of the three-dimensional scene and a second touch-and-drag movement across the multi-touch display and along the surface of the three-dimensional scene, and wherein the first touch-and-drag movement is substantially parallel to the second touch-and-drag movement. ### Claim 20 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the command associated with the hand movement is determined to be a walk command in a direction of the first touch-and-drag movement and the second touch-and-drag movement. ### Claim 21 A computing device, comprising: a multi-touch display configured to display a three-dimensional scene; and a processing unit configured to: receive information associated with an end-user touching a multi-touch display at one or more screen locations, determine a hand movement based on the information associated with the end-user touching the multi-touch display, determine a command associated with the hand movement, and cause the three-dimensional to be manipulated based on the command and the one or more screen locations. ### Claim 22 (depends on 21) The system of claim 21, further comprising a memory that includes instructions that, when executed by the processing unit, cause the processing unit to receive the information, determine the hand movement, determine the command, and cause the three-dimensional scene to be manipulated.