# US 12,118,155 B2 · Information processing device and information processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,155 B2 - Document ID: US12118155B2 - Status: Granted - Kind: B2 - Application number: 18/459,085 - Filed: 2023-08-31 - Published: 2024-03-07 - Granted: 2024-10-15 - Earliest claimed: 2022-09-02 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Hiroaki Kamijo - Web page: https://patentgrep.com/patent/US12118155B2 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/0354: with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks - G06F 3/012: {Head tracking input arrangements} - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/03547: {Touch pads, in which fingers can move on a surface} - G06F 3/0383: {Signal control means within the pointing device} - G06F 2203/0331: Finger worn pointing device - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing device includes at least one memory and at least one processor which function as: an acquisition unit configured to acquire operation information of a two-dimensional operation performed on a controller; and a control unit configured to control an object displayed on a display device based on the operation information and a correspondence relationship between an operation coordinate system for determining an operation direction of the two-dimensional operation performed on the controller and a display coordinate system for determining a display position of the display device. ## Claims ### Claim 1 An information processing device comprising at least one memory and at least one processor which function as: an acquisition unit configured to acquire operation information of a two-dimensional operation performed on a controller; and a control unit configured to control an object displayed on a display device based on the operation information and a correspondence relationship between an operation coordinate system for determining an operation direction of the two-dimensional operation performed on the controller and a display coordinate system for determining a display position of the display device. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the controller has an operation member capable of receiving a planar movement operation, and the operation information is information on the two-dimensional operation performed on the operation member. ### Claim 3 (depends on 1) The information processing device according to claim 1, wherein the control unit corrects the operation information based on the correspondence relationship between the operation coordinate system and the display coordinate system, and the control unit controls the object based on the corrected operation information. ### Claim 4 (depends on 1) The information processing device according to claim 1, wherein the correspondence relationship between the operation coordinate system and the display coordinate system is a relationship indicated by a difference between an orientation of the operation coordinate system and an orientation of the display coordinate system. ### Claim 5 (depends on 4) The information processing device according to claim 4, wherein the control unit determines the difference between the orientation of the operation coordinate system and the orientation of the display coordinate system according to a difference between an orientation of the controller in a reference coordinate system and an orientation of the display device in the reference coordinate system. ### Claim 6 (depends on 5) The information processing device according to claim 5, wherein the reference coordinate system is a coordinate system according to a measured value measured by a geomagnetic sensor. ### Claim 7 (depends on 5) The information processing device according to claim 5, wherein the reference coordinate system is a coordinate system according to a measured value of an inertial measurement device. ### Claim 8 (depends on 4) The information processing device according to claim 4, wherein the control unit determines the difference between the orientation of the operation coordinate system and the orientation of the display coordinate system according to 1) a difference between an orientation of a reference coordinate system and the orientation of the operation coordinate system and 2) a difference between the orientation of the reference coordinate system and the orientation of the display coordinate system. ### Claim 9 (depends on 1) The information processing device according to claim 1, wherein the control unit controls the object by moving the object. ### Claim 10 An information processing device comprising at least one memory and at least one processor which function as: an acquisition unit configured to acquire operation information of a two-dimensional operation performed on a controller; and a control unit configured to control an object displayed on a display device based on the operation information and a difference between movement information of the controller from a reference state of the controller and movement information of the display device from a reference state of the display device. ### Claim 11 (depends on 10) The information processing device according to claim 10, wherein the controller has an operation member capable of receiving a planar movement operation, and the operation information is information on the two-dimensional operation performed on the operation member. ### Claim 12 An information processing method comprising: an acquisition step of acquiring operation information of a two-dimensional operation performed on a controller; and a control step of controlling an object displayed on a display device based on the operation information and a correspondence relationship between an operation coordinate system for determining an operation direction of the two-dimensional operation performed on the controller and a display coordinate system for determining a display position of the display device. ### Claim 13 (depends on 12) A non-transitory computer readable medium that stores a program, wherein the program causes a computer to perform operations included in the information processing method according to claim 12. ### Claim 14 An information processing method comprising: an acquisition step of acquiring operation information of a two-dimensional operation performed on a controller; and a control step of controlling an object displayed on a display device based on the operation information and a difference between movement information of the controller from a reference state of the controller and movement information of the display device from a reference state of the display device. ### Claim 15 (depends on 14) A non-transitory computer readable medium that stores a program, wherein the program causes a computer to perform operations included in the information processing method according to claim 14.