# US 12,602,126 B2 · Information processing apparatus, non-transitory computer readable medium, and information processing method for non-contact gesture-based selection > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,602,126 B2 - Document ID: US12602126B2 - Status: Granted - Kind: B2 - Application number: 18/187,793 - Filed: 2023-03-22 - Published: 2024-02-29 - Granted: 2026-04-14 - Earliest claimed: 2022-08-29 - Assignees: FUJIFILM Business Innovation Corp. - Applicants: FUJIFILM Business Innovation Corp. - Inventors: Shunsuke Kiryu - Web page: https://patentgrep.com/patent/US12602126B2 ## CPC - G06F 3/0416: {Control or interface arrangements specially adapted for digitisers} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 2203/04101: 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An information processing apparatus includes: a processor configured to: acquire a three-dimensional coordinate at which an operation object is detected, the operation object being in an operation space where operation for contactlessly selecting a displayed object is performed; and in response to detecting moving of the three-dimensional coordinate of the detected operation object, the three-dimensional coordinate being moved by a predetermined threshold distance or longer from a predetermined reference position in a depth direction, regard the moving as operation for selecting the object and execute a process for the operation. ## Claims ### Claim 1 An information processing apparatus comprising: a processor configured to: acquire a three-dimensional coordinate at which an operation object is detected, the operation object being in an operation space where operation for contactlessly selecting a displayed object is performed; in response to detecting moving of the three-dimensional coordinate of the detected operation object, the three-dimensional coordinate being moved by a predetermined threshold distance or longer from a predetermined reference position in a depth direction, regard the moving as operation for selecting the object and execute a process for the operation; and set, as the reference position from which the predetermined threshold distance is measured, depth from the operation object at a time point when the operation object is detected after a state where the operation object is not detected. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to: set, as a next reference position, depth from the operation object at a time point of moving between levels of the object after the operation for selecting the object. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to: zoom in or out the selected object centered at a selected position or at the selected object in accordance with a change in the depth direction of the operation object. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to: in response to moving the operation object while a detection function of detecting the operation object is being disabled and then in response to the detection function being enabled again, set, as a new reference position, a position of the operation object after the moving. ### Claim 5 (depends on 4) The information processing apparatus according to claim 4, wherein the processor is configured to: in response to detecting a hover operation kept at a predetermined detection limit for a predetermined time or longer, the hover operation corresponding to keeping the operation object hovering for a predetermined time, or in response to detecting the moving of the operation object at the detection limit, disable the detection function for a predetermined time. ### Claim 6 (depends on 4) The information processing apparatus according to claim 4, wherein the processor is configured to: in response to the operation object reaching a predetermined detection limit, disable the detection function for a predetermined time. ### Claim 7 (depends on 4) The information processing apparatus according to claim 4, wherein the processor is configured to: in response to detecting a different operation object in a predetermined area, disable the detection function. ### Claim 8 (depends on 4) The information processing apparatus according to claim 4, wherein the processor is configured to: in response to detecting a predetermined gesture, disable the detection function for a predetermined time. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein the processor is configured to: in response to a predetermined operation for moving the operation object to a certain position, change the reference position. ### Claim 10 (depends on 9) The information processing apparatus according to claim 9, wherein the processor is configured to: in response to changing depth from the operation object to move the operation object upward at a predetermined moving speed, the changing serving as the predetermined operation, change the reference position. ### Claim 11 (depends on 10) The information processing apparatus according to claim 10, wherein the processor is configured to: in response to completing operation for changing depth from the operation object to move the operation object upward after detecting the changing, the completing serving as the predetermined operation, change the reference position. ### Claim 12 (depends on 9) The information processing apparatus according to claim 9, wherein the processor is configured to: in response to moving the operation object to outside of a detection range to prevent depth from the operation object from being changed, the moving serving as the predetermined operation, change the reference position. ### Claim 13 A non-transitory computer readable medium storing a program causing a computer to execute a process for information processing, the process comprising: acquiring a three-dimensional coordinate at which an operation object is detected, the operation object being in an operation space where operation for contactlessly selecting a displayed object is performed; in response to detecting moving of the three-dimensional coordinate of the detected operation object, the three-dimensional coordinate being moved by a predetermined threshold distance or longer from a predetermined reference position in a depth direction, regarding the moving as operation for selecting the object and executing a process for the operation; and setting, as the reference position from which the predetermined threshold distance is measured, depth from the operation object at a time point when the operation object is detected after a state where the operation object is not detected. ### Claim 14 An information processing method comprising: acquiring a three-dimensional coordinate at which an operation object in an operation space where operation for selecting a displayed object contactlessly is performed is detected; in response to detecting moving of the three-dimensional coordinate of the detected operation object, the three-dimensional coordinate being moved by a predetermined threshold distance or longer from a predetermined reference position in a depth direction, regarding the moving as operation for selecting the object and executing a process for the operation; and setting, as the reference position from which the predetermined threshold distance is measured, depth from the operation object at a time point when the operation object is detected after a state where the operation object is not detected.