# US 12,111,970 B2 · Information processing device and non-transitory computer readable medium for controlling floating images and detecting gestures > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,111,970 B2 - Document ID: US12111970B2 - Status: Granted - Kind: B2 - Application number: 16/891,250 - Filed: 2020-06-03 - Published: 2021-07-01 - Granted: 2024-10-08 - Earliest claimed: 2019-12-25 - Assignees: FUJIFILM Business Innovation Corp. - Applicants: Fujifilm Business Innovation Corp. - Inventors: Ikumi Kaede - Web page: https://patentgrep.com/patent/US12111970B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G02B 30/56: by projecting aerial or floating images - G03H 1/0005: {Adaptation of holography to specific applications (holographic optical element G02B5/32; holographic scanner G02B26/106; recognition using holographic mask G06V10/88; holographic memories G11B7/0065, G11C13/042)} - G03H 2001/0061: {in haptic applications when the observer interacts with the holobject} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G03H: HOLOGRAPHIC PROCESSES OR APPARATUS (holograms, e.g. point holograms, used as ordinary optical elements G02B5/32; producing stereoscopic or other three-dimensional effects G02B30/00; diffraction-grating systems G02B27/44; systems using moiré fringes G02B27/60; optical logic elements G02F3/00; stereo-photography G03B35/00; photosensitive materials or processes for photographic purposes G03C; {stereo-photographic or similar processes G03C9/00}; apparatus for processing exposed photographic materials G03D; analogue computers performing mathematical operations with the aid of optical elements G06E3/00; authentication by radiation, of concealed information carried by holograms or diffraction gratings G06K19/16; holographic storage G11B7/0065, G11C13/04; {stereoscopic or other three dimensional effects in television systems H04N13/00}) ## Abstract An information processing device includes a processor configured to perform a first process in response to detection of a first movement of a tangible object in a real world, the first movement comprising a first pass-through of a first region from a first space to a second space, the first region corresponding to a first image presented in midair to a user, the first space being a space on one side of the first region, the second space being a space on an opposite side of the first region, and perform a second process in response to detection of a second movement of the object, the second movement comprising an entrance to the first region from the first space but not comprising an exit to the second space from the first region. ## Claims ### Claim 1 An information processing device comprising: a processor configured to perform a first process in response to detection of a first movement of a tangible object in a real world, the first movement comprising a first pass-through of a first region from a first space to a second space, the first region corresponding to a first image presented in midair to a user, the first region having a predetermined depth in a direction perpendicular to the first image, the first space being a space on one side of the first region, the second space being a space on an opposite side of the first region, and perform a second process in response to detection of a second movement of the object, the second movement comprising an entrance to the first region from the first space but not comprising an exit to the second space from the first region, the second process being different from the first process, wherein the second process is a process that presents a second image in midair in the first space. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the first process is a process that presents a second image in midair in the second space. ### Claim 3 (depends on 2) The information processing device according to claim 2, wherein the processor is configured to perform a third process in response to selection of the second image by the user. ### Claim 4 (depends on 1) The information processing device according to claim 1, wherein the first movement further comprises a second pass-through of the first region from the second space to the first space, and the first process varies depending on a sub-region of the first region that the object passes through at the second pass-through. ### Claim 5 (depends on 1) The information processing device according to claim 1, wherein the first movement further comprises a second pass-through of the first region from the second space to the first space, and the first process varies depending on a combination of a first sub-region of a plurality of sub-regions that the object passes through at the first pass-through and a second sub-region of the plurality of sub-regions that the object passes through at the second pass-through. ### Claim 6 (depends on 1) The information processing device according to claim 1, wherein the processor is configured to instruct a stimulator to provide a stimulus to the object in response to the first pass-through of the object. ### Claim 7 (depends on 1) The information processing device according to claim 1, wherein the processor is configured to assign a specific function to the first region according to a selection by a user. ### Claim 8 An information processing device comprising: a processor configured to perform a first process in response to a first movement of a tangible object in a real world, the first movement comprising a pass-through of a first region from a first space to a second space and a pass-through of a second region, the first region corresponding to a first portion of a three-dimensional image presented in midair to a user, the first region having a predetermined depth in a direction perpendicular to the three-dimensional image, the first space being a space on one side of the first region, the second space being a space on an opposite side of the first region, the second region corresponding to a second portion of the three-dimensional image, the first process being determined by content corresponding to the first region and content corresponding to the second region, present a second image in midair in the second space in response to the object being detected at a predetermined position in the first region, and perform a second process in response to detection of the pass-through of the second region with the second image being selected, the second process being determined by content corresponding to the first region, content corresponding to the second region, and content corresponding to the second image, the second process being different from the first process. ### Claim 9 (depends on 8) The information processing device according to claim 8, wherein the second region includes a plurality of sub-regions, and the first process is determined by content corresponding to the first region and content corresponding to a sub-region of the second region that the object passes through at the pass-through of the second region. ### Claim 10 (depends on 9) The information processing device according to claim 9, wherein the first region corresponds to a function, and the plurality of sub-regions of the second region correspond to different settings of the function. ### Claim 11 (depends on 8) The information processing device according to claim 8, wherein the first region includes a plurality of sub-regions, and the first process is determined by content corresponding to a sub-region of the first region that the object passes through at the pass-through of the first region, and content corresponding to the second region. ### Claim 12 (depends on 8) The information processing device according to claim 8, wherein the first region and the second region each include a plurality of sub-regions, and the first process is determined by content corresponding to a sub-region of the first region that the object passes through at the pass-through of the first region in a part of the first region and content corresponding to a sub-region of the second region that the object passes through at the pass-through of the second region. ### Claim 13 (depends on 8) The information processing device according to claim 8, wherein the first three-dimensional image is a polyhedron with a first face and a second face, and the first portion is the first face and the second portion is the second face. ### Claim 14 (depends on 8) The information processing device according to claim 8, wherein the processor is configured to change an appearance of the three-dimensional image as the object passes through the first region. ### Claim 15 (depends on 8) The information processing device according to claim 8, wherein the processor is configured to change an appearance of the three-dimensional image as the object passes through the second region. ### Claim 16 A non-transitory computer readable medium storing a program causing a computer to execute a process for processing information, the process comprising: performing a first process in response to detection of a first movement of a tangible object in a real world, the first movement comprising a first pass-through of a first region from a first space to a second space, the first region corresponding to a first image presented in midair to a user, the first region having a predetermined depth in a direction perpendicular to the first image, the first space being a space on one side of the first region, the second space being a space on an opposite side of the first region, and performing a second process in response to detection of a second movement of the object, the second movement comprising an entrance to the first region from the first space but not comprising an exit to the second space from the first region, the second process being different from the first process, wherein the second process is a process that presents a second image in midair in the first space. ### Claim 17 A non-transitory computer readable medium storing a program causing a computer to execute a process for processing information, the process comprising: performing a first process in response to detection of a first movement of a tangible object in a real world, the first movement comprising a first pass-through of a first region from a first space to a second space, the first region corresponding to a first image presented in midair to a user, the first region having a predetermined depth in a direction perpendicular to the first image, the first space being a space on one side of the first region, the second space being a space on an opposite side of the first region, and performing a second process in response to detection of a second movement of the object, the second movement comprising an entrance to the first region from the first space but not comprising an exit to the second space from the first region, the second process being different from the first process.