# US 10,310,623 B2 · Information processing device, information processing method, and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,310,623 B2 - Document ID: US10310623B2 - Status: Granted - Kind: B2 - Application number: 15/501,471 - Filed: 2015-08-31 - Published: 2017-08-10 - Granted: 2019-06-04 - Earliest claimed: 2014-09-02 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Yuuji Takimoto; Yusuke Sakai; Tomohiro Ishii; Atsushi Izumihara; Osamu Shigeta - Web page: https://patentgrep.com/patent/US10310623B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract There is provided an information processing device including a determination unit configured to perform determination of execution or non-execution of a manipulation based on a pause of a manipulation position specified through a manipulation of pointing to a display plane using a manipulating body at a position apart from the display plane, and a control unit configured to issue a command corresponding to the manipulation when the determination unit determines execution of the manipulation. ## Claims ### Claim 1 An information processing apparatus comprising: circuitry configured to execute a process related to displayed content located inside of a boundary of a display region, based on a detection result of detecting that a pointing position remains substantially stationary in relation to the displayed content for a predetermined duration of time, wherein the pointing position is determined based on a location of a target whose position is indicated by a trajectory of a pointing operation made by a user for manipulation of a display object that is displayed inside of the boundary of the display region, and wherein the predetermined duration of time is changed based on a positional relation between a location of the pointing position and a location of the display object. ### Claim 2 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry is further configured to initiate a providing of an indicator to indicate to the user a length of time the pointing position has remained substantially stationary in relation to the displayed content. ### Claim 3 (depends on 2) The information processing apparatus of claim 2, wherein the indicator is a visual notification. ### Claim 4 (depends on 2) The information processing apparatus of claim 2, wherein the indicator is displayed at a location that corresponds to the pointing position. ### Claim 5 (depends on 4) The information processing apparatus of claim 4, wherein the indicator comprises an icon. ### Claim 6 (depends on 1) The information processing apparatus of claim 1, wherein the predetermined duration of time is changed based on overlapping or non-overlapping of the pointing position and the display object. ### Claim 7 (depends on 1) The information processing apparatus of claim 1, wherein the executed process comprises a changing of the displayed content. ### Claim 8 (depends on 1) The information processing apparatus of claim 1, wherein the executed process includes execution of an application program related to the displayed content. ### Claim 9 (depends on 1) The information processing apparatus of claim 1, wherein the pointing position is located at an intersection of the trajectory of the pointing operation and a plane that corresponds to the display region. ### Claim 10 (depends on 1) The information processing apparatus of claim 1, wherein the pointing position is located along the trajectory of the pointing operation within a plane that corresponds to the display region. ### Claim 11 (depends on 1) The information processing apparatus of claim 1, wherein the process is executed based on a detection result of detecting that a plurality of pointing positions are respectively remaining substantially stationary. ### Claim 12 (depends on 1) The information processing apparatus of claim 1, wherein the trajectory of the pointing operation corresponds to a line of sight of the user. ### Claim 13 (depends on 1) The information processing apparatus of claim 1, wherein the pointing operation is made by the user from a location that is remote from the location of the target. ### Claim 14 (depends on 1) The information processing apparatus of claim 1, wherein the pointing operation does not touch or come into proximity to the display region. ### Claim 15 (depends on 1) The information processing apparatus of claim 1, wherein the location of the pointing position changes in correspondence with a changing of the trajectory of the pointing operation. ### Claim 16 (depends on 1) The information processing apparatus of claim 1, wherein an icon is displayed at the pointing position when the pointing position is located inside of the boundary of the display region. ### Claim 17 (depends on 1) The information processing apparatus of claim 1, wherein the circuitry executes the process based further on a voice input. ### Claim 18 An information processing method comprising: detecting that a pointing position remains substantially stationary in relation to a displayed content for a predetermined duration of time; and executing, based on a detection result of the detecting, a process related to displayed content located inside of a boundary of a display region, wherein the pointing position is determined based on a location of a target whose position is indicated by a trajectory of a pointing operation made by a user for manipulation of a display object that is displayed inside of the boundary of the display region, and wherein the predetermined duration of time is changed based on a positional relation between a location of the pointing position and a location of the display object. ### Claim 19 A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute an information processing method, the method comprising: detecting that a pointing position remains substantially stationary in relation to a displayed content for a predetermined duration of time; and executing, based on a detection result of the detecting, a process related to displayed content located inside of a boundary of a display region, wherein the pointing position is determined based on a location of a target whose position is indicated by a trajectory of a pointing operation made by a user for manipulation of a display object that is displayed inside of the boundary of the display region, and wherein the predetermined duration of time is changed based on a positional relation between a location of the pointing position and a location of the display object. ### Claim 20 (depends on 6) The information processing apparatus of claim 6, wherein, when the pointing position is overlapping with the display object, the predetermined duration of time is set to a first time, and wherein, when the pointing position is non-overlapping with the display object, the predetermined duration of time is set to a second time longer than the first time.