Single-hand, full-screen interaction on a mobile device

An apparatus for determining a pointer position for display on a mobile device display, said apparatus comprising:

• at least one processor;
• and
• a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising:
• computer readable program code that displays a target object comprising a visual icon on a mobile device display, wherein the target object is displayed at a location on the mobile device display away from a physical object used to select the target object;
• computer readable program code that detects, using a depth camera, a position of the physical object relative to the mobile device display, wherein the detecting a position comprises detecting a position of the physical object in a three-dimensional space above the mobile device display with respect to a zero point on the mobile device display that defines a three-dimensional coordinate system;
• computer readable program code that uses the detected position to determine at least a perpendicular distance of the physical object from the mobile device display;
• computer readable program code that generates and displays on the mobile device display, a simulated shadow, wherein the simulated shadow begins at the zero point on the mobile device display and extends across the mobile device display based upon the perpendicular distance of the physical object from the mobile device display, wherein the length of the simulated shadow decreases as the perpendicular distance decreases and the length of the simulated shadow increases as the perpendicular distance increases;
• computer readable program code that calculates a position for a visual pointer corresponding to a location of selection by the physical object to be displayed on the mobile device display, wherein the position of the pointer is determined using the perpendicular distance and is located at a distal end of a simulated shadow and wherein the position of the pointer is defined with respect to two of the three dimensions of the three-dimensional coordinate system and wherein the calculating a position for a pointer comprises scaling the position of the pointer proportional to the perpendicular distance and wherein the position for a pointer is calculated and displayed as being further from the zero point and as being closer to the displayed target object as the perpendicular distance increases;
• and
• computer readable program code that displays the visual pointer on the mobile device display at the calculated position, the visual pointer being a visual indicator distinct and separate from the simulated shadow.

A computer program product for determining a pointer position for display on a mobile device display, said computer program product comprising:

• a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising:
• computer readable program code that displays a target object comprising a visual icon on a mobile device display, wherein the target object is displayed at a location on the mobile device display away from a physical object used to select the target object;
• computer readable program code that detects, using a depth camera, a position of the physical object relative to the mobile device display, wherein the detecting a position comprises detecting a position of the physical object in a three-dimensional space above the mobile device display with respect to a zero point on the mobile device display that defines a three-dimensional coordinate system;
• computer readable program code that uses the detected position to determine at least a perpendicular distance of the physical object from the mobile device display;
• computer readable program code that generates and displays on the mobile device display, a simulated shadow, wherein the simulated shadow begins at the zero point on the mobile device display and extends across the mobile device display based upon the perpendicular distance of the physical object from the mobile device display, wherein the length of the simulated shadow decreases as the perpendicular distance decreases and the length of the simulated shadow increases as the perpendicular distance increases;
• computer readable program code that calculates a position for a visual pointer corresponding to a location of selection by the physical object to be displayed on the mobile device display, wherein the position of the pointer is determined using the perpendicular distance and is located at a distal end of a simulated shadow and wherein the position of the pointer is defined with respect to two of the three dimensions of the three-dimensional coordinate system and wherein the calculating a position for a pointer comprises scaling the position of the pointer proportional to the perpendicular distance and wherein the position for a pointer is calculated and displayed as being further from the zero point and as being closer to the displayed target object as the perpendicular distance increases;
• and
• computer readable program code that displays the visual pointer on the mobile device display at the calculated position, the visual pointer being a visual indicator distinct and separate from the simulated shadow.

A method comprising:

• displaying a target object comprising a visual icon on a mobile device display, wherein the target object is displayed at a location on the mobile device display away from a human thumb used to select the target object;
• detecting, using a depth camera, a position of the human thumb relative to a mobile device display screen, wherein the detecting a position comprises detecting a position of the human thumb in a three-dimensional space above the mobile device display with respect to a zero point on the mobile device display that defines a three-dimensional coordinate system;
• using the detected position to determine at least a perpendicular distance of a portion of the human thumb relative to the mobile device display screen;
• generating and displaying on the mobile device display, a simulated shadow, wherein the simulated shadow begins at the zero point on the mobile device display and extends across the mobile device display based upon the perpendicular distance of the human thumb from the mobile device display, wherein the length of the simulated shadow decreases as the perpendicular distance decreases and the length of the simulated shadow increases as the perpendicular distance increases;
• calculating a position for a visual pointer corresponding to a location of selection by the human thumb to be displayed on the mobile device display screen, via transforming the perpendicular distance to a position for the pointer and wherein the position of the pointer is defined with respect to two of the three dimensions of the three-dimensional coordinate system, wherein the calculating a position for a pointer comprises scaling the position of the pointer proportional to the perpendicular distance;
• wherein said transforming comprises determining a distal end of the simulated shadow, given a simulated incident light angle and wherein the position for a pointer is calculated and displayed as being further from the position of the zero point and as being closer to the displayed target object as the perpendicular distance increases;
• and
• displaying the visual pointer on the mobile device display screen at the calculated position, the visual pointer being a visual indicator distinct and separate from the simulated shadow.