# US 2014/0152603 A1 · Remote Sensing Touchscreen > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2014/0152603 A1 - Document ID: US20140152603A1 - Status: Published application - Kind: A1 - Application number: 14/149,807 - Filed: 2014-01-08 - Published: 2014-06-05 - Earliest claimed: 2009-10-06 - Assignees: Cherif Atia Algreatly - Inventors: Cherif Atia Algreatly - Web page: https://patentgrep.com/patent/US20140152603A1 ## CPC - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04142: {the force sensing means being located peripherally, e.g. disposed at the corners or at the side of a touch sensing plate} - G06F 2203/0331: Finger worn pointing device - G06F 2203/04104: Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A remote sensing system for touchscreen is disclosed. The system is comprised of a surface and a pointer. The surface detects the point of a force exerted on the surface and the three-dimensional direction of the force. The pointer remotely exerts a force on the surface. The point of exerting the force on the surface, the 3D direction of the pointer, and the location of the pointer relative to the surface are then determined. The present invention is utilized in various 3D gaming, entertainment, engineering, and medical applications. ## Claims ### Claim 1 A remote sensing system comprised of; a surface which is a transparent flat sheet that can be positioned on a computer display; a pointer that can be positioned at a distance from the surface to blow air in a three-dimensional direction towards a spot on the surface and exert a force on the spot; a sensing unit that detects the location of the spot, the three-dimensional direction, and the value of the force; and a microprocessor that receives the data of the location, the three-dimensional direction, and the value to determine the distance and provide the computer system with an immediate input representing the location, the three-dimensional direction and the distance. ### Claim 2 (depends on 1) The system of claim 1 wherein the pointer blows the air through an opening located at one end of the pointer. ### Claim 3 (depends on 1) The system of claim 1 wherein the surface is a panel that has a front side, back side and four edges, and the sensing unit is comprised of; a first plurality of sensors located on the back side; and a second plurality of sensors located at the four edges. ### Claim 4 (depends on 1) The system of claim 1 wherein the surface is made from a fixable material and the sensing unit is tracking cameras that track the shape of the bending of the surface due to the force. ### Claim 5 (depends on 1) The system of claim 1 wherein the distance is determined by comparing the force exerted on the surface with a database that associates each value of a force with a corresponding distance. ### Claim 6 (depends on 1) The system of claim 1 wherein the speed of the air can be controlled by the pointer to change the value of the force exerted on the surface. ### Claim 7 (depends on 1) The system of claim 1 further an additional opening is located on the pointer to simultaneously blow air with the opening to provide an indication representing the rotation of the pointer about the pointer axial. ### Claim 8 (depends on 1) The system of claim 1 wherein the pointer is more than one pointer each of which blows air in different speed to provide an indication representing the identity of each pointer. ### Claim 9 (depends on 1) The system of claim 1 wherein the pointer is attached to a finger ring worn by one finger of a hand. ### Claim 10 (depends on 1) The system of claim 1 further the pointer is equipped with a light source to generate a light beam extending from the opening to the surface wherein the extension of the light beam through a 3D virtual environment presented on the computer display is depicted by a virtual ray. ### Claim 11 (depends on 1) The system of claim 1 wherein the three-dimensional direction represents a corresponding direction in three-dimensional on the computer display and the distance represents a corresponding distance in three-dimensional on the computer display, and the location of the spot represents a corresponding a spot in three-dimensional on the computer display. ### Claim 12 a remote sensing system comprised of; a surface which is a transparent flat sheet that can be positioned on a computer display; a pointer that can be positioned at a distance from the surface to blow air towards a spot on the surface and exert a force on the spot; and a sensing unit that detects the location of the spot and provides the computer system with an immediate input representing the location. ### Claim 13 (depends on 12) The system of claim 12 wherein the pointer blows the air through an opening located at one end of the pointer. ### Claim 14 (depends on 12) The system of claim 12 wherein the surface is a panel that has a front side, back side, and four edges, and the sensing unit is a first plurality of sensors located on the back side. ### Claim 15 (depends on 12) The system of claim 12 wherein the surface is made from a fixable material and the sensing unit is tracking cameras that track the shape of the bending of the surface due to the force. ### Claim 16 (depends on 12) The system of claim 12 wherein the location represents a position in two-dimensions on the computer display. ### Claim 17 A method for detecting the three-dimensional direction and the distance of a pointer relative to a surface, and the location on the surface that faces the three-dimensional direction, wherein the method comprising; detecting a first force perpendicular to the surface plane, and a second force parallel to the surface plane to generate a signal representing the values of the first force and the second force; aligning the pointer to a three-dimensional direction to blow air that exerts a force aligned with the three-dimensional direction on a location on the surface; and determining the three-dimensional direction and the distance of the pointer, and the location on the surface.