# US 2024/0094851 A1 · Virtual mouse

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0094851 A1
- Document ID: US20240094851A1
- Status: Published application
- Kind: A1
- Application number: 18/520,614
- Filed: 2023-11-28
- Published: 2024-03-21
- Earliest claimed: 2016-06-08
- Assignees: Architectronics Inc.
- Applicants: Architectronics Inc.
- Inventors: Stephen H. LEWIS
- Web page: https://patentgrep.com/patent/US20240094851A1

## CPC

- G06F 3/0423: {using sweeping light beams, e.g. using rotating or vibrating mirror}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/042: by opto-electronic means
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 15/00: Three-dimensional [3D] image rendering
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A system for interacting with a screen without touching it, comprising a source of radiating energy directed into a predefined area, at least one directionally sensitive sensor that detects the radiation when it's reflected off of an object within the predefined area, and a processor that calculates position and motion information of the object and generates therefrom image information, which it sends to a screen where it is displayed.

## Claims

### Claim 1

A system for interacting with a screen without touching it, the system comprising:
a computing device comprising at least:
one or more processors;
one or more memories; and
one or more computer-readable hardware storage devices;
a display screen comprising at least a partial video feed strip;
a source of radiating energy directed into a predefined area;
at least one directionally sensitive sensor that is configured to:
detect at least a portion of the radiating energy reflected off of an object disposed in the predefined area;
detect a range to the object disposed in the predefined area;
detect a motion of the object disposed in the predefined area;
transmit, to the one or more processors, information of a location from which the radiating energy is reflected; and
transmit visual feedback of the motion of the object to the partial video feed strip;
the one or more processors being configured to:
utilize the information of the location to calculate a position and motion of the object from which the radiating energy was reflected;
generate image information based on the calculated position and motion; and
transmit the image information to the display screen; and
the display screen being configured to display an image based on the image information received from the one or more processors.

### Claim 2 (depends on 1)

The system of claim 1, wherein the visual feedback is real-time visual feedback.

### Claim 3 (depends on 1)

The system of claim 1,
wherein the image is a rendering in three dimensions (3D) of the object that moves based on the motion of the object, and
wherein a movement of the 3D object includes a rotation of the object.

### Claim 4 (depends on 1)

The system of claim 1, wherein the radiating energy is infrared electromagnetic energy.

### Claim 5 (depends on 1)

The system of claim 1, wherein the radiating energy is laser energy configured to define a plane and cause a prominent dot to appear on the object where the object crosses the plane.

### Claim 6 (depends on 5)

The system of claim 5, wherein the at least one directionally sensitive sensor is a camera configured detect a direction to the dot and a motion of the dot.

### Claim 7 (depends on 5)

The system of claim 5, further comprising:
a plurality of laser beam splitting mirrors configured to define the plane based on static reflections of the split laser beam.

### Claim 8 (depends on 5)

The system of claim 5, further comprising:
a motor that causes a source of laser light to sweep through an angle to define the plane; and
a mirror coupled to the motor, wherein the plane is defined by a laser beam reflecting off of the mirror as the source of laser light.

### Claim 9 (depends on 5)

The system of claim 5, wherein the one or more computer-readable hardware storage devices contain program code executable by the one or more processors via the one or more memories to, based on information of the direction to the dot and the motion of the dot from at least two vantage points, calculate coordinates in the plane based on the direction and motion information and generate the image information based on the calculated coordinates.

### Claim 10 (depends on 9)

The system of claim 9,
wherein the image displayed on the screen based on the image information is a cursor that tracks the position and motion of the dot on the object to realize a virtual mouse, and
wherein the object on which the dot appears is a finger of a user, and a rapid movement of the finger causes a virtual mouse click.

### Claim 11 (depends on 1)

The system of claim 1, wherein the partial video feed strip comprises one or more boxes that delineate one or more menu items controllable by a user.

### Claim 12 (depends on 11)

The system of claim 11, wherein content is linked hierarchically in real-time from a database query.

### Claim 13 (depends on 1)

The system of claim 1, further comprising:
a frame; and
a clamp coupled to the frame for removably coupling the frame to a screen of the computing device, wherein the computing device comprises an open laptop, and wherein the at least one directionally sensitive sensor comprises a webcam.

### Claim 14 (depends on 13)

The system of claim 13, further comprising:
a first mirror attached to the frame near a first end of the frame and disposed in the frame at a position and an angle that, when the frame is coupled to a screen of the laptop, places the first mirror near a first corner of a top of the screen of the laptop at an angle that reflects an image of a plane in a front of a center of the screen of the laptop that covers at least a first portion of the screen of the laptop from a first vantage point;
a second mirror attached to the frame near a second end of the frame and disposed in the frame at the position and the angle that, when the frame is coupled to the screen of the laptop, places the second mirror near a second corner at the top of the screen of the laptop at the angle that reflects the image of the plane in the front of the screen of the laptop that covers at least a second portion of the screen of the laptop from a second vantage point,
wherein the first vantage point differs from the second vantage point, and
wherein the at least the second portion of the screen of the laptop overlaps the at least the first portion of the screen of the laptop in a front of a center of the screen of the laptop; and
a third mirror attached to the frame at a location that positions the third mirror in the front of the webcam at an angle that deflects a view of the webcam downward.

### Claim 15 (depends on 14)

The system of claim 14, further comprising:
a view splitter attached to the frame at a location that positions the view splitter below the third mirror and the webcam,
wherein the view splitter is configured to split the view of the webcam to include views of the first mirror and the second mirror, and
wherein the webcam receives images that comprise the plane in front of the screen of the laptop from two different vantage points and conveys information associated with the images to the one or more processors.

### Claim 16 (depends on 15)

The system of claim 15, wherein the one or more processors are configured to:
process the images to detect a position and a movement of an object within the plane in front of the screen;
from the detected position and movement, calculate corresponding x and y coordinates of the detected position and movements;
generate cursor image information corresponding to the calculated coordinates; and
cause the generated cursor image to display on the screen and track the motion of the object in the plane in the front of the laptop screen to realize a virtual mouse.

### Claim 17 (depends on 13)

The system of claim 13, further comprising:
a laser coupled to the frame at a location that does not interfere with the views reflected to the webcam.

### Claim 18 (depends on 17)

The system of claim 17, further comprising:
a plurality of laser beam splitting mirrors affixed to the frame and configured to define the plane based on static reflections of the split laser beam.

### Claim 19 (depends on 17)

The system of claim 17, further comprising:
a motor attached to the frame that causes a source of laser light to sweep through an angle to define the plane; and
a mirror coupled to the motor, wherein the plane is defined by a laser beam reflecting off of the mirror as the source of laser light.

### Claim 20 (depends on 1)

The system of claim 1,
wherein the radiation is em radiation,
wherein the at least one directionally sensitive sensor comprises a camera, and
wherein the system is configured to sense the location and the movement of the object through a pane of glass.
