# US 10,768,716 B2 · Virtual reality input including maintaining a current mapping of the input from an input device to an input plane within the 3D space

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,768,716 B2
- Document ID: US10768716B2
- Status: Granted
- Kind: B2
- Application number: 16/075,610
- Filed: 2016-10-21
- Published: 2019-02-07
- Granted: 2020-09-08
- Earliest claimed: 2016-10-21
- Assignees: Hewlett-Packard Development Company, L.P.
- Applicants: Hewlett-Packard Development Company, L.P.
- Inventors: Ian N. Robinson; Hiroshi Horii
- Web page: https://patentgrep.com/patent/US10768716B2

## CPC

- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/03545: {Pens or stylus}
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An input system may include a stylus, a positionable output device, a tablet to receive input via interaction with the stylus, and a three-dimensional (3D) workspace represented on a graphical user interface (GUI) of the positionable output device communicatively coupled to the tablet. Two-dimensional (2D) input on the tablet translates to a 3D input on the 3D workspace based on the orientation of an input plane represented in the 3D workspace. Interfacing the stylus with the tablet freezes a view of a tablet-to-input mapping displayed on the positionable output device.

## Claims

### Claim 1

An input system, comprising:
a stylus;
a positionable output device;
a tablet to receive input via interaction with the stylus; and
a three-dimensional (3D) workspace represented on a graphical user interface (GUI) of the positionable output device communicatively coupled to the tablet;
wherein two-dimensional (2D) input on the tablet translates to a 3D input on the 3D workspace based on the orientation of an input plane represented in the 3D workspace; and
wherein interface of the stylus with the tablet freezes a view of a tablet-to-input mapping displayed on the positionable output device;
wherein the input plane is adjustable with reference to a consistent point of reference within the 3D workspace;
wherein the input plane fits within a tablet frustum defined within a view frustum within the 3D workspace.

### Claim 2 (depends on 1)

The input system of claim 1, wherein boundaries of the input plane extend between the tablet frustum and the view frustum.

### Claim 3

A computer program product for applying a two-dimensional (2D) input into a three-dimensional (3D) space, the computer program product comprising:
a non-transitory computer readable storage medium comprising computer usable program code embodied therewith, the computer usable program code to, when executed by a processor:
receive input from a first input device at a processor indicating a change in position of an input plane within the 3D space represented on an output device;
receive input from a second input device having a 2D surface at the processor indicating a line to be drawn in the 3D space;
represent the received input from the second input device as a 3D image within the 3D space displayed on the output device; and
maintain a current mapping of the input from the second input device to the input plane within the 3D space when a stylus interacts with the second input device and as the output device is moved;
wherein the input plane fits within a tablet frustum of the second input device that is defined within a view frustum within the 3D workspace.

### Claim 4 (depends on 3)

The computer program product of claim 3, further comprising computer usable program code to, when executed by a processor, receive instructions to map.

### Claim 5 (depends on 3)

The computer program product of claim 3, further comprising computer usable program code to, when executed by a processor, prevent the input plane from aligning edge-on to a user viewpoint.