# US 2019/0290999 A1 · Holding and Releasing Virtual Objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0290999 A1
- Document ID: US20190290999A1
- Status: Published application
- Kind: A1
- Application number: 16/389,629
- Filed: 2019-04-19
- Published: 2019-09-26
- Earliest claimed: 2016-10-11
- Assignees: Valve Corporation
- Applicants: Valve Corporation
- Inventors: Keith Bradner; Jeremy Slocum; Scott Douglas Nietfeld; Lawrence Yang; Jeffrey George Leinbaugh
- Web page: https://patentgrep.com/patent/US20190290999A1

## CPC

- A63F 13/211: using inertial sensors, e.g. accelerometers or gyroscopes
- A63F 13/218: using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
- A63F 13/428: involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
- A63F 13/44: involving timing of operations, e.g. performing an action within a time slot
- A63F 13/573: using trajectories of game objects, e.g. of a golf ball according to the point of impact
- A63F 13/212: using sensors worn by the player, e.g. for measuring heart beat or leg activity
- A63F 13/812: Ball games, e.g. soccer or baseball
- A63F 2300/646: for calculating the trajectory of an object
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques and devices for determining how to present the release of the virtual object based at least in part on received sensor data is described herein. For example, when the hardware and/or software determines that the virtual object is to be released, the hardware and/or software may calculate one or more of a velocity of the object (e.g., speed and direction), a position at which the virtual object is to be released, a trajectory of the virtual object from the position of release to the landing point of the virtual object, a landing location of the virtual object, and/or the like. The hardware and/or software may then present the virtual object being released according to this determined information.

## Claims

### Claim 1

A method comprising:
receiving, while a display presents a virtual object being held by a virtual hand, sensor data from one or more sensors of a handheld controller;
determining, at a first time and based at least in part on the sensor data, that the virtual hand is to release the virtual object;
determining, at least partly in response to determining that the virtual hand is to release the virtual object, a peak velocity of the handheld controller within a predetermined time range prior to the first time;
determining that the peak velocity within the predetermined time range occurred at a second time prior to the first time; and
presenting, on the display, the virtual hand releasing the virtual object based at least in part on at least one of a speed of the handheld controller at the second time, a direction of the handheld controller at the second time, a position of the handheld controller at the second time, or a rotational velocity of the virtual object at the second time.

### Claim 2 (depends on 1)

The method as recited in claim 1, further comprising:
determining at least one of a velocity of the handheld controller at a third time prior to the second time or a velocity of the handheld controller at a fourth time after the second time; and
calculating an average of the peak velocity and the at least one of the velocity of the handheld controller at the third time or the velocity of the handheld controller at the fourth time;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual hand releasing the virtual object based at least in part on a velocity corresponding to the average.

### Claim 3 (depends on 1)

The method as recited in claim 1, further comprising:
determining a position of the virtual object at the second time;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual hand releasing the virtual object based at least in part on the position of the virtual object at the second time.

### Claim 4 (depends on 1)

The method as recited in claim 1, further comprising:
determining, from the peak velocity, a direction of the handheld controller at the second time;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual hand releasing the virtual object based at least in part on the direction of the handheld controller at the second time.

### Claim 5 (depends on 1)

The method as recited in claim 1, further comprising:
calculating a trajectory of the virtual object using at least the peak velocity;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual hand releasing the virtual object based at least in part on the trajectory.

### Claim 6 (depends on 1)

The method as recited in claim 1, further comprising:
calculating a landing location of the virtual object using at least the peak velocity and a position of the virtual object at the second time;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual object landing at the calculated landing location.

### Claim 7 (depends on 1)

The method as recited in claim 1, further comprising:
calculating a landing location of the virtual object using at least the peak velocity and a position of the virtual object at the second time;
determining a position of the virtual object at a current time; and
calculating a trajectory from the position of the virtual object at the current time to the calculated landing location;
and wherein the presenting the virtual hand releasing the virtual object comprises presenting the virtual hand releasing the virtual object based at least in part on the calculated trajectory.

### Claim 8 (depends on 1)

The method as recited in claim 1, wherein:
the first time is associated with a first frame; and
the determining the peak velocity of the handheld controller within the predetermined time range prior to the first time comprises determining the peak velocity of the handheld controller within a predetermined amount of frames immediately prior to the first frame.

### Claim 9

One or more computer-readable media storing computer-executable instructions that, when executed, cause one or more processors to perform acts comprising:
determining, at a first time, that a virtual object presented on a display is to be released;
determining, at least partly in response to determining that the virtual object is to be released, a peak velocity of a handheld controller within a predetermined time range prior to the first time;
determining that the peak velocity within the predetermined time range occurred at a second time prior to the first time; and
presenting, on the display, the virtual object being released based at least in part on at least one of a speed of the handheld controller at the second time, a direction of the handheld controller at the second time, a position of the handheld controller at the second time, or a rotational velocity of the virtual object at the second time.

### Claim 10 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
determining at least one of a velocity of the handheld controller at a third time prior to the second time or a velocity of the handheld controller at a fourth time after the second time; and
calculating an average of the peak velocity and the at least one of the velocity of the handheld controller at the third time or the velocity of the handheld controller at the fourth time;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on a velocity corresponding to the average.

### Claim 11 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
determining a position of the virtual object at the second time;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the position of the virtual object at the second time.

### Claim 12 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
determining, from the peak velocity, a direction of the handheld controller at the second time;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the direction of the handheld controller at the second time.

### Claim 13 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
calculating a trajectory of the virtual object using at least the peak velocity;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the trajectory.

### Claim 14 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
calculating a landing location of the virtual object using at least the peak velocity and a position of the virtual object at the second time;
and wherein the presenting the virtual object being released comprises presenting the virtual object landing at the calculated landing location.

### Claim 15 (depends on 9)

The one or more computer-readable media as recited in claim 9, the acts further comprising:
calculating a landing location of the virtual object using at least the peak velocity and a position of the virtual object at the second time;
determining a position of the virtual object at a current time; and
calculating a trajectory from the position of the virtual object at the current time to the calculated landing location;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the calculated trajectory.

### Claim 16 (depends on 9)

The one or more computer-readable media as recited in claim 9, wherein:
the first time is associated with a first frame; and
the determining the peak velocity of the handheld controller within the predetermined time range prior to the first time comprises determining the peak velocity of the handheld controller within a predetermined amount of frames immediately prior to the first frame.

### Claim 17

A system comprising:
one or more processors; and
one or more computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising:
determining, at a first time, that a virtual object is to be released;
determining, at least partly in response to determining that the virtual object is to be released, a peak velocity of a handheld controller within a predetermined time range prior to the first time;
determining that the peak velocity within the predetermined time range occurred at a second time prior to the first time; and
presenting, on a display, the virtual object being released based at least in part on at least one of a speed of the handheld controller at the second time, a direction of the handheld controller at the second time, a position of the handheld controller at the second time, or a rotational velocity of the virtual object at the second time.

### Claim 18 (depends on 17)

The system as recited in claim 17, the acts further comprising:
determining at least one of a velocity of the handheld controller at a third time prior to the second time or a velocity of the handheld controller at a fourth time after the second time; and
calculating an average of the peak velocity and the at least one of the velocity of the handheld controller at the third time or the velocity of the handheld controller at the fourth time;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on a velocity corresponding to the average

### Claim 19 (depends on 17)

The system as recited in claim 17, the acts further comprising:
determining a position of the virtual object at the second time;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the position of the virtual object at the second time.

### Claim 20 (depends on 17)

The system as recited in claim 17, the acts further comprising:
calculating a trajectory of the virtual object using at least the peak velocity;
and wherein the presenting the virtual object being released comprises presenting the virtual object being released based at least in part on the trajectory.
