# US 2018/0024623 A1 · Detecting user range of motion for virtual reality user interfaces

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024623 A1
- Document ID: US20180024623A1
- Status: Published application
- Kind: A1
- Application number: 15/656,850
- Filed: 2017-07-21
- Published: 2018-01-25
- Earliest claimed: 2016-07-22
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Alexander James FAABORG; Scott DOLIM; Manuel Christian CLEMENT
- Web page: https://patentgrep.com/patent/US20180024623A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one general aspect, a system and method are described to generate a virtual environment for a user. The virtual environment may be generated with a first electronic device that is communicably coupled to a second electronic device. The method may include tracking movement of the second electronic device in an ambient environment, determining, using one or more sensors, a range of motion associated with the movement in the ambient environment, correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment, determining, for a plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment the plurality of virtual objects according to the virtual configuration, and triggering rendering of the plurality of virtual objects according to the configuration.

## Claims

### Claim 1

A computer-implemented method comprising:
generating a virtual environment with a first electronic device that is communicably coupled to a second electronic device;
tracking movement of the second electronic device in an ambient environment;
determining, using one or more sensors, a range of motion associated with the movement of the second electronic device in the ambient environment;
correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment;
determining, for a plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment; and
trigger rendering, in the virtual environment in the first electronic device, the plurality of virtual objects according to the virtual configuration.

### Claim 2 (depends on 1)

The method of claim 1, wherein at least one of the plurality of virtual objects is part of a user interface showing the virtual environment and options associated with the virtual environment, and wherein determining the virtual configuration includes adapting the user interface to match the range of motion associated with the virtual environment.

### Claim 3 (depends on 1)

The method of claim 1, wherein correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment includes:
determining a physical aspect of a user accessing at least one of the first electronic device or the second electronic device;
translating at least one capability associated with the physical aspect from the ambient environment into the virtual environment; and
providing virtual content in the virtual environment according to the at least one translated capability.

### Claim 4 (depends on 3)

The method of claim 3, wherein the physical aspect of a user accessing the first electronic device includes at least one of a detected position within the virtual environment, a posture, a detected position within a physical space, or a detected height and a reach distance pertaining to an arm span associated with the user.

### Claim 5 (depends on 3)

The method of claim 3, wherein correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment further includes:
in response to determining that a user accessing the first electronic device is in a seated position while accessing the first electronic device, enabling the at least one capability in the virtual environment to account for the seated position of the user.

### Claim 6 (depends on 3)

The method of claim 3, wherein determining, for the plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment includes determining the physical aspect of the user associated with the first electronic device, and estimating a reach zone using the physical aspect of the user and the range of motion associated with the ambient environment, the reach zone being used as an area within reach of the user accessing the first electronic device and in which to place a plurality of virtual objects in the virtual environment.

### Claim 7 (depends on 1)

The method of claim 1, wherein the range of motion associated with the virtual environment is determined using an accelerometer executing on the second electronic device.

### Claim 8 (depends on 1)

The method of claim 1, wherein tracking movement of the second electronic device in the ambient environment includes tracking lateral movement of the second electronic device by capturing images of a user accessing the first electronic device and the second electronic device in the ambient environment.

### Claim 9 (depends on 1)

The method of claim 1, wherein the first electronic device is an HMD device and the second electronic device is a portable electronic device.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining, for the plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment includes determining a height of a user accessing the first electronic device, and estimating a reach zone using the height of the user and the range of motion associated with the ambient environment, the reach zone being used as an area within reach of the user accessing the first electronic device and in which to place a plurality of virtual objects in the virtual environment.

### Claim 11 (depends on 1)

The method of claim 1, wherein determining, for a plurality of virtual objects, a virtual configuration adapted to a range of motion associated with the virtual environment includes detecting a vertical offset of the first electronic device and using the vertical offset to place a plurality of objects within reach of a user accessing the first electronic device.

### Claim 12

A non-transitory, machine-readable medium having instructions stored thereon, the instructions, when executed by a processor, cause a computing device to:
generate a virtual environment with a first electronic device that is communicably coupled to a second electronic device;
track movement of the second electronic device in an ambient environment;
determine, using one or more sensors, a range of motion associated with the movement associated with the second electronic device in the ambient environment;
correlate the range of motion associated with the ambient environment to a range of motion associated with the virtual environment;
determine, for a plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment; and
trigger rendering, in the virtual environment in the first electronic device, the plurality of virtual objects according to the virtual configuration.

### Claim 13 (depends on 12)

The non-transitory, machine-readable medium of claim 12, wherein at least one of the plurality of virtual objects is part of a user interface showing the virtual environment and options associated with the virtual environment, and wherein determining the virtual configuration includes adapting the user interface to match the range of motion associated with the virtual environment.

### Claim 14 (depends on 12)

The non-transitory, machine-readable medium of claim 12, wherein correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment includes determining a physical aspect of a user accessing the first electronic device.

### Claim 15 (depends on 12)

The non-transitory, machine-readable medium of claim 12, wherein the first electronic device is an HMD device and the second electronic device is a portable electronic device.

### Claim 16 (depends on 12)

The non-transitory, machine-readable medium of claim 12, wherein determining, for the plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment includes determining a physical aspect of a user associated with the first electronic device, and estimating a reach zone using the physical aspect of the user and the range of motion associated with the ambient environment, the reach zone being used as an area within reach of the user associated with and/or accessing the first electronic device and in which to place a plurality of virtual objects in the virtual environment.

### Claim 17

A system comprising:
memory; and
at least one processor coupled to the memory, the at least one processor being configured to:
generate a virtual environment with a first electronic device that is communicably coupled to a second electronic device;
track movement of the second electronic device in an ambient environment;
determine, using one or more sensors, a range of motion associated with the movement in the ambient environment;
correlate the range of motion associated with the ambient environment to a range of motion associated with the virtual environment;
determine, for a plurality of virtual objects, a virtual configuration adapted to the range of motion associated with the virtual environment; and
trigger rendering, in the virtual environment in the first electronic device, the plurality of virtual objects according to the virtual configuration.

### Claim 18 (depends on 17)

The system of claim 17, wherein correlating the range of motion associated with the ambient environment to a range of motion associated with the virtual environment further includes enabling the at least one capability in the virtual environment to account for a seated position of a user accessing the first electronic device, in response to determining that the user is in a seated position while accessing the first electronic device.

### Claim 19 (depends on 17)

The system of claim 17, wherein tracking movement of the second electronic device in the ambient environment includes analyzing accelerometer data stored on the second electronic device.

### Claim 20 (depends on 17)

The system of claim 17, wherein the first electronic device is an HMD device and the second electronic device is a portable electronic device.
