# US 2021/0333864 A1 · Systems and methods for configuring a hub-centric virtual/augmented reality environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0333864 A1
- Document ID: US20210333864A1
- Status: Published application
- Kind: A1
- Application number: 17/139,666
- Filed: 2020-12-31
- Published: 2021-10-28
- Earliest claimed: 2016-11-14
- Assignees: Logitech Europe S.A.
- Applicants: Logitech Europe S.A.
- Inventors: Stephen Harvey; Denis O'Keeffe; Andreas Connellan; Damien O'Sullivan; Aidan Kehoe; Noirin Curran; Thomas Rouvinez; Mario Gutierrez; Olivier Riviere; Remy Zimmermann; Mathieu Meisser; Dennin Onorio; Ciaran Trotman; Pierce O'Bradaigh; Marcel Twohig; Padraig Murphy; Jerry Ahern
- Web page: https://patentgrep.com/patent/US20210333864A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/0426: {tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886)}
- G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

In certain embodiments, a sensing and tracking system detects objects, such as user input devices or peripherals, and user interactions with them. A representation of the objects and user interactions are then injected into the virtual reality environment. The representation can be an actual reality, augmented reality, virtual representation or any combination. For example, an actual keyboard can be injected, but with the keys pressed being enlarged and lighted.

## Claims

### Claim 1

A hub device for interfacing physical peripheral devices for a virtual environment, comprising:
a transceiver configured to communicate with a display system for presenting a virtual reality or augmented reality virtual reality environment to a user;
a tracking subsystem configured to sense a location of a physical peripheral input device within a physical environment; and
one or more processors coupled to the transceiver and the tracking subsystem, the one or more processors configured to:
determine, via the tracking subsystem, the location of the physical peripheral input device within the physical environment; and
transmit, via the transceiver, to the display system, the location of the physical peripheral input device within the physical environment.

### Claim 2 (depends on 1)

The hub device of claim 1, wherein the one or more processors are configured to:
determine, via the tracking subsystem, the location of the physical peripheral input device in relation to the device;
transform the location of the physical peripheral input device from a coordinate system used by the device to a coordinate system used by the display system; and
transmit, via the transceiver, to the display system, the location of the physical peripheral input device using the coordinate system of the display system.

### Claim 3 (depends on 1)

The hub device of claim 1, wherein the display system is a head-mounted display (HMD).

### Claim 4

A hub device for determining a virtual workstation for use with a virtual environment, comprising:
a transceiver configured to communicate with a display system for presenting a virtual reality or augmented reality virtual reality environment to a user;
one or more sensors configured to detect aspects of a physical environment in proximity to the device; and
one or more processors configured to:
determine, via the one or more sensors, the aspects of the physical environment in proximity to the device;
based on determining the aspects of the physical environment, defining one or more zones for the user to interact with a physical peripheral input device and a virtual display provided by the display system; and
transmit, via the transceiver, to the display system, information indicative of the one or more zones.

### Claim 5 (depends on 4)

The hub device of claim 4, wherein the one or more zones include a first zone that defines an area characterized in that a physical peripheral input device placed within the first zone is used by a user to interact with one or more virtual displays rendered by the display system.

### Claim 6 (depends on 5)

The hub device of claim 5, wherein the one or more zones include a second zone characterized in that a virtual display can be perceived by the user as being located within the second zone and interaction with a physical peripheral device within the first zone can modify content observable by the user rendered on the virtual display within the second zone.

### Claim 7 (depends on 6)

The hub device of claim 6, wherein the one or more zones include a third zone characterized in that content displayed within the third zone is viewable by a plurality of users interacting within an augmented reality or virtual reality virtual reality environment; and
wherein content displayed within the second zone is viewable by only one user of the plurality of users.

### Claim 8 (depends on 4)

The hub device of claim 4, wherein the display system is a head-mounted display (HMD).

### Claim at position 9

-20. (canceled)
