# US 2024/0201823 A1 · Light-emitting user input device for calibration or pairing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0201823 A1
- Document ID: US20240201823A1
- Status: Published application
- Kind: A1
- Application number: 18/591,983
- Filed: 2024-02-29
- Published: 2024-06-20
- Earliest claimed: 2017-04-27
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: James M. POWDERLY; Savannah NILES; Christopher David NESLADEK; Isioma Osagbemwenorue AZU; Marshal Ainsworth FONTAINE; Haney AWAD; William WHEELER; Brian David SCHWAB; Brian Edward Oliver BUCKNOR
- Web page: https://patentgrep.com/patent/US20240201823A1

## CPC

- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/02: Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F 3/0308: {comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/03547: {Touch pads, in which fingers can move on a surface}
- G06F 3/038: Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 10/145: Illumination specially adapted for pattern recognition, e.g. using gratings
- G06V 20/20: in augmented reality scenes
- G06V 40/18: Eye characteristics, e.g. of the iris
- G09G 3/32: semiconductive, e.g. using light-emitting diodes [LED]
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye}
- G06F 2203/0384: Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
- G06F 2203/04103: Manufacturing, i.e. details related to manufacturing processes specially suited for touch sensitive devices
- G06F 2203/04105: Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
- G09G 2320/0626: for control of overall brightness
- G09G 2354/00: Aspects of interface with display user
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A light-emitting user input device can include a touch sensitive portion configured to accept user input (e.g., from a user's thumb) and a light-emitting portion configured to output a light pattern. The light pattern can be used to assist the user in interacting with the user input device. Examples include emulating a multi-degree-of-freedom controller, indicating scrolling or swiping actions, indicating presence of objects nearby the device, indicating receipt of notifications, assisting pairing the user input device with another device, or assisting calibrating the user input device. The light-emitting user input device can be used to provide user input to a wearable device, such as, e.g., a head mounted display device.

## Claims

### Claim 1

A light-emitting user input device for providing user input to a display system including a wearable display device, the light-emitting user input device comprising:
a plurality of interactable regions, including a central touch surface, configured to receive user inputs;
a light-emitting assembly comprising a light guide outside of and at least partly surrounding the central touch surface; and
a hardware processor communicatively coupled to the plurality of interactable regions and the light-emitting assembly, the hardware processor programmed to:
detect an actuation of the light-emitting user input device by a user of the wearable display device;
determine an interactable region of the plurality of interactable regions that corresponds to the actuation;
translate the actuation into a user input for performing a user interface operation for interacting with a virtual environment presented through the wearable display device, wherein the user interface operation is determined based at least on a type of the actuation and the interactable region corresponding with the actuation; and
instruct the light-emitting assembly to illuminate a light pattern in response to the user input.

### Claim 2 (depends on 1)

The light-emitting user input device of claim 1, wherein:
the plurality of interactable regions comprises a first interactable region and a second interactable region;
in response to determining that the user actuated the first interactable region, the hardware processor is programmed to cause the light-emitting assembly to illuminate a first light pattern associated with the user input in the first interactable region; and
wherein in response to determining that the user actuated the second interactable region, the hardware processor is programmed to cause the light-emitting assembly to illuminate a second light pattern associated with the user input in the second interactable region.

### Claim 3 (depends on 1)

The light-emitting user input device of claim 1, wherein the actuation comprises at least one of: a swipe, a tap, a press, or a touch gesture.

### Claim 4 (depends on 1)

The light-emitting user input device of claim 1, wherein the light pattern comprises an arcuate region having one or more of a color, an arcuate length, or a visual effect.

### Claim 5 (depends on 1)

The light-emitting user input device of claim 1, wherein the hardware processor is further programmed to communicate with display system causing the display system to perform the user interface operation based on the user input.

### Claim 6 (depends on 1)

The light-emitting user input device of claim 1, wherein the light guide is substantially circular.

### Claim 7 (depends on 1)

The light-emitting user input device of claim 1, wherein the light guide is touch sensitive to receive user input.

### Claim 8 (depends on 1)

The light-emitting user input device of claim 1, wherein the central touch surface is substantially circular.

### Claim 9 (depends on 1)

The light-emitting user input device of claim 1, wherein the light guide fully surrounds the central touch surface.

### Claim 10

A method comprising:
under control of a hardware processor:
detecting an actuation of a light-emitting user input device by a user of a wearable display device, wherein the light-emitting user input device is configured to provide user input to a display system including the wearable display device, and wherein the light-emitting user input device comprises a plurality of interactable regions, including a central touch surface, configured to receive inputs, and a light-emitting assembly comprising a light guide outside of and at least partly surrounding the central touch surface;
determining an interactable region of the plurality of interactable regions that corresponds to the actuation;
translating the actuation into a user input for performing a user interface operation for interacting with a virtual environment presented through the wearable display device, wherein the user interface operation is determined based at least on a type of the actuation and the interactable region corresponding with the actuation; and
instructing the light-emitting assembly to illuminate a light pattern in response to the user input.

### Claim 11 (depends on 10)

The method of claim 10, wherein the plurality of interactable regions comprises a first interactable region and a second interactable region, the method further comprising:
in response to determining that the user actuated the first interactable region, causing the light-emitting assembly to illuminate a first light pattern associated with the user input in the first interactable region; and
in response to determining that the user actuated the second interactable region, causing the light-emitting assembly to illuminate a second light pattern associated with the user input in the second interactable region.

### Claim 12 (depends on 10)

The method of claim 10, wherein the actuation comprises at least one of: a swipe, a tap, a press, or a touch gesture.

### Claim 13 (depends on 10)

The method of claim 10, wherein the light pattern comprises an arcuate region having one or more of a color, an arcuate length, or a visual effect.

### Claim 14 (depends on 10)

The method of claim 10, further comprising:
causing the display system to perform the user interface operation based on the user input.

### Claim 15 (depends on 10)

The method of claim 10, wherein the light guide is substantially circular.

### Claim 16 (depends on 10)

The method of claim 10, wherein the light guide is touch sensitive to receive user input.

### Claim 17 (depends on 10)

The method of claim 10, wherein the central touch surface is substantially circular.

### Claim 18 (depends on 10)

The method of claim 10, wherein the light guide fully surrounds the central touch surface.
