Augmented reality assisted communication
AssigneeRobotArmy Corp.
InventorsDamien Phelan Stolarz, Alan Gary Brown
Life of this patent
Estimating the term…
Abstract
The disclosed embodiments illustrate methods and systems for training users in sports using mixed reality. The method includes retrieving data from athletes wearing helmets, wearable glasses, and/or motion-capture suits in real time. The helmets and the wearable glasses are integrated with mixed-reality technology. Further, physical performance data of the athletes is captured using a variety of time-synchronized measurement techniques. Thereafter, the athletes are trained using the captured data and audio, visual and haptic feedback.
Claims23
-20. (canceled)
A wearable apparatus, comprising:
- an augmented reality (“AR”) interface;
- a microphone operable to generate audio data of a voice of a first user wearing the wearable apparatus;
- a sensor configured to determine a first position information of the wearable apparatus;
- a transceiver operable to at least:
- receive a second position information of a second wearable apparatus worn by a second user;
- receive a third position information of a third wearable apparatus worn by a third user;
- and
- send audio data generated by the microphone;
- a gaze tracking component to determine a direction in which the first user is looking;
- one or more processors;
- and
- a memory storing program instructions that when executed by the one or more processors cause the one or more processors to at least:
- determine, based at least in part on information received from the gaze tracking component and one or more of the first position information, the second position information, or the third position information, that the first user wearing the wearable apparatus is looking in a direction of the second user;
- in response to a determination that the first user is looking in the direction of the second user:
- present on the AR interface, an indication that the first user is looking in the direction of the second user;
- establish a connection with the second wearable apparatus worn by the second user;
- receive, from the microphone, audio data that includes a speech of the first user that is output by the first user while the first user is looking in the direction of the second user;
- and
- send the audio data to the second wearable apparatus without sending the audio data to the third wearable apparatus.
A computer implemented method of augmented reality assisted communication, comprising:
- receiving, at an augmented reality (“AR”) interface of a first wearable worn by a first user, a selection by the first user of a second user of a plurality of users, wherein each of the plurality of users are wearing a wearable and the plurality of users includes the first user;
- establishing an audio connection between the first wearable and a second wearable worn by the second user;
- sending, via the audio connection, a first audio data from the first wearable to the second wearable for output by the second wearable;
- receiving at the first wearable and via the audio connection, a second audio data sent from the second wearable;
- indicating on the AR interface of the first wearable that second audio data is received from the second wearable and is of the second user speaking;
- and
- outputting at the first wearable the second audio data.
A system, comprising:
- a first wearable apparatus, including:
- a first augmented reality (“AR”) display;
- a first microphone;
- a first directional headphone;
- and
- a first transceiver;
- a second wearable apparatus, including:
- a second AR display;
- a second microphone;
- a second directional headphone;
- a second transceiver;
- one or more processors;
- and
- a memory storing program instructions that when executed by the one or more processors cause the one or more processors to at least:
- receive, via the second transceiver, audio data sent by the first transceiver;
- determine a position of the first wearable apparatus with respect to the second wearable apparatus;
- output, via the second directional headphone, the audio data with a virtual sound in a direction corresponding to the position of the first wearable apparatus;
- and
- present, on the second AR display, an indication of the position of the first wearable apparatus.
Dependencies are inferred from the claim text.