Mixed reality sensor suite and interface for physical region enhancement
AssigneeChosen Realities, LLC
InventorEric BROWY
Life of this patent
Estimating the term…
Abstract
Disclosed herein is a mixed reality application to use a multi-channel audio input to identify a character and origin of a given sound, then present a visual representation of the given sound on a near eye display. The visual representation including a vector to the source of the sound. The visual representation further including graphical elements that describe various attributes of the given sound including the magnitude, directionality, source, and threat level. Where the source of the given sound is moving, the visual representation shifts to illustrate the movement.
Claims20
A method, comprising:
- determining a location or direction of an object relative to a user at least by analyzing, at the display device, first audio data pertaining to a first sound originated from the object in an environment in which the user wearing a display device is located;
- determining a graphic representation for the object at least by analyzing at least the first audio data captured by a plurality of audio sensors of the display device;
- and
- presenting, by the display device, the graphic representation that indicates the location or direction of the object relative to the user.
A display system, comprising:
- a display device;
- at least one processor operatively coupled to the display device;
- and
- memory communicatively coupled to the at least one processor, the memory storing thereupon a set of instructions which, when executed by the at least one processor, cause the at least one processor to perform a set of acts, the set of acts comprising:
- determining a location or direction of an object relative to a user at least by analyzing, at the display device, first audio data pertaining to a first sound originated from the object in an environment in which the user wearing a display device is located;
- determining a graphic representation for the object at least by analyzing at least the first audio data captured by a plurality of audio sensors of the display device;
- and
- presenting, by the display device, the graphic representation that indicates the location or direction of the object relative to the user.
An augmented reality system, comprising:
- a display;
- a plurality of audio sensors;
- a processor operatively coupled to the display and the plurality of audio sensors;
- and
- memory communicatively coupled to the processor, the memory storing thereupon a set of instructions which, when executed by the processor, cause the processor to perform a set of acts, the set of acts comprising:
- determining a location or direction of an object relative to a user at least by analyzing, at the display device, first audio data pertaining to a first sound originated from the object in an environment in which the user wearing a display device is located;
- determining a graphic representation for the object at least by analyzing at least the first audio data captured by a plurality of audio sensors of the display device;
- and
- presenting, by the display device, the graphic representation that indicates the location or direction of the object relative to the user.
Dependencies are inferred from the claim text.