Systems and methods for sign language recognition
AssigneeMagic Leap, Inc.
InventorsEric C. Browy, Michael Janusz Woods, Andrew Rabinovich
Life of this patent
Estimating the term…
Abstract
A sensory eyewear system for a mixed reality device can facilitate user's interactions with the other people or with the environment. As one example, the sensory eyewear system can recognize and interpret a sign language, and present the translated information to a user of the mixed reality device. The wearable system can also recognize text in the user's environment, modify the text (e.g., by changing the content or display characteristics of the text), and render the modified text to occlude the original text.
Claims24
A computing system comprising:
- a hardware computer processor;
- a non-transitory computer readable medium having software instructions stored thereon, the software instructions executable by the hardware computer processor to cause the computing system to perform operations comprising:
- communicate with a plurality of wearable AR devices via one or more networks;
- receive image information captured by an outward facing imaging system of a first wearable AR device of the plurality of wearable AR devices, wherein the image information comprises images of one or more hands of a first wearer of the first wearable AR device;
- automatically detect sign language in the received image information, based at least on analysis of the images of the one or more hands of the first wearer;
- convert the detected sign language into text;
- and
- transmit, through the one or more networks, the converted text to a second wearable AR device in the plurality of wearable AR devices, wherein the second wearable AR device is configured to display the converted text to a second wearer of the second wearable AR device.
A method of facilitating communication between wearable AR devices, the method comprising:
- communicating with a plurality of wearable AR devices via one or more networks;
- receiving image information captured by an outward facing imaging system of a first wearable AR device of the plurality of wearable AR devices, wherein the image information comprises images of one or more hands of a first wearer of the first wearable AR device;
- automatically detecting sign language in the received image information, based at least on analysis of the images of the one or more hands of the first wearer;
- converting the detected sign language into text;
- and
- transmitting, through one or more networks, the converted text to a second wearable AR device in the plurality of wearable AR devices, wherein the second wearable AR device is configured to display the converted text to a second wearer of the second wearable AR device.
Dependencies are inferred from the claim text.