Eyewear including sign language to speech translation
AssigneeSnap Inc.
InventorsRyan Chan, Brent Mills, Eitan Pilipski, Jennica Pounds, Elliot Solomon
Life of this patent
Estimating the term…
Abstract
An eyewear having an electronic processor configured to identify a hand gesture including a sign language, and to generate speech that is indicative of the identified hand gesture. The electronic processor uses a convolutional neural network (CNN) to identify the hand gesture by matching the hand gesture in the image to a set of hand gestures, wherein the set of hand gestures is a library of hand gestures stored in a memory. The hand gesture can include a static hand gesture, and a moving hand gesture. The electronic processor is configured to identify a word from a series of hand gestures.
Claims20
Eyewear, comprising:
- a frame configured to be worn on a head of a user;
- a camera supported by the frame and configured to generate an image including a hand gesture;
- and
- an electronic processor configured to:
- receive the image including the hand gesture from the camera;
- identify the hand gesture as a sign language;
- and
- generate speech that is indicative of the identified hand gesture.
A method of use of eyewear having a frame configured to be worn on a head of a user, a camera supported by the frame and configured to generate an image including a hand gesture, and an electronic processor, the electronic processor:
- receiving the image including the hand gesture from the camera;
- identifying the hand gesture as a sign language;
- and
- generating speech that is indicative of the identified hand gesture.
A non-transitory computer-readable medium storing program code which, when executed by an electronic processor of eyewear having a frame configured to be worn on a head of a user, a camera supported by the frame and configured to generate an image including a hand gesture, is operative to cause the processor to perform the steps of:
- receiving the image including the hand gesture from the camera;
- identifying the hand gesture as a sign language;
- and
- generating speech that is indicative of the identified hand gesture.
Dependencies are inferred from the claim text.