Back to results
US 2023/0056847 A1Published application
Wearable speech input-based to moving lips display overlay
AssigneeSnap Inc.
InventorKathleen Worthington McMahon
Life of this patent
Estimating the term…
Loading patent…
Loading patent…
AssigneeSnap Inc.
InventorKathleen Worthington McMahon
Estimating the term…
Eyewear having a speech to moving lips algorithm that receives and translates speech and utterances of a person viewed through the eyewear, and then displays an overlay of moving lips corresponding to the speech and utterances on a mask of the viewed person. A database having text to moving lips information is utilized to translate the speech and generate the moving lips in near-real time with little latency. This translation provides the deaf/hearing impaired users the ability to understand and communicate with the person viewed through the eyewear when they are wearing a mask. The translation may include automatic speech recognition (ASR) and natural language understanding (NLU) as a sound recognition engine.
Eyewear, comprising:
A method of use of eyewear, the eyewear having a frame, a camera supported by the frame and configured to generate an image of a person wearing a mask viewed through the frame, a display supported by the frame, a microphone supported by the frame, and a processor, the electronic processor:
A non-transitory computer-readable medium storing program code which, when executed, is operative to cause a processor of eyewear having a frame, a camera supported by the frame and configured to generate an image of a person wearing a mask viewed through the frame, a display supported by the frame, a microphone supported by the frame to perform the steps of:
Dependencies are inferred from the claim text.