Translation of sign language in a virtual environment
AssigneeSony Interactive Entertainment Inc.
InventorsCeleste Bean, Todd Tokubo
Life of this patent
Estimating the term…
Abstract
A method is provided, including the following operations: receiving video of a first user; processing the video to identify signed communications in a first sign language made by the first user; translating the signed communications in the first sign language into signed communications in a second sign language; rendering an avatar of the user performing the translated signed communications in the second sign language; presenting the avatar on a display for viewing by a second user.
Claims20
A computer-implemented method, comprising:
- receiving video of a first user of a video game;
- processing the video to identify gestures made by the first user while the first user plays the video game;
- receiving context data indicating actions occurring in the video game when the gestures are made by the first user;
- determining, using the context data, whether the gestures made by the first user include signed communications in a first sign language;
- in response to determining that the gestures made by the first user include signed communications in the first sign language, translating the signed communications in the first sign language into signed communications in a second sign language;
- rendering an avatar of the first user performing the translated signed communications in the second sign language;
- and
- presenting the avatar on a display for viewing by a second user.
A non-transitory computer-readable medium having program instructions embodied thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising:
- receiving video of a first user of a video game;
- processing the video to identify gestures made by the first user while the first user plays the video game;
- receiving context data indicating actions occurring in the video game when the gestures are made by the first user;
- determining, using the context data, whether the gestures made by the first user include signed communications in a first sign language;
- in response to determining that the gestures made by the first user include signed communications in the first sign language, translating the signed communications in the first sign language into signed communications in a second sign language;
- rendering an avatar of the first user performing the translated signed communications in the second sign language;
- and
- presenting the avatar on a display for viewing by a second user.
A system comprising at least one computing device, the at least one computing device having logic configured to implement operations comprising:
- receiving video of a first user of a video game;
- processing the video to identify gestures made by the first user while the first user plays the video game;
- receiving context data indicating actions occurring in the video game when the gestures are made by the first user;
- determining, using the context data, whether the gestures made by the first user include signed communications in a first sign language;
- in response to determining that the gestures made by the first user include signed communications in the first sign language, translating the signed communications in the first sign language into signed communications in a second sign language;
- rendering an avatar of the first user performing the translated signed communications in the second sign language;
- and
- presenting the avatar on a display for viewing by a second user.
Dependencies are inferred from the claim text.