Performing artificial intelligence sign language translation services in a video relay service environment
OwnerConrad A. Maxwellinventor
Life of this patent
Estimating the term…
Abstract
Video relay services, communication systems, non-transitory machine-readable storage media, and methods are disclosed herein. A video relay service may include at least one server configured to receive a video stream including sign language content from a video communication device during a real-time communication session. The server may also be configured to automatically translate the sign language content into a verbal language translation during the real-time communication session without assistance of a human sign language interpreter. Further, the server may be configured to transmit the verbal language translation during the real-time communication session.
Claims12
A video phone system for providing automated translation services during a real-time video phone communication session between two or more people, comprising:
- a video communication device associated with a near-end user;
- a far-end communication device associated with a far-end user;
- a video relay service configured to connect to the near-end device over a first connection and to the far-end device over a second connection, thereby facilitating a communication session between the near-end user and the far-end user;
- at least one server in operable communication with the video relay service, the at least one server comprising an AI translation engine, the server configured to:
- receive an audio stream from one or more of the video communication device and the far-end communication device during the real-time communication session between the near-end user and the far-end user;
- analyze the audio stream;
- automatically translate voice content from the audio stream into sign language content during the real-time video phone communication session without assistance from a human sign language interpreter;
- and,
- transmit the sign language content to at least the near-end user during the real-time video phone communication session.
A method of performing automated translation services during a real-time communication session between two or more people using a video relay service in operable communication with server comprising an artificial intelligence (AI) translation engine, the method comprising:
- establishing a first connection between a communication device of one or more call initiators and the video relay service and a second connection between the video relay service and a communication device of one or more call recipients;
- using the AI translation engine to automatically translate an audio stream received from the call initiator over the first connection into sign language content converting the audio stream into text in the language of one or more of the call recipients and comparing the text to stored video files in an AI translation database;
- and
- transmitting the text to the video communication device over the second connection during the real-time communication session.
A non-transitory machine-readable storage medium comprising processor executable instructions that, when executed by a processor of a server, cause the server to perform operations comprising:
- establishing a first connection between a communication device of one or more call initiators and a video relay service fin operable communication with and artificial intelligence (AI) translation engine and a second connection between the video relay service and a communication device of one or more call recipients;
- receiving an audio stream from the one or more call initiators over the first connection during a real-time video phone communication session;
- automatically translating the audio stream into sign language content using the AI translation engine without assistance of a human sign language interpreter by converting the audia stream into text in the language of one or more call recipients;
- and
- transmitting the text to the video communication device of one or more call recipients over the second connection during the real-time video phone communication session.
Dependencies are inferred from the claim text.