Back to results
US 12,720,002 B2Granted
Providing assistance to impaired users within a conferencing system
AssigneeZoom Communications, Inc.
InventorsRonald Hutto, Thanh Le Nguyen
Life of this patent
Estimating the term…
Abstract
The present disclosure relates to systems and methods for providing assistance to visually impaired and/or hearing-impaired users accessing a video conference. The systems and methods include initiating a virtual meeting hosting a plurality of participants, detecting a presence of at least one impaired participant from the plurality of participants, loading one or more audio visual settings for providing assistance to the at least one impaired participant, and automatically providing adjustments for one or more audio visual elements provided to the at least one impaired participant, based on the one or more audio visual settings.
Claims20
A method for referencing a user in chat, the method comprising:
- initiating, by a video conference provider, a virtual meeting hosting a plurality of participants;
- detecting, by the video conference provider, a presence of at least one hearing-impaired participant among the plurality of participants in the virtual meeting;
- updating, by the video conference provider, one or more audio and visual settings for providing assistance to the at least one hearing-impaired participant, wherein the one or more audio and visual settings comprise a voice style setting corresponding to each of the at least one hearing-impaired participant;
- detecting, by the video conference provider, a presence of an interpreter participant;
- transmitting, by the video conference provider, an indication of one or more hearing-impaired participants assigned to the interpreter participant to cause a client device associated with the interpreter participant to update a graphical user interface (GUI) to display the one or more hearing-impaired participants;
- executing, by the video conference provider, a machine learning model on received video feed associated with the at least one hearing-impaired participant to determine that a hearing-impaired participant of the one or more hearing-impaired participants is using sign language;
- notifying, by the video conference provider, the interpreter participant that the hearing-impaired participant is using sign language;
- receiving, by the video conference provider, an audio stream of the interpreter participant translating the sign language, the audio stream comprising speech;
- modifying, by the video conference provider, the speech of the interpreter participant based on applying the voice style setting corresponding to the hearing-impaired participant to the speech of the interpreter participant to obtain a modified speech of the interpreter participant;
- and
- providing, by the video conference provider, the modified speech of the interpreter participant as an audio output associated with the hearing-impaired participant.
8 more elements
A system comprising:
- a communications interface;
- a non-transitory computer-readable medium;
- and
- one or more processors communicatively coupled to the communications interface and the non-transitory computer-readable medium, the one or more processors configured to execute processor-executable instructions stored in the non-transitory computer-readable medium to:
- initiate a virtual meeting hosting a plurality of participants;
- detect a presence of at least one-hearing-impaired participant among the plurality of participants;
- update one or more audio and visual settings for providing assistance to the at least one hearing-impaired participant, wherein the one or more audio and visual settings comprise a voice style setting corresponding to each of the at least one hearing-impaired participant;
- detecting a presence of an interpreter participant;
- transmit an indication of one or more hearing-impaired participants assigned to the interpreter participant to cause a client device associated with the interpreter participant to update a graphical user interface (GUI) to display the one or more hearing-impaired participants;
- execute a machine learning model on received video feed associated with the at least one hearing-impaired participant to determine that a hearing-impaired participant of the one or more hearing-impaired participants is using sign language;
- notify the interpreter participant that the hearing-impaired participant is using sign language;
- receive an audio stream of the interpreter participant translating the sign language, the audio stream comprising speech;
- modify the speech of the interpreter participant based on applying the voice style setting corresponding to the hearing-impaired participant to the speech of the interpreter participant to obtain a modified speech of the interpreter participant;
- and
- provide the modified speech of the interpreter participant as an audio output associated with the hearing-impaired participant.
12 more elements
A non-transitory computer-readable memory comprising processor-executable instructions configured to cause one or more processors to:
- initiate a virtual meeting hosting a plurality of participants;
- detect a presence of at least one-hearing-impaired participant among the plurality of participants;
- update one or more audio and visual settings for providing assistance to the at least one hearing-impaired participant, wherein the one or more audio and visual settings comprise a voice style setting corresponding to each of the at least one hearing-impaired participant;
- detect a presence of an interpreter participant;
- transmit an indication of one or more hearing-impaired participants assigned to the interpreter participant to cause a client device associated with the interpreter participant to update a graphical user interface (GUI) to display the one or more hearing-impaired participants;
- execute a machine learning model on received video feed associated with the at least one hearing-impaired participant to determine that a hearing-impaired participant of the one or more hearing-impaired participants is using sign language;
- notify the interpreter participant that the hearing-impaired participant is using sign language;
- receive an audio stream of the interpreter participant translating the sign language, the audio stream comprising speech;
- modify the speech of the interpreter participant based on applying the voice style setting corresponding to the hearing-impaired participant to the speech of the interpreter participant to obtain a modified speech of the interpreter participant;
- and
- provide the modified speech of the interpreter participant as an audio output associated with the hearing-impaired participant.
8 more elements
Dependencies are inferred from the claim text.