Back to results
US 9,794,209 B2Granted
User interface for multi-modality communication
AssigneeElwha LLC
InventorsRoyce A. Levien, Richard T. Lord, Robert W. Lord, Mark A. Malamud, John D. Rinaldo, Jr.
Life of this patent
Estimating the term…
Abstract
Disclosed herein are example embodiments for multi-modality communication user interfaces. By way of example but not limitation, at least one user interface feature that is related to multi-modality communication may be provided, and manipulation of the at least one user interface feature may be detected. Described embodiments may include, but are not limited to, providing one or more communication modality options for user interaction with a communication device for a communication. By way of further example but not limitation, presentation or manipulation of example communication modality options are disclosed.
Claims33
A system comprising:
- (a) circuitry configured for providing at least one user interface feature, of a communication device, that is related to multi-modality communication that includes at least modality conversion, including at least:
- (1) circuitry for providing at least one virtual component for the at least one user interface feature on at least one display;
- (2) circuitry for providing at least one communication modality option indicative of a user interaction communication modality that depends, at least partially, on one or more temporal factors;
- (3) circuitry for providing at least one user interface feature configured to permit a user of the communication device to enter at least one user interaction setting for an incoming communication from a remote communication device when the incoming communication is indicative of a remote user interacting with the remote communication device at least partly via voice, the at least one user interface feature configured to permit the user to enter as the at least one user interaction setting a setting that, based on a detection of at least one environmental factor that is at least partly detectable by the communication device, selects between either a local user interaction communication modality for the incoming communication that is at least partly via text or a local user interaction communication modality for the incoming communication that is at least partly via video, including for at least:
- (i) circuitry for determining that a local user interaction communication modality for the incoming communication is to be at least partly via text if an identity of the remote user is determined not to match that of one or more particular persons, including at least:
- (A) circuitry for providing a user interface feature that permits a user to enter a user interaction setting for determining that a local user interaction communication modality for the incoming communication is to be at least partly via text based at least in part on detection of the environmental factor based on input from one or more sensors and based at least in part on determining that the identity of the remote user is determined not to match with one or more names in a contact list that are associated with a communication modality option that includes video;
- (B) circuitry configured for detecting manipulation of the at least one user interface feature of the communication device;
- (C) circuitry for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via text, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device;
- (D) circuitry for presenting at a local communication device prospective converted text data, which text data is converted from voice data that is input by a local user;
- and
- (E) circuitry for providing an opportunity to approve transmission of the prospective converted text data prior to transmission to a remote communication device;
- or
- (ii) circuitry for determining that a local user interaction communication modality for the incoming communication is to be at least partly via video if the identity of the remote user is determined to match that of the one or more particular persons, including at least:
- (A) circuitry configured for detecting manipulation of the at least one user interface feature of the communication device;
- (B) circuitry for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via video, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device.
12 more elements
A system comprising:
- (A) circuitry for providing at least one user interface feature, associated with a communication device, that is related to multi-modality communication, including at least:
- (1) circuitry for providing at least one virtual component for the at least one user interface feature on at least one display;
- (2) circuitry for providing at least one communication modality option indicative of a user interaction communication modality that depends, at least partially, on one or more temporal factors;
- (3) circuitry for providing at least one user interface feature configured to permit a user of the communication device to enter at least one user interaction setting for an incoming communication from a remote communication device when the incoming communication is indicative of a remote user interacting with the remote communication device at least partly via voice, the at least one user interface feature configured to permit the user to enter as the at least one user interaction setting a setting that, based on a detection of at least one environmental factor that is at least partly detectable by the communication device, selects between either a local user interaction communication modality for the incoming communication that is at least partly via text or a local user interaction communication modality for the incoming communication that is at least partly via video including for at least:
- (i) circuitry for determining that a local user interaction communication modality for the incoming communication is to be at least partly via text if an identity of the remote user is determined not to match that of one or more particular persons, including at least:
- (a) circuitry configured for detecting manipulation of the at least one user interface feature of the communication device;
- (b) circuitry for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via text, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device;
- (c) circuitry for presenting at a local communication device prospective converted text data, which text data is converted from voice data that is input by a local user;
- and
- (d) circuitry for providing an opportunity to approve transmission of the prospective converted text data prior to transmission to a remote communication device;
- or
- (ii) circuitry for determining that a local user interaction communication modality for the incoming communication is to be at least partly via video if the identity of the remote user is determined to match that of the one or more particular persons, including at least:
- (a) circuitry for providing a user interface feature that permits a user to enter a user interaction setting for determining that a local user interaction communication modality for the incoming communication is to be at least partly via video based at least in part on detection of the environmental factor based at least partly on input from one or more sensors and based at least in part on determining that the identity of the remote user is a match with one or more names in a contact list that are associated with a communication modality option that includes video;
- (B) circuitry for detecting manipulation of the at least one user interface feature of the communication device;
- and
- (C) circuitry for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via video, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device.
13 more elements
A computer program product comprising:
- at least one non-transitory computer-readable medium including at least:
- (a) one or more instructions for providing at least one user interface feature, of a communication device, that is related to multi-modality communication that includes at least modality conversion, including at least:
- (1) one or more instructions for providing at least one virtual component for the at least one user interface feature on at least one display;
- (2) one or more instructions for providing at least one communication modality option indicative of a user interaction communication modality that depends, at least partially, on one or more temporal factors;
- (3) one or more instructions for providing at least one user interface feature configured to permit a user of the communication device to enter at least one user interaction setting for an incoming communication from a remote communication device when the incoming communication is indicative of a remote user interacting with the remote communication device at least partly via voice, the at least one user interface feature configured to permit the user to enter as the at least one user interaction setting a setting that, based on a detection of at least one environmental factor that is at least partly detectable by the communication device, selects between either a local user interaction communication modality for the incoming communication that is at least partly via text or a local user interaction communication modality for the incoming communication that is at least partly via video including at least:
- (i) one or more instructions for determining that a local user interaction communication modality for the incoming communication is to be at least partly via text if an identity of the remote user is determined not to match that of one or more particular persons, including at least:
- (A) one or more instructions for providing a user interface feature that permits a user to enter a user interaction setting for at least partial conversion of voice data associated with the incoming communication to at least text data, wherein the at least partial conversion is to occur automatically, without further user intervention, based at least in part upon detection of an incoming voice communication, detection of the at least one environmental factor, and identification of the remote user;
- (B) one or more instructions configured for detecting manipulation of the at least one user interface feature of the communication device;
- (C) one or more instructions for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via text, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device;
- (D) one or more instructions for presenting at a local communication device prospective converted text data, which text data is converted from voice data that is input by a local user;
- and
- (E) one or more instructions for providing an opportunity to approve transmission of the prospective converted text data prior to transmission to a remote communication device;
- or
- (ii) one or more instructions for determining that a local user interaction communication modality for the incoming communication is to be at least partly via video if the identity of the remote user is determined to match that of the one or more particular persons, including at least:
- (A) one or more instructions for providing a user interface feature that permits a user to enter a user interaction setting for at least partial conversion of voice data associated with the incoming communication to at least video data, wherein the at least partial conversion is to occur automatically, without further user intervention, based at least in part upon detection of an incoming voice communication, detection of the at least one environmental factor, and identification of the remote user;
- (B) one or more instructions for detecting manipulation of the at least one user interface feature of the communication device;
- (C) one or more instructions for establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via video, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device.
14 more elements
A method comprising:
- (a) providing, at least in part with one or more processing devices, at least one user interface feature of a communication device that is related to multi-modality communication that includes at least modality conversion, including at least:
- (1) providing at least one virtual component for the at least one user interface feature on at least one display
- (2) providing at least one communication modality option indicative of a user interaction communication modality that depends, at least partially, on one or more temporal factors;
- (3) providing at least one user interface feature configured to permit a user of the communication device to enter at least one user interaction setting for an incoming communication from a remote communication device when the incoming communication is indicative of a remote user interacting with the remote communication device at least partly via voice, the at least one user interface feature configured to permit the user to enter as the at least one user interaction setting a setting that, based on a detection of at least one environmental factor that is at least partly detectable by the communication device, selects between either a local user interaction communication modality for the incoming communication that is at least partly via text or a local user interaction communication modality for the incoming communication that is at least partly via video including at least:
- (i) determining that a local user interaction communication modality for the incoming communication is to be at least partly via text if an identity of the remote user is determined not to match that of one or more particular persons, including at least:
- (A) providing a user interface feature that permits a user to enter a user interaction setting for determining that a local user interaction communication modality for the incoming communication is to be at least partly via text based at least in part on detection of the environmental factor based on input from one or more sensors and based at least in part on determining that the identity of the remote user is determined not to match with one or more names in a contact list that are associated with a communication modality option that includes video;
- (B) detecting manipulation of the at least one user interface feature of the communication device;
- (C) establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via text, wherein the at least one user interaction setting represents at least one communication modality option for a local user with respect to a local device;
- (D) presenting at a local communication device prospective converted text data, which text data is converted from voice data that is input by a local user;
- and
- (E) providing an opportunity to approve transmission of the prospective converted text data prior to transmission to a remote communication device;
- or
- (ii) determining that a local user interaction communication modality for the incoming communication is to be at least partly via video if the identity of the remote user is determined to match that of the one or more particular persons, including at least:
- (A) detecting manipulation of the at least one user interface feature;
- (B) establishing at least one user interaction setting, including at least establishing that the local user interaction communication modality for the incoming communication is to be at least partly via video, wherein the at least one user interaction setting represents at least one degree of communicative exposure for a local user with respect to a local device.
12 more elements
Dependencies are inferred from the claim text.