Methods and devices for communication with multimodal compositions
AssigneeHuawei Technologies Canada Co., Ltd.
InventorsJian ZHAO, Pengcheng AN, Ziqi ZHOU, Qing LIU, Da-yuan HUANG, Linghao DU, Wei LI
Life of this patent
Estimating the term…
Abstract
Methods and devices are described that enable a device to generate a message including a multimodal composition, and to output the message on a device. The multimodal composition is generated by first selecting a first element belonging to a first output modality. The multimodal composition is further generated by selecting at least one second element belonging to a second output modality to associate with the first element, the combination of the first element and the second element being the multimodal composition.
Claims15
A method at a device, comprising:
- obtaining, via a user interface for generating a message, a first input indicating a first element belonging to a first output modality to include in the message;
- obtaining, via the user interface, a second input indicating at least one second element belonging to a second output modality to associate with the first element,
- combining the first element and the at least one second element to generate a multimodal composition;
- and
- outputting the message including the multimodal element.
A method at a device, the method comprising:
- receiving a communication of a message including a multimodal composition, the multimodal composition being a combination of a first element belonging to a first output modality and at least one second element belonging to a second output modality, receipt of the multimodal composition including receipt of a set of one or more parameters associated with the multimodal composition;
- detecting an input for interacting with the multimodal composition;
- and
- generating a multimodal output in accordance with the detected input, the multimodal output being generated in accordance with the set of one or more parameters associated with the multimodal composition.
An electronic device comprising:
- a memory storing instructions;
- and
- a processing unit coupled to the memory;
- wherein the processing unit is configured to execute the instructions to cause the device to:
- obtain, via a user interface for generating a message, a first input indicating a first element belonging to a first output modality to include in the message;
- obtain, via the user interface, a second input indicating at least one second element belonging to a second output modality to associate with the first element,
- combine the first element and the at least one second element to generate a multimodal composition;
- and
- output the message including the multimodal element.
Dependencies are inferred from the claim text.