# US 2015/0178043 A1 · Combined multi-source input interface > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2015/0178043 A1 - Document ID: US20150178043A1 - Status: Published application - Kind: A1 - Application number: 14/140,447 - Filed: 2013-12-24 - Published: 2015-06-25 - Earliest claimed: 2013-12-24 - Inventors: Arthur Tan-Chi Yuan - Web page: https://patentgrep.com/patent/US20150178043A1 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Computerized method for composing actions from two or more input sources comprising. The method includes identifying content rendered on a content provisioning interface. The method further includes receiving a first input from a first input source on a part of the identified content. A second input from a second input source is also received to interact with the part of the identified content. The second input source is different from the first input source. The method also includes composing a combined action from the received second input from the second input source and the received first input from the first input source. The composed action is executed to interact with the part of the identified content. ## Claims ### Claim 1 A computerized method for composing actions from two or more input sources comprising: identifying content rendering on a user interface; receiving a touch input on a part of the identified content; receiving another input from another source to interact with the part of the identified content, said the another source being different from the touch input; composing a combined action from the received second input and the received touch input; and executing the composed action to interact with the part of the identified content. ### Claim 2 (depends on 1) The computerized method of claim 1, wherein receiving the another input comprises receiving a voice command. ### Claim 3 (depends on 1) The computerized method of claim 1, further comprising setting a predetermined period between receiving the another input and composing the combined action. ### Claim 4 (depends on 1) The computerized method of claim 1, wherein receiving the touch input comprises receiving a location data of the touch input with respect to the part of the identified content. ### Claim 5 (depends on 1) The computerized method of claim 1, wherein composing comprises composing the combined action with the received touch input being a first portion of the combined action and with the received another input being a second portion of the combined action. ### Claim 6 (depends on 1) The computerized method of claim 1, further comprising setting a predetermined period between receiving the touch input and composing the combined action. ### Claim 7 (depends on 1) The computerized method of claim 1, further comprising continuously monitoring for additional inputs from input sources between receiving the another input and the composing, and further comprising setting another predetermined period between receiving each of the additional inputs and the composing. ### Claim 8 A computerized method for composing actions from two or more input sources comprising: identifying content rendered on a content provisioning interface; receiving a first input from a first input source on a part of the identified content; receiving a second input from a second input source to interact with the part of the identified content, said the second input source being different from the first input source; and composing a combined action from the received second input from the second input source and the received first input from the first input source, wherein the composed action is executed to interact with the part of the identified content. ### Claim 9 (depends on 8) The computerized method of claim 8, wherein receiving the first input comprises receiving a touch-based input on a touch sensitive display. ### Claim 10 (depends on 8) The computerized method of claim 8, wherein receiving the second input comprises receiving a voice command. ### Claim 11 (depends on 8) The computerized method of claim 8, further comprising setting a predetermined period between receiving the second input and composing the combined action. ### Claim 12 (depends on 8) The computerized method of claim 8, wherein composing comprises composing the combined action by concatenating the received first input and the received second input according to an order when the first input and the second input are received. ### Claim 13 (depends on 8) The computerized method of claim 8, further comprising setting a predetermined period between receiving the first input and composing the combined action. ### Claim 14 (depends on 8) The computerized method of claim 8, further comprising continuously monitoring for additional inputs from input sources between receiving the second input and the composing. ### Claim 15 A system for composing actions from two or more input sources comprising: a client device having a processing unit configured for processing computer-executable instructions, a content provisioning interface, a first user interface input source, a second user interface input source, a network interface, and a memory; said processing unit identifying content rendered on the content provisioning interface; said first user interface input source receiving a first input from a user on a part of the identified content; said second user interface input source receiving a second input from the user to interact with the part of the identified content, said the second user interface input source being different from the first user interface input source; a remote memory for storing data associated with at least one of the following transmitted via the network interface: the first input and the second input; wherein the processing unit composes a combined action from the received second input from the second input source and the received first input from the first input source, wherein the processing unit executes the composed action for the user to interact with the part of the identified content. ### Claim 16 (depends on 15) The system of claim 15, wherein the network interface transmits the combined action to the remote memory. ### Claim 17 (depends on 15) The system of claim 15, further comprising a remote processing unit, wherein the network interface transmits the first input or the second input to the remote processing unit. ### Claim 18 (depends on 17) The system of claim 17, wherein the processing unit and the remote processing unit in combination compose the combined action. ### Claim 19 (depends on 15) The system of claim 15, wherein the client device further comprising additional user interface input sources, wherein the processing unit is further configured to continuously monitor for additional inputs from the additional user interface input sources. ### Claim 20 (depends on 15) The system of claim 15, wherein the processing unit is configured to set a predetermined period before composing the combined action in response to either the first user interface input source receives the first input or the second user interface input source receives the second input.