# US 8,751,937 B2 · Method of and system for dynamically controlling during run time a multifunction peripheral (MFP) touch panel user interface (UI) from an external remote network-connected computer > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,751,937 B2 - Document ID: US8751937B2 - Status: Granted - Kind: B2 - Application number: 13/617,542 - Filed: 2012-09-14 - Published: 2013-01-31 - Granted: 2014-06-10 - Earliest claimed: 2001-07-16 - Assignees: Nuance Communications, Inc. - Applicants: Michael Conley; Eric Hansen - Inventors: Michael Conley; Eric Hansen - Web page: https://patentgrep.com/patent/US8751937B2 ## CPC - H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP] - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - H04L 67/025: for remote control or remote monitoring of applications - H04N 1/0035: {User-machine interface; Control console (input or output arrangements for computers G06F3/00)} - H04N 1/00411: {the display also being used for user input, e.g. touch screen} - H04N 1/00509: {Personalising for a particular user or group of users, e.g. a workgroup or company} - H04N 1/00973: {from a remote device, e.g. receiving via the internet instructions input to a computer terminal} - H04L 69/329: in the application layer [OSI layer 7] - H04N 1/00204: {with a digital computer or a digital computer system, e.g. an internet server (programmed control between transmitter and receiver or between image input and image output device H04N1/32561)} - H04N 2201/001: Sharing resources, e.g. processing power or memory, with a connected apparatus or enhancing the capability of the still picture apparatus - H04N 2201/0039: Connection via a network - H04N 2201/0094: Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract In a system for dynamically and remotely providing user interface (UI) display and processing information to a touch panel embedded within a multifunction peripheral (MFP) such as a digital copier having an internal computer for controlling the touch panel, a method that comprises linking the internal computer to an external data communication network having an external remote computer on the network; and upon the inputting of desired selections by a user at the UI and communicating the same over the network to the external computer, providing information from the external computer via the network back to the internal computer that enables dynamically changing or updating the UI display and behavior during run time of the MFP. ## Claims ### Claim 1 A multifunction peripheral device capable of communicating with an external computer over a network, the multifunction peripheral device comprising: a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device; and an internal computer coupled to the user interface, the internal computer programmed to operate the multifunction peripheral device to perform operations associated with the set of capabilities, the internal computer programmed to, subsequent to the user selecting a service, communicate to the external computer via the network that the service has been selected, and to receive information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control, the internal computer programmed to update the touch panel display based on the received information, wherein information received by the multifunction peripheral device from the external computer includes extended mark-up language (XML) data describing content to be displayed on the touch panel display. ### Claim 2 (depends on 1) The multifunction peripheral device of claim 1, wherein the information describes the presentation of at least one user interface control to be displayed on the touch panel display, and wherein the internal computer is programmed to use the information to update the touch panel display to display the at least one user interface control according to the presentation description. ### Claim 3 (depends on 2) The multifunction peripheral device of claim 2, wherein the information includes at least one processing rule describing one or more operations to be performed when the user activates the at least one user interface control. ### Claim 4 (depends on 3) The multifunction peripheral device of claim 3, wherein the at least one processing rule includes instruction to the internal computer to send information to the external computer via the network when the user activates the at least one user interface control. ### Claim 5 (depends on 1) The multifunction peripheral device of claim 1, wherein the multifunction peripheral device is configured to receive, from the external computer via the network, user specific information to be displayed on the touch panel display, the user specific information describing capabilities available to the specific user, and wherein the internal computer is programmed to display the available capabilities on the touch panel display. ### Claim 6 A multifunction peripheral device capable of communicating with an external computer over a network, the multifunction peripheral device comprising: a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device; and an internal computer coupled to the user interface, the internal computer programmed to operate the multifunction peripheral device to perform operations associated with the set of capabilities, the internal computer programmed to, subsequent to the user selecting a service, communicate to the external computer via the network that the service has been selected, and to receive information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control, the internal computer programmed to update the touch panel display based on the received information, wherein the multifunction peripheral device is configured to receive, from the external computer, application information capable of, at least in part, controlling the touch panel display to display processing information needed to integrate the multifunction peripheral device with at least one enterprise application. ### Claim 7 A method of communicating between a multifunction peripheral device and an external computer over a network, the multifunction peripheral device comprising a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device, the method comprising: receiving indication via the user interface that a user has selected a service; communicating to the external computer via the network that the service has been selected; receiving information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control, wherein information received by the multifunction peripheral device from the external computer includes extended mark-up language (XML) data describing content to be displayed on the touch panel display; and updating the touch panel display based on the received information. ### Claim 8 (depends on 7) The method of claim 7, wherein the information describes the presentation of at least one user interface control to be displayed on the touch panel display, and wherein updating includes updating the touch panel display to display the at least one user interface control according to the presentation description. ### Claim 9 (depends on 8) The method of claim 8, wherein the information includes at least one processing rule describing one or more operations to be performed when the user activates the at least one user interface control. ### Claim 10 (depends on 9) The method of claim 9, further comprising sending information to the external computer via the network in response to the at least one processing rule. ### Claim 11 (depends on 7) The method of claim 7, comprising: receiving, from the external computer via the network, user specific information to be displayed on the touch panel display, the user specific information describing capabilities available to the specific user; and displaying the available capabilities on the touch panel display. ### Claim 12 A method of communicating between a multifunction peripheral device and an external computer over a network, the multifunction peripheral device comprising a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device, the method comprising: receiving indication via the user interface that a user has selected a service; communicating to the external computer via the network that the service has been selected; receiving information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control; updating the touch panel display based on the received information; and receiving, from the external computer, application specific information capable of, at least in part, controlling the touch panel display to display processing information needed to integrate the multifunction peripheral device with at least one enterprise application to which the application specific information relates. ### Claim 13 At least one non-transitory computer readable medium encoded with a software program that, when executed by a computer, performs a method of communicating between a multifunction peripheral device and a external computer over a network, the multifunction peripheral device comprising a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device, the method comprising: receiving indication via the user interface that a user has selected a service; communicating to the external computer via the network that the service has been selected; receiving information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control, wherein information received by the multifunction peripheral device from the external computer includes extended mark-up language (XML) data describing content to be displayed on the touch panel display; and updating the touch panel display based on the received information. ### Claim 14 (depends on 13) The at least one non-transitory computer readable medium of claim 13, wherein the information describes the presentation of at least one user interface control to be displayed on the touch panel display, and wherein updating includes updating the touch panel display to display the at least one user interface control according to the presentation description. ### Claim 15 (depends on 14) The at least one non-transitory computer readable medium of claim 14, wherein the information includes at least one processing rule describing one or more operations to be performed when the user activates the at least one user interface control. ### Claim 16 (depends on 13) The at least one non-transitory computer readable medium of claim 13, wherein the method further comprises sending information to the external computer via the network in response to the at least one processing rule. ### Claim 17 (depends on 13) The at least one non-transitory computer readable medium of claim 13, the method comprising: receiving, from the external computer via the network, user specific information to be displayed on the touch panel display, the user specific information describing capabilities available to the specific user; and displaying the available capabilities on the touch panel display. ### Claim 18 At least one non-transitory computer readable medium encoded with a software program that, when executed by a computer, performs a method of communicating between a multifunction peripheral device and a external computer over a network, the multifunction peripheral device comprising a user interface including a touch panel display to display user interface controls that allow a user to access a set of capabilities of the multifunction peripheral device, the method comprising: receiving indication via the user interface that a user has selected a service; communicating to the external computer via the network that the service has been selected; receiving information, provided by the external computer via the network, describing at least one user interface control to be displayed on the touch panel display and/or at least one processing rule for at least one user interface control; updating the touch panel display based on the received information; and receiving, from the external computer, application information capable of, at least in part, controlling the touch panel display to display processing information needed to integrate the multifunction peripheral device with at least one enterprise application.