Apparatus, system and method for controlling an image processing device via a mobile device

A method for controlling an image processing device comprising:

• generating a graphical user interface including at least one image element enabling receipt of a data value of a particular type therein, the graphical user interface being generated in response to selecting a processing job to be performed by the image processing device;
• mirroring the generated graphical user interface on a mobile computing device by transmitting a form object data describing a structure of the graphical user interface including the at least one image element and the particular type of data to be received within the graphical user interface to a mobile computing device via a short distance communication protocol, the form data object being used by the mobile computing device to render the graphical user interface on the mobile computing device;
• receive a return data object, via the short distance communication protocol, including data describing a modified graphical user interface including the at least one image element having the data value of the particular type, the data value having been input using mobile computing device;
• and
• executing the processing job to generate job data and automatically associating the data value derived from the modified graphical user interface with the generated job data.

A mobile computing device comprising

• one or more processors;
• and
• a memory coupled to the one or more processors, the memory including instructions stored therein that, when executed by the one or more processors, cause the one or more processors to
• receive a form data object generated by an image processing device using a short distance communication protocol, the form data object includes data describing a form displayed in a graphical user interface of an image processing device, the form data object including configuration data used to render, on the mobile computing device, a mobile device user interface including at least one image element have a particular data type associated therewith;
• parse the form data object to determine a type of data associated with the at least one image element;
• select a function executed by the mobile computing device for inputting a data value corresponding to the determined type of data;
• generate, by rendering on the mobile computing device, the mobile user interface based on the form data object and including the selected function enabling receipt of the data value input by a user of the mobile computing device;
• create a return data object describing the at least one image element and including the data value entered by the user via the selected function;
• and
• transmit the return data object, via the short distance communication protocol, to the image processing device enabling completion of the form graphical user interface using the data value entered via the mobile computing device.

The mobile computing device 11, wherein

• the type of data included in the form data object indicates that the type of data is to be acquired by an external application executing on the mobile device;
• and the instructions, when executed by the one or more processors cause the one of more processors to
• query a mobile operating system for at least one external application able to provide the particular type of data;
• and
• generate an external application image element for inclusion in the mobile user interface, the external application image element being selectable by a user and enables launch of the external application directly from within the mobile user interface.

A method of controlling the operation of a mobile computing device comprising:

• receiving a form data object generated by an image processing device using a short distance communication protocol, the form data object including data describing a form displayed in a graphical user interface of an image processing device, the form data object including configuration data used to render, on the mobile computing device, a mobile device user interface including at least one image element have a particular data type associated therewith;
• parsing the form data object to determine a type of data associated with the at least one image element;
• selecting a function executed by the mobile computing device for inputting a data value corresponding to the determined type of data;
• generating, by rendering on the mobile computing device, the mobile user interface based on the form data object and including the selected function enabling receipt of the data value input by a user of the mobile computing device;
• creating a return data object describing the at least one image element and including the data value entered by the user via the selected function;
• and
• transmitting the return data object, via the short distance communication protocol, to the image processing device enabling completion of the form graphical user interface using the data value entered via the mobile computing device.

A system for inputting data values into a form displayed on an image processing device using a mobile computing device, the system comprising

• an image processing device that
• generates a graphical user interface including at least one image element enabling receipt of a data value of a particular type therein, the graphical user interface being generated in response to selecting a processing job to be performed by the image processing device and mirrors the generated graphical user interface on the mobile computing device by transmitting form object data describing a structure of the graphical user interface including the at least one image element and the particular type of data to be received within the graphical user interface to the mobile computing device via a short distance communication protocol, the form object data being used by the mobile computing device to render the graphical user on the mobile computing device;
• and
• a mobile computing device that
• receives the form object data describing the graphical user interface via the short distance communication protocol from the image processing device,
• parses the data representing the graphical user interface to determine a type of data associated with the at least one image element;
• selects a function executed by the mobile computing device for inputting a data value corresponding to the determined type of data;
• generates, by rendering on the mobile computing device, the mobile user interface based on the form data object and including the selected function enabling receipt of the data value input by a user of the mobile computing device;
• creates a return data object describing the at least one image element and including the data value entered by the user via the selected function;
• and
• transmits the return data object, via the short distance communication protocol, to the image processing device, wherein
• in response to receiving the return data object via the short distance communication protocol, the data values entered via the mobile computing device complete the at least one image element using and the image processing device initiates execution of the processing job to generate job data and automatically associates the data value derived from the modified graphical user interface with the generated job data.