Cooperative image processing system, cooperative image processing method, portable terminal apparatus, image processing apparatus, and recording medium

A cooperative image processing method to be implemented by a cooperative image processing system comprising an image processing apparatus and a portable terminal apparatus capable of connecting to each other, the cooperative image processing method comprising:

• the following steps of the image processing apparatus:
• obtaining screen data for reproducing a first operation screen that allows operating the portable terminal apparatus, from the portable terminal apparatus;
• displaying a second operation screen that allows operating the image processing apparatus and displaying the first operation screen based on the screen data obtained from the portable terminal apparatus, together on a first display portion;
• transmitting to the portable terminal apparatus operation information when the first operation screen is operated on the first display portion;
• and
• storing on a memory, a cooperation table that contains a list of operations that can be performed on the first operation screen and a plurality of potential next second operations to be displayed in a next second operation screen that allows operating the image processing apparatus, each of the potential next second operations being listed in the cooperation table corresponding to a respective one of the operations on the list of operations on the first operation screen, each of the potential next second operations being dependent on the first operation screen;
• and
• the following steps of the portable terminal apparatus:
• obtaining screen data for reproducing the second operation screen, from the image processing apparatus;
• displaying the first operation screen and displaying the second operation screen based on the screen data obtained from the image processing apparatus, together on a second display portion;
• and
• transmitting to the image processing apparatus operation information when the second operation screen is operated on the second display portion;
• when an operation is operated on the first operation screen on the first display portion or on the second display portion, transmitting a notification of the operation to the image processing apparatus,
• wherein the cooperative image processing method further comprises the following step of the image processing apparatus:
• when the image processing apparatus receives the notification from the portable terminal apparatus, identifying one of the potential next second operations as corresponding to the operation among those in the cooperation table;
• and
• displaying the next second operation screen corresponding to the identified one potential next second operation on the first display portion;
• wherein when there is more than one suitable second operation screen for more than one potential next second operation or only one potential next second operation identified, displaying the second operation screen to one of the more than one suitable second operation screens while displaying call buttons for calling the other suitable second operation screens onto the first display portion of the image processing apparatus in place of a present suitable second operation screen after the operation on the first operation screen.

An image processing apparatus comprising:

• a connector that connects to a portable terminal apparatus;
• a first display portion;
• a first processor executes instructions to control functions of:
• a first screen data obtaining portion that obtains screen data for reproducing a first operation screen that allows operating the portable terminal apparatus, from the portable terminal apparatus;
• a first display controller that displays a second operation screen that allows operating the image processing apparatus and displays the first operation screen based on the screen data obtained by the first screen data obtaining portion, together on the first display portion;
• a transmitter that transmits to the portable terminal apparatus operation information when the first operation screen is operated on the first display portion;
• a memory that stores a cooperation table that contains a list of operations that can be performed on the first operation screen and a plurality of potential next second operations to be displayed in a next second operation screen that allows operating the image processing apparatus, each of the potential next second operations being listed in the cooperation table corresponding to a respective one of the operations on the list of operations on the first operation screen, each of the potential next second operations being dependent on the first operation screen;
• the first processor executes instructions to further control the functions of:
• an operation identification portion that, when the image processing apparatus receives a notification of an operation operated on the first operation screen on the first display portion or on a second display portion from the portable terminal apparatus, identifies one of the potential next second operations as corresponding to the operation among those in the cooperation table;
• and
• a switch portion that displays the next second operation screen corresponding to the one potential next second operation identified by the operation identification portion on the first display portion;
• wherein when there is more than one suitable second operation screen for more than one potential next second operation or only one potential next second operation identified, the switch portion of the image processing apparatus displays the second operation screen to one of the more than one suitable operation screens while displaying call buttons for calling the other suitable second operation screens onto the first display portion of the image processing apparatus in place of a present suitable second operation screen after the operation on the first operation screen.

A non-transitory computer-readable recording medium with a cooperation program being stored thereon to make a computer of an image processing apparatus execute:

• connecting to a portable terminal apparatus;
• obtaining screen data for reproducing a first operation screen that allows operating the portable terminal apparatus, from the portable terminal apparatus displaying a second operation screen that allows operating the image processing apparatus and displaying the first operation screen based on the screen data obtained from the portable terminal apparatus, together on a first display portion;
• transmitting to the portable terminal apparatus operation information when the first operation screen is operated on the first display portion;
• storing on a memory, a cooperation table that contains a list of operations that can be performed on the first operation screen and a plurality of potential next second operations to be displayed in a next second operation screen that allows operating the image processing apparatus, each of the potential next second operations being listed in the cooperation table corresponding to a respective one of the operations on the list of operations on the first operation screen, each of the potential next second operations being dependent on the first operation screen;
• when the image processing apparatus receives a notification of an operation operated on the first operation screen on the first display portion or on a second display portion from the portable terminal apparatus, identifying one of the potential next second operations as corresponding to the operation among those in the cooperation table;
• and displaying the next second operation screen corresponding to the identified one potential next second operation on the first display portion;
• wherein when there is more than one suitable second operation screen for more than one potential next second operation or only one potential next second operation identified, displaying the second operation screen to one of the more than one suitable second operation screens while displaying call buttons for calling the other suitable second operation screens onto the first display portion of the image processing apparatus in place of a present suitable second operation screen after the operation on the first operation screen.