Information processing apparatus, information processing system, and information processing method

An information processing system comprising:

• an information processing apparatus including a display unit;
• and
• a terminal connectable to the information processing apparatus,
• the terminal including
• an emulated-screen display unit configured to display an emulated screen emulating at least a screen displayed on the display unit and
• a first-input-information transmitting unit configured to transmit first input information indicating an input entered into the emulated screen to the information processing apparatus,
• the information processing apparatus further including
• a storage unit,
• an accepting unit configured to accept any one of an operation based on the first input information and an operation based on second input information indicating an input entered into the screen displayed on the display unit, and
• an association control unit configured to perform control of associating operation information indicating the operation accepted by the accepting unit and an image of a region on the screen displayed on the display unit, the region corresponding to the operation accepted by the accepting unit, into an associated set and storing the associated set in the storage unit,
• wherein the accepting unit includes
• a first-input-information receiving unit configured to receive, from a terminal displaying an emulated screen emulating at least the screen displayed on the display unit, first input information indicating an input entered into the emulated screen, and
• a first identifying unit configured to identify an operation based on the first input information received by the first-input-information receiving unit,
• wherein the association control unit is configured to perform control of associating operation information indicating the operation identified by the first identifying unit with an image of a region on the screen displayed on the display unit, the region corresponding to a region where the operation is performed on the emulated screen, into an associated set and storing the associated set in the storage unit, and
• wherein for each period from when remote support from the terminal is started to when the remote support ends, the remote support being a mode where the information processing apparatus can accept an operation, the association control unit is configured to perform control of storing a set of association information in the storage unit, the association information presenting, in chronological order, one or more associated sets of the operation information indicating the operation identified by the first identifying unit and the image of the region on the screen displayed on the display unit, the region corresponding to the region where the operation identified by the first identifying unit being performed on the emulated screen, and
• an operation control unit configured to perform automatic operation control of
• reading out each image associated with one set, the one set being selectable by a first user, the first user being a user of the information processing apparatus, from among the one or more sets of association information stored in the storage unit in chronological order and
• performing, upon the screen displayed on the display unit containing a region corresponding to the read-out image, an operation indicated by operation information associated with the read-out image.

An information processing method comprising:

• accepting an operation;
• performing association control of associating operation information indicating the operation accepted at the accepting and an image of a region on a screen displayed on a display unit, the region corresponding to the operation accepted at the accepting, into an associated set and storing the associated set in a storage unit,
• wherein the accepting includes
• receiving, from a terminal displaying an emulated screen emulating at least the screen displayed on the display unit, first input information indicating an input entered into the emulated screen, and
• identifying an operation based on the first input information received,
• wherein the performing includes
• performing control of associating operation information indicating the operation identified with an image of a region on the screen displayed on the display unit, the region corresponding to a region where the operation is performed on the emulated screen, into an associated set and storing the associated set in the storage unit,
• wherein for each period from when remote support from the terminal is started to when the remote support ends, the remote support being a mode where the information processing apparatus can accept an operation, performing control of storing a set of association information in the storage unit, the association information presenting, in chronological order, one or more associated sets of the operation information indicating the operation identified and the image of the region on the screen displayed on the display unit, the region corresponding to the region where the operation identified by the first identifying unit being performed on the emulated screen;
• and
• performing automatic operation control of
• reading out each image associated with one set, the one set being selectable by a first user from among the one or more sets of association information stored in the storage unit in chronological order and
• performing, upon the screen displayed on the display unit containing a region corresponding to the read-out image, an operation indicated by operation information associated with the read-out image.