# US 2015/0146226 A1 · Image forming apparatus, display method for an operation screen, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146226 A1
- Document ID: US20150146226A1
- Status: Published application
- Kind: A1
- Application number: 14/552,640
- Filed: 2014-11-25
- Published: 2015-05-28
- Earliest claimed: 2013-11-27
- Assignees: Konica Minolta, Inc.
- Applicants: Konica Minolta Inc.
- Inventors: Shohei Ichiyama; Yoichi Kurumasa; Toshihisa Motosugi; Mie Kawabata; Hiroaki Sugimoto
- Web page: https://patentgrep.com/patent/US20150146226A1

## CPC

- H04N 1/00506: {Customising to the data to be displayed}
- H04N 1/00381: {Input by recognition or interpretation of visible user gestures (manual input means, e.g. digitisers, writing tablets H04N1/00392; gesture input to computers G06F3/017; recognition algorithms G06V40/20)}
- H04N 1/00411: {the display also being used for user input, e.g. touch screen}
- H04N 1/00474: {outputting a plurality of functional options, e.g. scan, copy or print}
- H04N 1/0049: {providing a visual indication to the user, e.g. using a lamp (H04N1/00408 takes precedence)}
- H04N 1/00949: {Combining applications, e.g. to create workflows (allocation of computer machine resources considering the execution order of a plurality of tasks G06F9/5038)}
- H04N 1/00954: {Scheduling operations or managing resources (H04N1/0096 takes precedence; program initiating or switching G06F9/48; allocation of computer resources G06F9/50)}
- H04N 2201/0094: Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image forming apparatus includes a display and a touch panel, and is provided with a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation, and the image forming apparatus includes a controller configured to determine a gesture represented by a series of touch events, store gesture log data and touch event log data to a storage unit, and determine display control processing. In the normal mode, the display control processing is determined on the basis of the gesture or an object. In the play back mode, the display control processing is determined on the basis of the gesture log data or the touch event log data. The determined display control processing is executed.

## Claims

### Claim 1

An image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation,
the image forming apparatus comprising a controller configured to;
determine a gesture represented by the series of touch events every time a series of touch events is performed on a first area of the touch panel in the normal mode;
store gesture log data representing the gesture determined and touch event log data representing the series of touch events performed on a second area of the touch panel to a storage unit;
determine display control processing for displaying an operation screen on the display,
wherein in the normal mode,
a) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture determined, and
b) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of an object at a position where the series of touch events is performed, and
wherein in the play back mode,
c) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture log data, and
d) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of the touch event log data; and
execute the determined display control processing.

### Claim 2 (depends on 1)

The image forming apparatus according to claim 1, wherein the gesture log data further indicates a first time at which the gesture is performed, and the touch event log data further indicates a second time at which the series of touch events is performed, and
in the play back mode, the display control processing is performed on the basis of the first time and the second time.

### Claim 3 (depends on 1)

The image forming apparatus according to claim 1, wherein the storage unit is a storage unit configured to store an operation log possessed by the image forming apparatus.

### Claim 4 (depends on 1)

The image forming apparatus according to claim 1, wherein the storage unit is a portable storage medium.

### Claim 5 (depends on 1)

The image forming apparatus according to claim 1, wherein the storage unit is a server.

### Claim 6

An image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation,
the image forming apparatus comprising a controller configured to;
determine a gesture represented by the series of touch events every time a series of touch events is performed on the touch panel in the normal mode;
obtain gesture log data representing the gesture represented by the series of touch events performed on a second touch panel of another image forming apparatus;
determine display control processing for displaying an operation screen on the display, on the basis of the determined gesture log and the obtained gesture log data,
wherein
e) in the normal mode, the display control processing is determined on the basis of the determined gesture,
f) in the play back mode, the display control processing is determined on the basis of the obtained gesture log data; and
execute the determined display control processing.

### Claim 7 (depends on 1)

The image forming apparatus according to claim 1, wherein the gesture log data are obtained from a portable storage medium.

### Claim 8 (depends on 1)

The image forming apparatus according to claim 1, wherein the gesture log data are obtained from a server.

### Claim 9

A storage medium including a computer program that can be executed by an image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation,
the storage medium causing the image forming apparatus to:
execute determination processing for determining, every time a series of touch events is performed on a first area of the touch panel in the normal mode, a gesture represented by the series of touch events;
execute storage processing for storing, to a storage unit, gesture log data representing the gesture determined and touch event log data representing the series of touch events performed on a second area of the touch panel;
execute determination processing for determining display control processing for displaying an operation screen on the display,
wherein in the normal mode,
a) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture determined, and
b) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of an object at a position where the series of touch events is performed, and
wherein in the play back mode,
c) in a case where the series of touch events is performed on the first area, the display control processing is determined on the basis of the gesture log data, and
d) in a case where the series of touch events is performed on the second area, the display control processing is determined on the basis of the touch event log data; and
execute the display control processing determined in the determination processing.

### Claim 10

A non-transitory recording medium storing a computer readable program used for an image forming apparatus comprising a display and a touch panel provided on a display surface of the display, the image forming apparatus comprising a normal mode in which processing is performed every time operation is performed with the touch panel and a play back mode in which processing is performed on the basis of recording of the operation,
the non-transitory recording medium storing a computer readable program causing the image forming apparatus to:
execute determination processing for determining, every time a series of touch events is performed on the touch panel in the normal mode, a gesture represented by the series of touch events,
execute obtaining processing for obtaining gesture log data representing the gesture represented by the series of touch events performed on a second touch panel of another image forming apparatus
execute determination processing for determining display control processing for displaying an operation screen on the display,
wherein in the determination processing,
e) in the normal mode, the display control processing is determined on the basis of the determined gesture,
f) in the play back mode, the display control processing is determined on the basis of the obtained gesture log data; and
execute the display control processing determined in the determination processing.
