# US 2017/0285905 A1 · Information processing device, and method and computer-readable medium therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285905 A1
- Document ID: US20170285905A1
- Status: Published application
- Kind: A1
- Application number: 15/461,564
- Filed: 2017-03-17
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: Brother Kogyo Kabushiki Kaisha
- Applicants: Brother Kogyo Kabushiki Kaisha
- Inventors: Hirokazu SATO
- Web page: https://patentgrep.com/patent/US20170285905A1

## CPC

- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/0416: {Control or interface arrangements specially adapted for digitisers}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An information processing device includes a controller configured to display a closed frame line for specifying a particular range for image processing, the frame line having positioning points placed thereon, display object images in respective positions associated with the positioning points, when a selected one of the object images is of a second type, in response to a touch intensity for bringing an indicator in touch with or in proximity to the selected object image on a touch panel being more than a threshold, change the type of the selected object image to a first type, whereas when the selected object image is of the first type, in response to a particular condition being satisfied in detection of the indicator in touch with or in proximity to the selected object image, change the type of the selected object image to the second type.

## Claims

### Claim 1

An information processing device comprising:
a display;
a touch panel; and
a controller configured to perform:
a first display process comprising:
controlling the display to display a closed frame line for specifying a particular range, the frame line having a plurality of positioning points placed thereon;
a second display process comprising:
controlling the display to display a plurality of object images in respective positions associated with the plurality of positioning points, each object image being configured to accept an operation to move a corresponding one of the positioning points;
a first storing process comprising:
controlling a storage to store type information representing whether each of the object images is of a first type or a second type;
a first detecting process comprising:
when an indicator is brought in touch with or in proximity to a display area for a selected one of the object images, controlling the touch panel to detect a first indication position and a touch intensity, the first indication position representing a position which the indicator is brought in touch with or in proximity to within the display area for the selected object image, the touch intensity representing a pressing force applied onto the touch panel when the indicator is brought in touch with or in proximity to the display area for the selected object image;
a second storing process comprising:
when the selected object image is of the second type, in response to the detected touch intensity being more than a first threshold, changing a type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image;
a second detecting process comprising:
after the first indication position is detected by the touch panel, when the indicator moves to a second indication position while being kept in touch with or in proximity to the touch panel, controlling the touch panel to detect the second indication position;
a first positioning process comprising:
setting a specific display position to a position corresponding to the second indication position, the specific display position being a display position of a selected positioning point associated with the selected object image, of the plurality of positioning points;
a third display process comprising:
controlling the display to redisplay the frame line by putting the selected positioning point in the specific display position;
a fourth display process comprising:
controlling the display to redisplay the selected object image in the second indication position; and
a third storing process comprising:
after the first indication position is detected by the touch panel, when the selected object image is of the first type, in response to a particular condition being satisfied in detection of the indicator in touch with or in proximity to the touch panel, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 2 (depends on 1)

The information processing device according to claim 1,
wherein the controller is further configured to perform:
a first determining process comprising:
determining whether the selected object image is of the first type or the second type;
the second storing process comprising:
when determining that the selected object image is of the second type, in response to the touch intensity being more than the first threshold, changing the type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image; and
the third storing process comprising:
when determining that the selected object image is of the first type, in response to the touch intensity being more than a second threshold, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 3 (depends on 1)

The information processing device according to claim 1,
wherein the controller is further configured to perform:
the third storing process comprising:
after the first indication position is detected by the touch panel, in response to the indicator in touch with or in proximity to the touch panel becoming undetected, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 4 (depends on 1)

The information processing device according to claim 1,
wherein the controller comprises:
a processor; and
a memory storing processor-executable instructions configured to, when executed by the processor, cause the processor to perform:
the first display process;
the second display process;
the first storing process;
the first detecting process;
the second storing process;
the second detecting process;
the first positioning process;
the third display process;
the fourth display process; and
the third storing process.

### Claim 5

A method implementable on a processor connected with a display, a touch panel, and a storage, the method comprising:
a first display process comprising:
controlling the display to display a closed frame line for specifying a particular range, the frame line having a plurality of positioning points placed thereon;
a second display process comprising:
controlling the display to display a plurality of object images in respective positions associated with the plurality of positioning points, each object image being configured to accept an operation to move a corresponding one of the positioning points;
a first storing process comprising:
controlling the storage to store type information representing whether each of the object images is of a first type or a second type;
a first detecting process comprising:
when an indicator is brought in touch with or in proximity to a display area for a selected one of the object images, controlling the touch panel to detect a first indication position and a touch intensity, the first indication position representing a position which the indicator is brought in touch with or in proximity to within the display area for the selected object image, the touch intensity representing a pressing force applied onto the touch panel when the indicator is brought in touch with or in proximity to the display area for the selected object image;
a second storing process comprising:
when the selected object image is of the second type, in response to the detected touch intensity being more than a first threshold, changing a type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image;
a second detecting process comprising:
after the first indication position is detected by the touch panel, when the indicator moves to a second indication position while being kept in touch with or in proximity to the touch panel, controlling the touch panel to detect the second indication position;
a first positioning process comprising:
setting a specific display position to a position corresponding to the second indication position, the specific display position being a display position of a selected positioning point associated with the selected object image, of the plurality of positioning points;
a third display process comprising:
controlling the display to redisplay the frame line by putting the selected positioning point in the specific display position;
a fourth display process comprising:
controlling the display to redisplay the selected object image in the second indication position; and
a third storing process comprising:
after the first indication position is detected by the touch panel, when the selected object image is of the first type, in response to a particular condition being satisfied in detection of the indicator in touch with or in proximity to the touch panel, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising:
a first determining process comprising:
determining whether the selected object image is of the first type or the second type,
wherein the second storing process comprises:
when determining that the selected object image is of the second type, in response to the touch intensity being more than the first threshold, changing the type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image, and
wherein the third storing process comprises:
when determining that the selected object image is of the first type, in response to the touch intensity being more than a second threshold, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 7 (depends on 5)

The method according to claim 5,
wherein the third storing process comprises:
after the first indication position is detected by the touch panel, in response to the indicator in touch with or in proximity to the touch panel becoming undetected, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 8

A non-transitory computer-readable medium storing computer-readable instructions that are executable by a processor connected with a display, a touch panel, and a storage, the instructions being configured to, when executed by the processor, cause the processor to perform:
a first display process comprising:
controlling the display to display a closed frame line for specifying a particular range, the frame line having a plurality of positioning points placed thereon;
a second display process comprising:
controlling the display to display a plurality of object images in respective positions associated with the plurality of positioning points, each object image being configured to accept an operation to move a corresponding one of the positioning points;
a first storing process comprising:
controlling the storage to store type information representing whether each of the object images is of a first type or a second type;
a first detecting process comprising:
when an indicator is brought in touch with or in proximity to a display area for a selected one of the object images, controlling the touch panel to detect a first indication position and a touch intensity, the first indication position representing a position which the indicator is brought in touch with or in proximity to within the display area for the selected object image, the touch intensity representing a pressing force applied onto the touch panel when the indicator is brought in touch with or in proximity to the display area for the selected object image;
a second storing process comprising:
when the selected object image is of the second type, in response to the detected touch intensity being more than a first threshold, changing a type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image;
a second detecting process comprising:
after the first indication position is detected by the touch panel, when the indicator moves to a second indication position while being kept in touch with or in proximity to the touch panel, controlling the touch panel to detect the second indication position;
a first positioning process comprising:
setting a specific display position to a position corresponding to the second indication position, the specific display position being a display position of a selected positioning point associated with the selected object image, of the plurality of positioning points;
a third display process comprising:
controlling the display to redisplay the frame line by putting the selected positioning point in the specific display position;
a fourth display process comprising:
controlling the display to redisplay the selected object image in the second indication position; and
a third storing process comprising:
after the first indication position is detected by the touch panel, when the selected object image is of the first type, in response to a particular condition being satisfied in detection of the indicator in touch with or in proximity to the touch panel, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the instructions are further configured to, when executed by the processor, cause the processor to perform:
a first determining process comprising:
determining whether the selected object image is of the first type or the second type;
the second storing process comprising:
when determining that the selected object image is of the second type, in response to the touch intensity being more than the first threshold, changing the type represented by the type information of the selected object image from the second type to the first type and controlling the storage to store the changed type information of the selected object image; and
the third storing process comprising:
when determining that the selected object image is of the first type, in response to the touch intensity being more than a second threshold, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the third storing process comprises:
after the first indication position is detected by the touch panel, in response to the indicator in touch with or in proximity to the touch panel becoming undetected, changing the type represented by the type information of the selected object image from the first type to the second type and controlling the storage to store the changed type information of the selected object image.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein each of the second display process and the fourth display process comprises:
controlling the display to display an object image of the first type in a first display mode and display an object image of the second type in a second display mode different from the first display mode.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein each of the second display process and the fourth display process comprises:
controlling the display to display each of the object images in a specific position close to a corresponding one of the positioning points, in such a manner as not to overlap the frame line.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the instructions are further configured to, when executed by the processor, cause the processor to perform:
a fifth display process comprising:
controlling the display to display an acceptor image for accepting an instruction to begin to perform image processing;
a third detecting process comprising:
controlling the touch panel to detect the indicator in touch with or in proximity to a display area for the acceptor image; and
an image processing execution process comprising:
performing the image processing for an image within the particular range specified by the frame line displayed at a point of time when the touch panel detects the indicator in touch with or in proximity to the display area for the acceptor image.

### Claim 14 (depends on 13)

The non-transitory computer-readable medium according to claim 13,
wherein the instructions are further configured to, when executed by the processor, cause the processor to perform the image processing execution process even when the touch panel detects the indicator in touch with or in proximity to the display area for the acceptor image without execution of the second detecting process, the first positioning process, the third display process, or the fourth display process.

### Claim 15 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the frame line forms a polygonal shape, and
wherein each of the positioning points is placed on a corresponding one of vertices of the polygonal shape formed by the frame line.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium according to claim 15,
wherein each of one or more positioning points, among the plurality of positioning points, is placed on a side connecting two adjacent vertices of the polygonal shape, and
wherein the third display process comprises:
controlling the display to redisplay a particular side of the polygonal shape parallel to the particular side displayed in the first display process, the particular side passing through the selected positioning point.

### Claim 17 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the display comprises a first area and a second area,
wherein a distance between the first area and a user of the processor is shorter than a distance between the second area and the user, and
wherein the first threshold used when the first indication position is detected within the first area is higher than the first threshold used when the first indication position is detected within the second area.

### Claim 18 (depends on 9)

The non-transitory computer-readable medium according to claim 9,
wherein the instructions are further configured to, when executed by the processor, cause the processor to perform:
a second determining process comprising:
determining whether the touch intensity is more than a third threshold, the third threshold being different from the first threshold and the second threshold;
a third detecting process comprising:
after determining that the touch intensity is more than the third threshold, when the indicator moves to a third indication position while being kept in touch with or in proximity to the touch panel, controlling the touch panel to detect the third indication position; and
a fifth display process comprising:
controlling the display to redisplay the selected object image in the third indication position.

### Claim 19 (depends on 8)

The non-transitory computer-readable medium according to claim 8,
wherein the first threshold is equal to the second threshold.

### Claim 20 (depends on 10)

The non-transitory computer-readable medium according to claim 10,
wherein the instructions are further configured to, when executed by the processor, cause the processor to perform:
a determining process comprising:
determining whether the touch intensity is more than a second threshold, the second threshold being different from the first threshold;
a third detecting process comprising:
after determining that the touch intensity is more than the second threshold, when the indicator moves to a third indication position while being kept in touch with or in proximity to the touch panel, controlling the touch panel to detect the third indication position; and
a fifth display process comprising:
controlling the display to redisplay the selected object image in the third indication position.
