# US 2024/0004593 A1 · Image processing device, and non-transitory computer-readable recording medium therefor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004593 A1
- Document ID: US20240004593A1
- Status: Published application
- Kind: A1
- Application number: 18/345,579
- Filed: 2023-06-30
- Published: 2024-01-04
- Earliest claimed: 2022-07-01
- Assignees: Brother Kogyo Kabushiki Kaisha
- Applicants: Brother Kogyo Kabushiki Kaisha
- Inventors: Yoichi SHIKAI; Masaki KONDO; Kentaro SAWANO; Kohei WATANABE; Takaaki MASUDA; Masayoshi MITA
- Web page: https://patentgrep.com/patent/US20240004593A1

## CPC

- G06F 3/1208: {resulting in improved quality of the output result, e.g. print layout, colours, workflows, print preview}
- G06F 3/1242: {Image or content composition onto a page}
- G06F 3/1253: {Configuration of print job parameters, e.g. using UI at the client}
- G06F 3/1256: {User feedback, e.g. print preview, test print, proofing, pre-flight checks}
- G06K 15/1885: {for modifying the layout of a document}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS

## Abstract

An image processing device performs, multiple times a candidate displaying process of displaying one or more candidate images on a display, each of the one or more candidate images being a candidate of the print image, and an evaluation obtaining process of obtaining image evaluation information representing evaluation of each of the one or more candidate images displayed on the display, the image evaluation information being information based on a user input. In the candidate displaying process performed a second time or later is a process of determining the one or more candidate images based on the image evaluation information and displaying the same on the display. The image processing device determines the print image based on at least part of a multiple candidate images and at least part of multiple pieces of the image evaluation information.

## Claims

### Claim 1

A non-transitory computer-readable recording medium for an image processing device which includes a computer, the non-transitory computer-readable recording medium containing computer-executable instructions, the instructions causing, when executed by the computer, the image processing device to perform:
a print image determining process of determining a print image to be printed;
a print data generating process of generating print data indicating the determined print image; and
a print controlling process of causing a print engine to execute printing according to the print data,
wherein, in the print image determining process, the image processing device performs, multiple times:
a candidate displaying process of displaying one or more candidate images on a display, each of the one or more candidate images being a candidate of the print image; and
an evaluation obtaining process of obtaining image evaluation information representing evaluation of each of the one or more candidate images displayed on the display, the image evaluation information being information based on a user input,
wherein the candidate displaying process performed a second time or later is a process of determining the one or more candidate images based on the image evaluation information and displaying the determined one or more candidate images on the display, and
wherein the print image determining process determines the print image based on at least part of multiple candidate images displayed in the candidate displaying process performed over multiple times and at least part of multiple pieces of the image evaluation information obtained in the evaluation obtaining process performed over multiple times.

### Claim 2 (depends on 1)

The non-transitory computer-readable recording medium according to claim 1, the instructions further causing, when executed by the computer, the image processing device to perform:
a content obtaining process of obtaining one or more pieces of content data indicating a content;
an expression information obtaining process of obtaining the content data and the multiple pieces of expression information; and
a candidate image generating process of generating multiple pieces of candidate image data indicating the multiple candidate images, respectively, with using the content data and the multiple pieces of expression information,
wherein the candidate displaying process is a process of displaying the multiple candidate images on the display with using the multiple pieces of candidate image data, respectively.

### Claim 3 (depends on 2)

The non-transitory computer-readable recording medium according to claim 2,
wherein the content data includes at least one of image data indicating an image as the content or text data indicating text as the content.

### Claim 4 (depends on 3)

The non-transitory computer-readable recording medium according to claim 3,
wherein the content data includes first content data indicating a first content and second content data indicating a second content,
wherein the expression information includes layout information defining a layout of multiple contents, and
wherein the candidate image generating process generates the candidate image data indicating the candidate image in which a first content image expressing the first content and a second content image expressing the second content arranged according to the layout defined by the layout information.

### Claim 5 (depends on 2)

The non-transitory computer-readable recording medium according to claim 2,
wherein the expression information includes style image data indicating a style image expressed in a particular style,
wherein, in the candidate image generating process, the image processing device executes a style converting process using the style image data to generate converted image data indicating a converted image in which the content is represented in the particular style.

### Claim 6 (depends on 5)

The non-transitory computer-readable recording medium according to claim 5,
wherein, in the candidate image generating process, the image processing device performs:
the style converting process multiple times using the multiple pieces of the style image data different from each other with respect to single content data to generate multiple pieces of the converted image data indicating multiple converted images, respectively; and
generating multiple pieces of the candidate image data using the multiple pieces of the converted image data, and
wherein the instructions further causing, when executed by the computer, the image processing device to perform:
a style evaluation obtaining process of obtaining style evaluation information on evaluation of the style image data, the style evaluation information being information based on user input; and
a style changing process of changing at least a part of the style image data to be used in the style converting process based on the style evaluation information.

### Claim 7 (depends on 5)

The non-transitory computer-readable recording medium according to claim 5,
wherein, in the style converting process, the image processing device generates another style image data to be used in the style converting process by combining multiple pieces of style image data of which evaluation based on the style evaluation information is higher than standard.

### Claim 8 (depends on 6)

The non-transitory computer-readable recording medium according to claim 6,
wherein, in the style evaluation obtaining process, the image processing device obtains the image evaluation information indicating evaluation of the candidate image as the style evaluation information indicating evaluation of the style image data used to generate the candidate image data.

### Claim 9 (depends on 1)

The non-transitory computer-readable recording medium according to claim 1,
wherein the candidate displaying process is a process of determining less-than-m candidate images from among m images and displaying the determined less-than-m candidate images on the display, the m being an integer greater than or equal to 2,
wherein the candidate displaying process performed a second time or later is a process of:
calculating an evaluation value for at least part of the m images using the image evaluation information obtained in the evaluation obtaining process previously performed;
determining less-than-m candidate images from among the m images again using the evaluation value; and
displaying the determined less-than-m candidate images on the display.

### Claim 10 (depends on 1)

The non-transitory computer-readable recording medium according to claim 1,
wherein the candidate displaying process is a process of:
selecting m candidate images from among M images by executing a particular selecting process independent of user input, the M being an integer greater than or equal to 3, m being an integer greater than or equal to 2 and less than M;
determining less-than-m candidate images from among the selected m images; and
displaying the determined less-than-m candidate images on the display.

### Claim 11 (depends on 10)

The non-transitory computer-readable recording medium according to claim 10,
wherein the particular selecting process is a process of:
obtaining evaluation data of the M images by using a machine learning model trained to output the evaluation data representing a result of evaluating an image indicated by an image data when the image data is input; and
selecting the m image based on the evaluation data of the obtained M images.

### Claim 12

An image processing device comprising:
a print engine configured to print an image; and
a controller configured to perform:
a print image determining process of determining a print image to be printed;
a print data generating process of generating print data indicating the determined print image; and
a print controlling process of causing the print engine to execute printing according to the print data,
wherein, in the print image determining process, the controller performs, multiple times:
a candidate displaying process of displaying one or more candidate images on a display, each of the one or more candidate images being a candidate of the print image; and
an evaluation obtaining process of obtaining image evaluation information representing evaluation of each of the one or more candidate images displayed on the display, the image evaluation information being information based on a user input,
wherein the candidate displaying process performed a second time or later is a process of determining the one or more candidate images based on the image evaluation information and displaying the determined one or more candidate images on the display, and
wherein, in the print image determining process, the controller determines the print image based on at least part of multiple candidate images displayed in the candidate displaying process performed over multiple times and at least part of multiple pieces of the image evaluation information obtained in the evaluation obtaining process performed over multiple times.
