# US 2020/0402197 A1 · Image processing apparatus, image processing method, and computer readable medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402197 A1
- Document ID: US20200402197A1
- Status: Published application
- Kind: A1
- Application number: 17/010,950
- Filed: 2020-09-03
- Published: 2020-12-24
- Earliest claimed: 2018-09-18
- Assignees: Fuji Xerox Co., Ltd.; FUJIFILM Corporation
- Applicants: Fuji Xerox Co., Ltd.; FUJIFILM Corporation
- Inventors: Takashi NAGAO; Kazuyuki ITAGAKI
- Web page: https://patentgrep.com/patent/US20200402197A1

## CPC

- G06F 9/5033: {considering data affinity}
- G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining
- G06F 2209/5017: Task decomposition
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

An image processing apparatus for executing partial processes on each of plural image-section data items, corresponding to plural image sections obtained by dividing an input image into partial regions, in each object of an object group in which plural objects for executing image processing is connected in a directed acyclic graph form, the image processing apparatus includes a processor configured to: assign dependency relationships to the partial processes between the objects; assign a priority to a partial process of an object arranged in a terminal stage of the object group; assign, as a priority of a partial process of an object arranged at a pre-stage side which has at least one partial process that is connected at a post-stage side and that has the dependency relationship assigned, a largest value of the priority; and execute a partial process having become executable according to the dependency relationship, according to the priority.

## Claims

### Claim 1

An image processing apparatus for executing partial processes on each of a plurality of image-section data items, corresponding to a plurality of image sections obtained by dividing an input image into partial regions, in each object of an object group in which a plurality of objects for executing image processing is connected to one another in a directed acyclic graph form, the image processing apparatus comprising a processor configured to:
assign dependency relationships to the partial processes between the objects connected;
assign a priority to a partial process of an object arranged in a terminal stage of the object group;
assign, as a priority of a partial process of an object arranged at a pre-stage side which has at least one partial process that is connected at a post-stage side and that has the dependency relationship assigned, a largest value of the priority assigned to the at least one partial process that is connected at the post-stage side and that has the dependency relationship assigned; and
execute a partial process having become executable according to the dependency relationship, according to the priority assigned.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein,
when assigning the priority to the partial process of the object arranged in the terminal stage, the processor assigns a higher priority to a partial process of processing an image-section data item representing an image section to be positioned on an upper side of an output image as seen in a front view, than to a partial process of processing an image-section data item representing an image section to be positioned on a lower side of the output image as seen in the front view.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein,
in a case where there is a plurality of objects arranged in the terminal stage in the object group, the processor assigns priorities such that image processing is executed in order in units of the objects, or assigns priorities such that the partial processes of the objects are executed in turn between the objects, in assigning priorities to the partial processes of the plurality of objects arranged in the terminal stage.

### Claim 4 (depends on 2)

The image processing apparatus according to claim 2, wherein
in a case where there is a plurality of objects arranged in the terminal stage in the object group, the processor assigns priorities such that image processing is executed in order in units of the objects, or assigns priorities such that the partial processes of the objects are executed in turn between the objects, in assigning priorities to the partial processes of the plurality of objects arranged in the terminal stage.

### Claim 5 (depends on 3)

The image processing apparatus according to claim 3, wherein
the processor is configured to select whether to assign priorities such that the image processing is executed in order in units of the objects or to assign priorities such that the partial processes of the objects are executed in turn between the objects.

### Claim 6 (depends on 4)

The image processing apparatus according to claim 4, wherein
the processor is configured to select whether to assign priorities such that the image processing is executed in order in units of the objects or to assign priorities such that the partial processes of the objects are executed in turn between the objects.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 8 (depends on 2)

The image processing apparatus according to claim 2, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 9 (depends on 3)

The image processing apparatus according to claim 3, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 10 (depends on 4)

The image processing apparatus according to claim 4, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 11 (depends on 5)

The image processing apparatus according to claim 5, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 12 (depends on 6)

The image processing apparatus according to claim 6, wherein
the processor is configured not to assign a priority, or to assign a predetermined priority representing that the partial processes do not need to be executed, to a partial process to which a partial process having no dependency relationship assigned is connected on the post-stage side, and
the processor excludes the partial process having no priority assigned or the partial processes having the predetermined priority assigned, from a processing target.

### Claim 13 (depends on 1)

The image processing apparatus according to claim 1, wherein,
in a case where there is a plurality of executable partial processes having a same priority, the processor obtains, with respect to each of the plurality of executable partial processes having the same priority, at least one of:
a first number that is the number of partial processes which depend on a corresponding executable partial process, which become executable after execution of the corresponding partial process is completed, and which have the same priority as the corresponding partial process has,
a second number that is the number of partial processes which depend on the corresponding partial process, which do not become executable after the execution of the corresponding partial process is completed, and which have the same priority as the corresponding partial process has,
a third number that is the number of partial processes which depend on the corresponding partial process, which become executable after the execution of the corresponding partial process is completed, and which have priorities lower than a priority of the corresponding partial process, and
a fourth number that is the number of partial processes which depend on the corresponding partial process, which do not become executable after the execution of the corresponding partial process is completed, and which have priorities lower than the priority of the corresponding partial process, and
the processor executes a partial process having a largest number as the first number, the second number, the third number, or the fourth number obtained, among the plurality of executable partial processes having the same priority.

### Claim 14 (depends on 13)

The image processing apparatus according to claim 13, wherein
the processor obtains the first numbers, the second numbers, the third numbers, and the fourth numbers, in the order of the first numbers, the second numbers, the third numbers, and the fourth numbers, for the plurality of executable partial processes having the same priority, and,
when the numbers obtained as the first numbers, the second numbers, the third numbers, or the fourth numbers are different for the plurality of individual partial processes having the same priorities, the processor executes a partial process having the largest number of the numbers obtained.

### Claim 15 (depends on 1)

The image processing apparatus according to claim 1, wherein,
in a case where there is a plurality of executable partial processes having a same priority, the processor determines a difference, for each of the plurality of executable partial processes, between the memory amount in an output area required for execution of a corresponding partial process and memory amount in an input area to be released after the execution of the corresponding partial process is completed, and executes a partial process of which the difference determined is minimum among the differences determined for the plurality of executable partial processes.

### Claim 16 (depends on 1)

The image processing apparatus according to claim 1, wherein,
in a case where there is a plurality of executable partial processes having a same priority, the processor obtains, with respect to each of the plurality of executable partial processes having the same priority, at least one of:
a first number that is the number of partial processes which depend on a corresponding executable partial process, which become executable after execution of the corresponding partial process is completed, and which have the same priority as the corresponding partial process has,
a second number that is the number of partial processes which depend on the corresponding partial process, which do not become executable after the execution of the corresponding partial process is completed, and which have the same priority as the corresponding partial process has,
a third number that is the number of partial processes which depend on the corresponding partial process, which become executable after the execution of the corresponding partial process is completed, and which have priorities lower than a priority of the corresponding partial process, and
a fourth number that is the number of partial processes which depend on the corresponding partial process, which do not become executable after the execution of the corresponding partial process is completed, and which have priorities lower than the priority of the corresponding partial process, and
the processor is configured to select whether to use
a first method of executing a partial process having a largest number as the first number, the second number, the third number, or the fourth number obtained, among the plurality of executable partial processes having the same priority,
a second method of determining a difference, for each of the plurality of executable partial processes, between the memory amount in an output area required for execution of a corresponding partial process and memory amount in an input area to be released after the execution of the corresponding partial process is completed, and executing a partial process of which the difference determined is minimum among the differences determined for the plurality of executable partial processes, or
a combination of the first method and the second method.

### Claim 17

An image processing method which is performed by an image processing apparatus for executing partial processes on each of a plurality of image-section data items, corresponding to a plurality of image sections obtained by dividing an input image into partial regions, in each object of an object group in which a plurality of objects for executing image processing is connected to one another in a directed acyclic graph form, the image processing method comprising:
assigning dependency relationships to the partial processes between the objects connected;
assigning a priority to a partial process of an object arranged in a terminal stage of the object group;
assigning, as a priority of a partial process of an object arranged at a pre-stage side which has at least one partial process that is connected at a post-stage side and that has the dependency relationship assigned, a largest value of the priority assigned to the at least one partial process that is connected at the post-stage side and that has the dependency relationship assigned; and
executing a partial process having become executable according to the dependency relationship, according to the priority assigned.

### Claim 18

A non-transitory computer-readable medium storing a program causing a computer to execute a process for executing partial processes on each of a plurality of image-section data items, corresponding to a plurality of image sections obtained by dividing an input image into partial regions, in each object of an object group in which a plurality of objects for executing image processing is connected to one another in a directed acyclic graph form, the process comprising:
assigning dependency relationships to the partial processes between the objects connected;
assigning a priority to a partial process of an object arranged in a terminal stage of the object group;
assigning, as a priority of a partial process of an object arranged at a pre-stage side which has at least one partial process that is connected at a post-stage side and that has the dependency relationship assigned, a largest value of the priority assigned to the at least one partial process that is connected at the post-stage side and that has the dependency relationship assigned; and
executing a partial process having become executable according to the dependency relationship, according to the priority assigned.
