# US 2019/0356820 A1 · Image processing apparatus for processing marked regions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356820 A1
- Document ID: US20190356820A1
- Status: Published application
- Kind: A1
- Application number: 16/529,540
- Filed: 2019-08-01
- Published: 2019-11-21
- Earliest claimed: 2017-11-27
- Assignees: Toshiba Tec Kabushiki Kaisha
- Applicants: Toshiba Tec Kabushiki Kaisha
- Inventors: Tetsuya SADOWARA; Hiromasa TANAKA
- Web page: https://patentgrep.com/patent/US20190356820A1

## CPC

- G06V 10/225: {based on a marking or identifier characterising the area}
- G06F 18/241: relating to the classification model, e.g. parametric or non-parametric approaches
- G06V 10/235: {based on user input or interaction}
- G06V 30/413: Classification of content, e.g. text, photographs or tables
- G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
- H04N 1/6094: {depending on characteristics of the input medium, e.g. film type, newspaper}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

According to one embodiment, an image processing apparatus includes a scanner, a memory, and a processor. The scanner acquires a read image of an original document. The memory stores the read image of the original document that is acquired by the scanner. The processor detects a highlighted region including a region that is highlighted with a chromatic color in the read image of the original document which is stored in the memory and a circled region including a region circled by the chromatic color, and classifies the highlighted region as a region for first processing and classifies the circled region as a region for second processing.

## Claims

### Claim 1

An image processing apparatus comprising:
a scanner configured to acquire a read image of an original document;
a memory configured to store the read image of the original document that is acquired by the scanner; and
a processor configured to detect a highlighted region including a region that is highlighted with a chromatic color in the read image of the original document which is stored in the memory and a circled region including a region circled by the chromatic color, and configured to classify the highlighted region as a region for first processing and classify the circled region as a region for second processing.

### Claim 2 (depends on 1)

The apparatus according to claim 1,
wherein the processor cuts out a rectangular region including the region that is highlighted with the chromatic color as a highlighted region.

### Claim 3 (depends on 2)

The apparatus according to claim 2,
wherein the processor cuts out a contour of a chromatic color region that is formed so as to circle a partial region on the original document as a circled region.

### Claim 4 (depends on 3)

The apparatus according to claim 3,
wherein the processor performs the first processing for the region that is cut out as the highlighted region and performs the second processing for the region that is cut out as the circled region.

### Claim 5 (depends on 1)

The apparatus according to claim 1,
wherein the processor extracts a contour line of the chromatic color region in the read image of the original document, determines that the chromatic color region is a mark indicating the highlighted region if a ratio of white pixels in the contour line is less than a threshold value, and determines that the chromatic color region is a mark indicating the circled region if the ratio of the white pixels in the contour line is greater than or equal to the threshold value.

### Claim 6 (depends on 1)

The apparatus according to claim 1,
wherein the processor extracts a contour line of the chromatic color region in a read image of the original document, determines that the chromatic color region is a mark indicating the highlighted region if a ratio of chromatic color pixels in the contour line is greater than or equal to a threshold value, and determines that the chromatic color region is a mark indicating the circled region if the ratio of the chromatic color pixels in the contour line is less than the threshold value.

### Claim 7

A method for differentiating marked-up information in an image, the method comprising:
receiving an input from a user;
acquiring, in an optical acquisition device, an image;
communicating the acquired image to a data processor;
identifying, in the data processor, one or more marked-up regions distinct from other portions of the acquired image;
differentiating the one or more marked-up regions in response to the input by the user; and
outputting a modified image based on the image and the differentiated one or more marked-up regions.

### Claim 8 (depends on 7)

The method of claim 7, further comprising saving the acquired image into a memory device.

### Claim 9 (depends on 7)

The method of claim 7, wherein the one or more marked-up regions include a region highlighted with a chromatic color contrasting against other portions of the image.

### Claim 10 (depends on 7)

The method of claim 7, wherein the one or more marked-up regions include a region surrounded by a chromatic color contrasting against other portions of the image.

### Claim 11 (depends on 7)

The method of claim 7, wherein the one or more marked-up regions include one or more regions highlighted with a chromatic color or surrounded by a contour line of the chromatic color contrasting against other portions of the image or both.

### Claim 12 (depends on 11)

The method of claim 11, wherein identifying the one or more marked-up regions includes first processing one or more regions highlighted with a chromatic color and then processing one or more regions surrounded by a contour line of the chromatic color.

### Claim 13 (depends on 11)

The method of claim 11, wherein identifying the one or more marked-up regions comprises:
extracting a contour line of a chromatic color region in the image,
identifying the one or more regions highlighted with the chromatic color when, in the one or more highlighted regions, a chromatic color pixels to white pixels ratio in the contour line is greater than or equal to a threshold value; and
identifying the one or more regions surrounded by the contour line when, in the chromatic color region, a white pixels to chromatic color pixels ratio bounded within the contour line is greater than or equal to the threshold value.

### Claim 14 (depends on 7)

The method of claim 7, wherein differentiating the one or more marked-up regions in response to the input by the user comprises removing or emphasizing the one or more marked-up regions.

### Claim 15 (depends on 7)

The method of claim 7, wherein identifying the one or more marked-up regions comprises:
extracting a contour line of a chromatic color region in the image;
determining that the chromatic color region is a mark indicating a highlighted region if a ratio of chromatic color pixels in the contour line is larger than or equal to a threshold value; and
determining that the chromatic color region is a mark indicating the circled region if the ratio of the chromatic color pixels in the contour line is less than the threshold value.

### Claim 16

An image processing apparatus comprising:
a control unit receiving an input from a user;
a scanner operable to acquire an image according to the input;
a memory unit operable to store the image; and
a processor operable to process the stored image according to the input, wherein the operation comprises determining a chromatic color and identifying a marker region of the chromatic color.

### Claim 17 (depends on 16)

The image processing apparatus of claim 16, wherein the operation performed by the processor further comprises removing noises of the image, determining white pixels of the image, and determining a marking method associated with the chromatic color.

### Claim 18 (depends on 17)

The image processing apparatus of claim 17, wherein the marking method associated with the chromatic color associates with at least one parameter set in the input received from the user.

### Claim 19 (depends on 17)

The image processing apparatus of claim 17, wherein the operation further includes, subsequent to identifying the marker region, cutting the marker region from the image and storing an edited image into the memory unit.

### Claim 20 (depends on 16)

The image processing apparatus of claim 16, wherein the operation by the processor further comprises identifying a highlighted region indicated by an area covered by the chromatic color, or a circled region indicated by an area surrounded by a contour line of the chromatic color, or both.
