# US 11,443,399 B2 · Image processing apparatus for generating multiplexed information in which information is embedded in an image

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,399 B2
- Document ID: US11443399B2
- Status: Granted
- Kind: B2
- Application number: 17/114,285
- Filed: 2020-12-07
- Published: 2021-06-10
- Granted: 2022-09-13
- Earliest claimed: 2019-12-09
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Hiroaki Ogawa; Yoshinori Mizoguchi; Fumitaka Goto; Hiroyuki Sakai; Hiromitsu Yamaguchi; Tsukasa Doi; Takeru Sasaki
- Web page: https://patentgrep.com/patent/US11443399B2

## CPC

- G06T 1/0021: {Image watermarking}
- G06T 1/0028: {Adaptive watermarking, e.g. Human Visual System [HVS]-based watermarking}
- H04N 1/32149: {Methods relating to embedding, encoding, decoding, detection or retrieval operations}
- G06T 2201/0051: Embedding of the watermark in the spatial domain
- G06T 2201/0202: whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Reduce image quality deterioration of an object area that is gazed viewed by a user in a case where information is embedded in an image. An image processing apparatus including a recognition unit configured to recognize an object within an image and a layout unit configured to lay out information relating to an object recognized by the recognition unit in an area except for an object area for the recognized object within the image.

## Claims

### Claim 1

An image processing apparatus comprising:
a memory storing instructions; and
at least one processor executing the instructions cause the image processing apparatus to act as:
a recognition unit configured to recognize an object within an image; and
a layout unit configured to lay out information relating to an object recognized by the recognition unit in an area except for an object area for the recognized object within the image,
wherein the layout unit has a first determination unit configured to determine whether the object area exists inside each divided area obtained by dividing the image.

### Claim 2 (depends on 1)

The image processing apparatus according to claim 1, wherein
the layout unit determines that a divided area inside which the object area does not exist is an area in which information is embedded and a divided area inside which the object area exits is an area in which information is not embedded.

### Claim 3 (depends on 1)

The image processing apparatus according to claim 1, wherein
the layout unit layouts information relating to an object recognized by the recognition unit in an area except for an object area for the recognized object and which is around the object area within the image.

### Claim 4 (depends on 3)

The image processing apparatus according to claim 3, wherein
the layout unit further comprises:
a first determination unit configured to determine whether the object area exists inside each divided area obtained by dividing the image; and
a second determination unit configured to determine where there exists another divided area in which the object area exists around a divided area for which it is determined that the object area does not exist inside by the first determination unit.

### Claim 5 (depends on 4)

The image processing apparatus according to claim 4, wherein
the layout unit determines that:
a divided area inside which the object area exists is an area in which information is not embedded;
a divided area inside which the object area does not exist and there exits another divided area in which the object area exists therearound is an area in which information is embedded; and
a divided area inside which the object area does not exist and there exists not another divided area in which the object area exists therearound is an area in which information is not embedded.

### Claim 6 (depends on 1)

The image processing apparatus according to claim 1, wherein the at least one processor executing the instructions cause the image processing apparatus to further act as:
an adjustment unit configured to adjust embedding areas so that a plurality of pieces of information corresponding to a plurality of different objects is not embedded in an overlapping manner in one divided area.

### Claim 7 (depends on 1)

The image processing apparatus according to claim 1, further comprising:
a storage unit configured to store information relating to an object; and
the at least one processor executing the instructions cause the image processing apparatus to further act as a determination unit configured to selectively determine information relating to an object recognized by the recognition unit from among information stored in the storage unit.

### Claim 8 (depends on 7)

The image processing apparatus according to claim 7, wherein
in the storage unit, as information relating to an object, embedding-target additional information and association information for associating object recognition results are stored.

### Claim 9 (depends on 8)

The image processing apparatus according to claim 8, the at least one processor executing the instructions cause the image processing apparatus to further act as:
a generation unit configured to generate the association information automatically.

### Claim 10

An image processing method comprising:
recognizing an object within an image;
laying out information relating to a recognized object in an area except for an object area for the recognized object within the image; and
determining whether the object area exists inside each divided area obtained by dividing the image.

### Claim 11 (depends on 10)

The image processing method according to claim 10, wherein
a divided area inside which the object area does not exist is determined to be an area in which information is embedded and a divided area inside which the object area exits is determined to be an area in which information is not embedded.

### Claim 12 (depends on 10)

The image processing method according to claim 10, wherein
information relating to the recognized object is laid out in an area except for an object area for the recognized object and which is around the object area within the image.

### Claim 13 (depends on 12)

The image processing method according to claim 12, further comprising:
determining whether the object area exists inside each divided area obtained by dividing the image; and
determining whether there exists another divided area in which the object area exists around a divided area for which it is determined that the object area does not exist inside.

### Claim 14 (depends on 13)

The image processing method according to claim 13, wherein
a divided area inside which the object area exists is determined to be an area in which information is not embedded;
a divided area inside which the object area does not exist and there exits another divided area in which the object area exists therearound is determined to be an area in which information is embedded; and
a divided area inside which the object area does not exist and there exists not another divided area in which the object area exists therearound is determined to be an area in which information is not embedded.

### Claim 15 (depends on 10)

The image processing method according to claim 10, further comprising:
adjusting embedding areas so that a plurality of pieces of information corresponding to a plurality of different objects is not embedded in an overlapping manner in one divided area.

### Claim 16 (depends on 10)

The image processing method according to claim 10, further comprising:
storing information relating to an object; and
selectively determining information relating to the recognized object from among the stored information.

### Claim 17 (depends on 16)

The image processing method according to claim 16, wherein
as the information relating to an object, embedding-target additional information and association information for associating object recognition results are stored.

### Claim 18

A non-transitory computer readable storage medium storing a program for causing a computer to perform an image processing method comprising:
recognizing an object within an image;
laying out information relating to a recognized object in an area except for an object area for the recognized object within the image; and
determining whether the object area exists inside each divided area obtained by dividing the image.
