# US 10,121,271 B2 · Image processing apparatus and image processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,271 B2 - Document ID: US10121271B2 - Status: Granted - Kind: B2 - Application number: 15/360,685 - Filed: 2016-11-23 - Published: 2017-06-01 - Granted: 2018-11-06 - Earliest claimed: 2015-11-30 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Takashi Akahane - Web page: https://patentgrep.com/patent/US10121271B2 ## CPC - G06T 5/94: based on local image properties, e.g. for local contrast enhancement - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 2207/10024: Color image - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/20012: Locally adaptive - G06T 2207/30196: Human being; Person - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract According to various embodiments, an image processing apparatus includes an inputting unit configured to receive input of an image, a range information acquiring unit configured to acquire range information about a subject for each region of the input image, and a converting unit configured to assign a gradation to each region of the input image based on the range information and convert luminance data of the input image according to the assigned gradation. ## Claims ### Claim 1 An image processing apparatus comprising: at least one processor or circuit; a memory, wherein the at least one processor or circuit is configured to function as following units using data in the memory: an inputting unit configured to receive input of a captured image; an acquiring unit configured to acquire, for each image area of the captured image, range information indicating a distance from an imaging apparatus to a subject at the time of imaging; and a converting unit configured to convert, for each image area of the captured image, a luminance value of the captured image according to the distance to the subject, and convert a color value of the captured image into a predetermined value, based on the range information, wherein the converting unit converts the luminance value of the captured image such that the luminance value decreases as the distance to the subject becomes shorter, and wherein the converting unit assigns an equal luminance value to an image area included in a predetermined distance range. ### Claim 2 An image processing apparatus comprising: at least one processor or circuit; a memory, wherein the at least one processor or circuit is configured to function as following units using data in the memory: an inputting unit configured to receive input of a captured image; an acquiring unit configured to acquire, for each image area of the captured image, range information indicating a distance from an imaging apparatus to a subject at the time of imaging; and a converting unit configured to convert, for each image area of the captured image, the captured image into a shadow image of the subject expressed in light and dark according to the distance to the subject, based on the range information, wherein the converting unit converts the captured image such that darkness increases as the distance to the subject becomes shorter, and wherein the converting unit converts the captured image in an image area included in a predetermined distance range to equal darkness. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein the converting unit assigns the luminance value to an image area depending on where a distance of the image area is included, in a plurality of distance ranges set stepwise based on a distance from a focal plane at the time of the imaging. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the converting unit converts the luminance value such that a luminance value of zero is uniformly assigned to a subject located closer than a focal plane at the time of the imaging. ### Claim 5 (depends on 1) The image processing apparatus according to claim 1, further comprising a blurring processing unit configured to perform blurring processing on the captured image converted by the converting unit in a blur amount that differs according to the distance to the subject, for each image area. ### Claim 6 (depends on 1) The image processing apparatus according to claim 1, further comprising a marginal illumination reduction processing unit configured to perform marginal illumination reduction processing on the captured image converted by the converting unit to reduce an amount of light in a marginal area of the captured image. ### Claim 7 (depends on 3) The image processing apparatus according to claim 3, wherein the plurality of distance ranges is set according to an imaging condition at the time of the imaging. ### Claim 8 (depends on 7) The image processing apparatus according to claim 7, wherein the imaging condition includes at least one of a distance to the focal plane, a distance at which imaging is performable, a focal length, and an aperture value. ### Claim 9 An image processing method comprising: receiving input of a captured image; acquiring, for each image area of the captured image, range information indicating a distance from an imaging apparatus to a subject at the time of imaging; and converting, for each image area of the captured image, a luminance value of the captured image according to the distance to the subject, and converting a color value of the captured image into a predetermined value, based on the range information, wherein the converting converts the luminance value of the captured image such that the luminance value decreases as the distance to the subject becomes shorter, and wherein the converting unit assigns an equal luminance value to an image area included in a predetermined distance range.