# US 10,313,582 B2 · Image processing apparatus which separates images into groups based on image pickup condition information to perform a corection on images using a same image restoration filter with respect to each group, image pickup apparatus, image processing method and storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,582 B2 - Document ID: US10313582B2 - Status: Granted - Kind: B2 - Application number: 15/191,965 - Filed: 2016-06-24 - Published: 2016-12-29 - Granted: 2019-06-04 - Earliest claimed: 2015-06-26 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Shinji Hisamoto - Web page: https://patentgrep.com/patent/US10313582B2 ## CPC - H04N 25/134: {based on three different wavelength filter elements} - H04N 23/60: Control of cameras or camera modules - H04N 23/663: for controlling interchangeable camera parts based on electronic image sensor signals - H04N 23/75: by influencing optical camera components - H04N 23/843: {Demosaicing, e.g. interpolating colour pixel values} - H04N 25/6153: {for colour signals} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image processing apparatus includes an image acquisition unit (113) that acquires a plurality of images, an information acquisition unit (114) that acquires each image pickup condition information while imaging the plurality of images, a memory unit (108) that stores an optical transfer function corresponding to the image pickup condition information, a correction unit (111) that generates an image restoration filter from the optical transfer function on the basis of the image pickup condition information so as to correct the plurality of images using the image restoration filter, and a correction control unit (110) that causes the correction unit to correct the plurality of images acquired by the image acquisition unit in order based on the image pickup condition information. ## Claims ### Claim 1 An image processing apparatus comprising: a memory that stores an optical transfer function; one or more processors; and a storage medium including instructions that, when executed by the one or more processors, cause the one or more processors to; read a plurality of images; analyze header information of the plurality of images to acquire image pickup condition information of each of the plurality of images; generate an image restoration filter from the optical transfer function on the basis of the image pickup condition information so as to correct the plurality of images using the image restoration filter; and separate the plurality of images into a plurality of groups based on the image pickup condition information to correct images included in each group using a same image restoration filter with respect to each group. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: correct images included in a first group using a first image restoration filter and correct images included in a second group different from the first group using a second image restoration filter different from the first image restoration filter. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: set an order in which a correction using the image restoration filter is performed, in descending order of the number of the images included in each group. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: firstly perform a correction using the image restoration filter on groups matching a specific camera ID and a specific lens ID. ### Claim 5 (depends on 1) The image processing apparatus according to claim 1, wherein the image pickup condition information includes an image pickup date and time, and wherein the instructions, when executed by the one or more processors, further cause the one or more processor to: set an order performing a correction using the image restoration filter on groups according to the image pickup date and time. ### Claim 6 (depends on 1) The image processing apparatus according to claim 1, wherein the image pickup condition information includes a camera ID, a lens ID, a focal length, a photographing distance, a diaphragm and ISO speed, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: generate a first group in which each image pickup condition information of images has the same camera ID, a second group among the first groups in which each image pickup condition information of images has the same lens ID, and a third group among the second groups in which at least one of the focal length, the photographing distance, the diaphragm or the ISO speed of each image pickup condition information of images is identical, and correct the images in the third group using the same image restoration filter. ### Claim 7 (depends on 1) The image processing unit according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: while causing the one or more processors to perform a correction using a first image restoration filter, generate a second image restoration filter that is used for a next correction of the correction using the first image restoration filter. ### Claim 8 (depends on 1) The image processing unit according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: while causing the one or more processors to generate an image restoration filter according to a first optical transfer function, acquire, from the memory, a second optical transfer function that is used for a generation of an image restoration filter next to the first optical transfer function. ### Claim 9 (depends on 1) The image processing unit according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: while causing the one or more processors to determine an order performing a correction using the image restoration filter on a first image acquire a second image different from the first image. ### Claim 10 (depends on 1) The image processing unit according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: generate a signal for an image display that indicates a list of an order of corrections using the image restoration filter of the plurality of images. ### Claim 11 (depends on 10) The image processing unit according to claim 10, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: generate a signal adding a processing status of the correction to the list. ### Claim 12 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: record progress of an interrupted generation of the image restoration filter and a correction using the image restoration filter, and the previously generated image restoration filters when processing interrupts, and perform the correction in reference to the recorded image restoration filters and the recorded progress when the interrupted processing restarts. ### Claim 13 (depends on 12) The image processing apparatus according to claim 12, wherein the instructions, when executed by the one or more processors, further cause the one or more processors to: acquire a plurality of images selected by users. ### Claim 14 An image pickup apparatus comprising: an image pickup element that images an optical image of an object formed by an image pickup optical system; a memory that stores an optical transfer function; one or more processors; and a storage medium including instructions that when executed by the one or more processors, cause the one or more processors to; read a plurality of images imaged by the image pickup element; analyze header information of the plurality of images to acquire image pickup condition information of each of the plurality of images; generate an image restoration filter from the optical transfer function on the basis of the image pickup condition information so as to correct the plurality of images using the image restoration filter; and separate the plurality of images into a plurality of groups based on the image pickup condition information to correct images included in each group using a same image restoration filter with respect to each group. ### Claim 15 An image processing method comprising the steps of: acquiring a plurality of images; analyze header information of the plurality of images to acquire image pickup condition information of each of the plurality of images; acquiring an optical transfer function on the basis of the image pickup condition information; generating an image restoration filter from the optical transfer function on the basis of the image pickup condition information so as to correct the plurality of images using the image restoration filter; and separating the plurality of images into a plurality of groups based on the image pickup condition information to correct images included in each group using a same image restoration filter with respect to each group. ### Claim 16 A non-transitory computer-readable storage medium configured to store a computer program that enables a computer to execute image processing, wherein the image processing includes the steps of: acquiring a plurality of images; analyze header information of the plurality of images to acquire image pickup condition information of each of the plurality of images; acquiring an optical transfer function on the basis of the image pickup condition information; generating an image restoration filter from the optical transfer function on the basis of the image pickup condition information so as to correct the plurality of images using the image restoration filter; and separating the plurality of images into a plurality of groups based on the image pickup condition information to correct images included in each group using a same image restoration filter with respect to each group.