# US 11,441,946 B2 · Processing apparatus, image pickup apparatus, image pickup system, and processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,441,946 B2 - Document ID: US11441946B2 - Status: Granted - Kind: B2 - Application number: 17/320,407 - Filed: 2021-05-14 - Published: 2021-12-09 - Granted: 2022-09-13 - Earliest claimed: 2020-06-04 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Tsubasa Nakamura - Web page: https://patentgrep.com/patent/US11441946B2 ## CPC - G01J 3/2803: {using photoelectric array detector} - G01J 3/0208: {using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction} - G01J 3/0289: {Field-of-view determination; Aiming or pointing of a spectrometer; Adjusting alignment; Encoding angular position; Size of measurement area; Position tracking} - G01J 3/2823: {Imaging spectrometer} - G01J 3/36: Investigating two or more bands of a spectrum by separate detectors - G01J 2003/2806: {Array and filter array} - G01J 2003/2826: {Multispectral imaging, e.g. filter imaging} - G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N) ## Abstract A processing apparatus combines a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units and to generate a combined image, and includes at least one processor or circuit that serves as an acquisition task configured to acquire information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center position and positions of the plurality of images in the combined image, and conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on a correction function for correcting the plurality of object images, and a processing task configured to generate the combined image using the conversion information. ## Claims ### Claim 1 A processing apparatus configured to combine a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units and to generate a combined image, the processing apparatus comprising: at least one processor or circuit configured to execute a plurality of tasks including: an acquisition task configured to acquire information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center position and positions of the plurality of images in the combined image, and conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on a correction function for correcting the plurality of object images; and a processing task configured to generate the combined image using the conversion information. ### Claim 2 (depends on 1) The processing apparatus according to claim 1, wherein the acquisition task acquires correction information for correcting an in-plane luminance distribution of an image corresponding to each of the plurality of object images, and wherein the processing task corrects the image corresponding to each of the plurality of object images using the correction information. ### Claim 3 (depends on 1) The processing apparatus according to claim 1, further comprising a memory configured to store the conversion information. ### Claim 4 (depends on 1) An image pickup apparatus comprising: the processing apparatus according to claim 1; and the image sensor configured to generate the plurality of images. ### Claim 5 (depends on 4) An image pickup system comprising: the image pickup apparatus according to claim 4; and an optical system that includes the plurality of lens units. ### Claim 6 (depends on 5) The image pickup system according to claim 5, wherein the optical system includes a plurality of filters disposed on optical axes of the plurality of lens units and having transmission characteristics different from each other. ### Claim 7 (depends on 6) The image pickup system according to claim 6, wherein the correction function includes a function including a deformation component caused by a lateral chromatic aberration of each of the plurality of object images, and a function including a distortion component of each of the plurality of object images at a reference wavelength. ### Claim 8 (depends on 5) The image pickup system according to claim 5, wherein the optical system includes a main optical system on an object side of the plurality of lens units. ### Claim 9 (depends on 8) The image pickup system according to claim 8, wherein the correction function includes a function including an angle of view component of each of the plurality of object images, and a function including a component of a shift amount between an optical axis of the main optical system and an optical axis of each of the plurality of lens units. ### Claim 10 A processing method for a processing apparatus configured to combine a plurality of images based on a plurality of object images formed on an imaging plane of an image sensor by a plurality of lens units and to generate a combined image, the processing method comprising: acquiring information on a center position of each of the plurality of object images on the imaging plane, information on a correspondence relationship between the center position and positions of the plurality of images in the combined image, and conversion information for converting a first coordinate system in the imaging plane into a second coordinate system in the combined image, the conversion information being generated based on a correction function for correcting the plurality of object images; and generating the combined image using the conversion information.