# US 2013/0155265 A1 · Image pickup apparatus, method of performing image compensation, and computer readable recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0155265 A1 - Document ID: US20130155265A1 - Status: Published application - Kind: A1 - Application number: 13/553,909 - Filed: 2012-07-20 - Published: 2013-06-20 - Earliest claimed: 2011-12-16 - Assignees: Samsung Electronics Co., Ltd. - Inventors: Jum-han BAE; Ki-ho Kim; June-hee Lee; Kyu-yul Choi - Web page: https://patentgrep.com/patent/US20130155265A1 ## CPC - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/77: Retouching; Inpainting; Scratch removal - H04N 23/62: Control of parameters via user interfaces - H04N 23/63: by using electronic viewfinders - H04N 23/6811: {based on the image signal} - H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio - H04N 25/68: applied to defects - H04N 25/704: Pixels specially adapted for focusing, e.g. phase difference pixel sets - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An image pickup apparatus includes an image pickup unit to continuously pick up a plurality of images having mutual displacement using an image pickup device, a storage unit to store a position of a defect area of the image pickup device, and an image compensation unit to compensate for the defect area in one of the plurality of picked images using the other picked image. ## Claims ### Claim 1 An image pickup apparatus, comprising: an image pickup unit to continuously pick up a plurality of images having a mutual displacement therebetween using an image pickup device; a storage unit to store a position of a defect area of the image pickup device; and an image compensation unit to compensate for the defect area in one of the plurality of picked up images using another one of the plurality of picked up images. ### Claim 2 (depends on 1) The image pickup apparatus as claimed in claim 1, wherein: the plurality of picked up images include a first image and a second image, and the image compensation unit compensates for the first image according to the mutual displacement, calculates a pixel value of the compensated first image that corresponds to the defect area of the second image, and substitutes the calculated pixel value for the defect area of the second image. ### Claim 3 (depends on 1) The image pickup apparatus as claimed in claim 1, wherein each of the plurality of picked up images is a full-frame image through a shutter operation. ### Claim 4 (depends on 1) The image pickup apparatus as claimed in claim 1, wherein: at least one of the plurality of picked up images is a full-frame image through a shutter operation, and the other of the plurality of picked up images is a live-view image for live-view display. ### Claim 5 (depends on 4) The image pickup apparatus as claimed in claim 4, wherein the live-view image is a small-size live-view that is displayed when a shutter is released or a full-side live-view that is displayed when a half-press shutter is input. ### Claim 6 (depends on 4) The image pickup apparatus as claimed in claim 4, wherein the live-view image is an image that is picked up just before the full-frame image is picked up. ### Claim 7 (depends on 4) The image pickup apparatus as claimed in claim 4, wherein the live-view image is an image that is picked up after the full-frame image is picked up. ### Claim 8 (depends on 1) The image pickup apparatus as claimed in claim 1, further comprising: a sensing unit to sense movement of the image pickup apparatus; and an OIS (Optical Image Stabilizer) unit to move an image pickup direction of the image pickup apparatus as much as a preset displacement so that the mutual displacement exists between the plurality of picked images if the movement of the image pickup apparatus is not sensed. ### Claim 9 (depends on 1) The image pickup apparatus as claimed in claim 1, further comprising a user interface unit to display a live-view image picked up by the image pickup unit. ### Claim 10 (depends on 9) The image pickup apparatus as claimed in claim 9, further comprising a control unit to control the image pickup unit to pick up a full-frame image through a shutter operation after the live-view image being displayed is stored as a first image if a shutter command is input while the live-view is displayed. ### Claim 11 (depends on 1) The image pickup apparatus as claimed in claim 1, wherein the storage unit stores a position of at least one of a white pixel defect area of the image pickup device, a black pixel defect area of the image pickup device, and an AF phase-difference defect area. ### Claim 12 A method of performing image compensation in an image pickup apparatus, comprising: continuously picking up and storing a plurality of images having mutual displacement therebetween using an image pickup device; and compensating for a defect area in one of the plurality of picked up images using another one of the plurality of picked up images. ### Claim 13 (depends on 12) The method of performing image compensation as claimed in claim 12, wherein: the plurality of picked up images include a first image and a second image, and the compensating includes moved the first image according to the mutual displacement, calculating a pixel value of the moved first image that corresponds to the defect area of the second image, and substituting the calculated pixel value for the defect area of the second image. ### Claim 14 (depends on 12) The method of performing image compensation as claimed in claim 12, wherein each of the plurality of picked up images is a full-frame image through a shutter operation. ### Claim 15 (depends on 12) The method of performing image compensation as claimed in claim 12, wherein: at least one of the plurality of picked up images is a full-frame image through a shutter operation, and the other of the plurality of picked up images is a live-view image for live-view display. ### Claim 16 (depends on 15) The method of performing image compensation as claimed in claim 15, wherein the live-view image is a small-size live-view that is displayed when a shutter is released or a full-side live-view that is displayed when a half-press shutter is input. ### Claim 17 (depends on 15) The method of performing image compensation as claimed in claim 15, wherein the live-view image is an image that is picked up just before the full-frame image is picked up. ### Claim 18 (depends on 15) The method of performing image compensation as claimed in claim 15, wherein the live-view image is an image that is picked up after the full-frame image is picked up. ### Claim 19 (depends on 12) The method of performing image compensation as claimed in claim 12, further comprising: sensing movement of the image pickup apparatus; and moving an image pickup direction of the image pickup apparatus as much as a preset displacement so that the mutual displacement exists between the plurality of picked images if the movement of the image pickup apparatus is not sensed. ### Claim 20 (depends on 12) The method of performing image compensation as claimed in claim 12, further comprising displaying a live-view image picked up by the image pickup unit. ### Claim 21 (depends on 20) The method of performing image compensation as claimed in claim 20, wherein the picking up and storing includes picking up and storing a full-frame image through a shutter operation after the live-view image being displayed is stored as a first image if a shutter command is input while the live-view is displayed. ### Claim 22 (depends on 12) The method of performing image compensation as claimed in claim 12, wherein the defect area is at least one of a white pixel defect area of the image pickup device, a black pixel defect area of the image pickup device, and an AF phase-difference defect area. ### Claim 23 A non-transitory computer readable recording medium including computer-readable codes to execute a method of performing image compensation, wherein the method of performing image compensation comprises: continuously picking up and storing a plurality of images having mutual displacement therebetween using an image pickup device; and compensating for a defect area in one of the plurality of picked images using another one of the plurality of picked up images.