# US 10,311,915 B2 · Image processing apparatus and method for controlling the same > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,311,915 B2 - Document ID: US10311915B2 - Status: Granted - Kind: B2 - Application number: 14/033,784 - Filed: 2013-09-23 - Published: 2014-01-23 - Granted: 2019-06-04 - Earliest claimed: 2010-12-24 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Satoshi Okamura - Web page: https://patentgrep.com/patent/US10311915B2 ## CPC - G11B 27/036: Insert-editing - H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability} - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Grain noise and scratches are applied to an input image as random noise to generate a combined image. When applying grain noise clipped from two-dimensional noise data to the input image, each time clipping is performed, a positional difference from a last clipping position is evaluated. When the positional difference is determined to be small, a current clipping position is changed. When applying scratches clipped from noise data of a plurality of patterns to an input image, when a condition for successively applying scratches for a predetermined time period is selected, a positional difference from a last pasting position is evaluated. When the positional difference is determined to be large, the application of scratches is invalidated. ## Claims ### Claim 1 An image processing apparatus which performs image processing to a plurality of input frame images, the image processing apparatus comprising: one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a clipping unit configured to clip each image of the plurality of input frame images at a position determined based on a random value; a masking unit configured to partially mask the image processed by the clipping unit; and an outputting unit configured to output a plurality of frame images which are processed by the clipping unit and masked by the masking unit as a moving image, wherein the masking unit masks the image processed by the clipping unit so that a noise area included in the clipped image is hidden. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the clipping unit changes a readout start position of an input frame image based on the random value. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions stored in the memory further causes the image processing apparatus to function as a luminance changing unit configured to randomly change input- output characteristics of luminance for a plurality of frame images. ### Claim 4 (depends on 3) The image processing apparatus according to claim 3, wherein the luminance changing unit randomly changes the input-output gamma characteristics of the plurality of frame images. ### Claim 5 (depends on 3) The image processing apparatus according to claim 3, wherein the masking unit masks the image of which luminance is changed by the luminance changing unit. ### Claim 6 (depends on 3) The image processing apparatus according to claim 3, wherein the instructions stored in the memory further causes the image processing apparatus to function as a combining unit configured to add noise data to the images processed by the luminance changing unit. ### Claim 7 (depends on 3) The image processing apparatus according to claim 3, wherein the instructions stored in the memory further causes the image processing apparatus to function as a setting unit configured to set changing of luminance by the luminance changing unit as valid or invalid. ### Claim 8 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions stored in the memory further causes the image processing apparatus to function as a recording unit configured to record the output moving image in a recording medium. ### Claim 9 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions stored in the memory further causes the image processing apparatus to function as a displaying unit configured to display the output moving image. ### Claim 10 (depends on 1) The image processing apparatus according to claim 1, wherein the masking unit masks the image processed by the clipping unit at the top of the frame and the bottom of the frame. ### Claim 11 (depends on 1) The image processing apparatus according to claim 1, wherein a portion of the image which is not masked has a letter box aspect ratio. ### Claim 12 (depends on 1) The image processing apparatus according to claim 1, wherein the clipped image has a predetermined ratio and the masked image has another predetermined ratio size. ### Claim 13 (depends on 1) The image processing apparatus according to claim 1, further comprising an image capturing unit configured to capture the plurality of input frame images sequentially. ### Claim 14 (depends on 1) The image processing apparatus according to claim 1, wherein the clipping unit is configured to clip each image of the plurality of frames at a position randomly displaced in at least one of vertical and horizontal directions. ### Claim 15 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions stored in the memory further causes the image processing apparatus to function as a clip setting unit configured to set clipping by the clipping unit as valid or invalid. ### Claim 16 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions stored in the memory further causes the image processing apparatus to function as a mask setting unit configured to set masking image by the masking unit as valid or invalid. ### Claim 17 An image processing method performing image processing to a plurality of input frame images, the image processing method comprising: clipping each image of the plurality of input frame images at a position determined based on a random value; partially masking the image processed by the clipping; and outputting a plurality of frame images processed by the clipping and masked by the masking as a moving image, wherein the image processed by the clipping is masked by the masking so that a noise area included in the clipped image is hidden. ### Claim 18 An image processing apparatus which performs image processing to a plurality of input frame images, the image processing apparatus comprising: one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a luminance changing unit configured to randomly change an input-output characteristic of luminance among the plurality of input frame images and change luminance among the plurality of input frame images based on the each input-output characteristic of luminance as a film-like effect; and an outputting unit configured to output a plurality of frame images which are processed by the luminance changing unit as a moving image. ### Claim 19 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a masking unit configured to partially mask the image processed by the luminance changing unit. input frame images at a position determined based on a random value. ### Claim 20 (depends on 19) The image processing apparatus according to claim 19, wherein the masking unit masks the image processed by the clipping unit at the top of the frame and the bottom of the frame. ### Claim 21 (depends on 19) The image processing apparatus according to claim 19, wherein the masked image has a letter box aspect ratio. ### Claim 22 (depends on 20) The image processing apparatus according to claim 20, wherein the clipping unit is configured to clip each frame of the plurality of frames at a position randomly displaced in at least one of vertical and horizontal directions. ### Claim 23 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a combining unit configured to add noise data to the image processed by the luminance changing unit. ### Claim 24 (depends on 18) The image processing apparatus according to claim 18, wherein the luminance changing unit randomly changes an input-output gamma characteristic among the plurality of input frame images in order to randomly change an input-output characteristic of luminance among the plurality of input frame images. ### Claim 25 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a recording unit configured to record the output moving image in a recording medium. ### Claim 26 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a displaying unit configured to display the output moving image. ### Claim 27 (depends on 18) The image processing apparatus according to claim 18, further comprising an image capturing unit configured to capture the plurality of input frame images sequentially. ### Claim 28 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a setting unit configured to set changing of luminance by the luminance changing unit as valid or invalid. ### Claim 29 (depends on 18) The image processing apparatus according to claim 18, wherein the instructions stored in the memory further causes the image processing apparatus to function as a clipping unit configured to clip each image of the plurality of input frame images at a position determined based on a random value. ### Claim 30 An image processing method for performing image processing to a plurality of input frame images, the method comprising: randomly changing an input-output characteristic of luminance among the plurality of input frame images and change luminance among the plurality of input frame images based on the each input-output characteristic of luminance as a film-like effect; and outputting a plurality of frame images processed by the randomly changing input- output characteristics of luminance as a moving image. ### Claim 31 An image capturing apparatus which performs image processing to a plurality of captured frame images, the image capturing apparatus comprising: an image capturing unit configured to capture a plurality of frame images sequentially; one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a clipping unit configured to clip each image of the plurality of captured frame images at a position determined based on a random value; a masking unit configured to partially mask the image processed by the clipping unit; and an outputting unit configured to output a plurality of frame images which are processed by the clipping unit and masked by the masking unit as a moving image, wherein the masking unit masks the image processed by the clipping unit so that a noise area included in the clipped image is hidden. ### Claim 32 An image processing apparatus which performs image processing to a plurality of captured frame images, the image capturing apparatus comprising: an image capturing unit configured to capture a plurality of frame images sequentially; one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a luminance changing unit configured to randomly change an input-output characteristic of luminance among the plurality of input frame images and change luminance among the plurality of input frame images based on the each input-output characteristic of luminance as a film-like effect; and an outputting unit configured to output a plurality of frame images processed by the luminance changing unit as a moving image. ### Claim 33 A non-transitory computer readable storage medium storing a program for controlling a computer to execute respective steps of an image processing method which performs image processing to a plurality of input frame images, the steps comprising: clipping each image of the plurality of input frame images at a position determined based on a random value; partially masking the images processed by the clipping; and outputting a plurality of frame images processed by the clipping and masked by the masking as a moving image, wherein the image processed by the clipping is masked by the masking so that a noise area included in the clipped image is hidden. ### Claim 34 A non-transitory computer readable storage medium storing a program for controlling a computer to execute respective steps of an image processing method which performs image processing to a plurality of input frame images, the steps comprising: randomly changing an input-output characteristic of luminance among the plurality of input frame images and changing luminance among of the plurality of input frame images based on the each input-output characteristic of luminance as a film-like effect; and outputting a plurality of frame images processed by the randomly changing input- output characteristics of luminance as a moving image. ### Claim 35 An image processing apparatus which performs image processing to a plurality of input frame images, the image processing apparatus comprising: one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a clipping unit configured to clip each image of the plurality of input frame images at a position determined based on a random value; a masking unit configured to apply a mask having an opening of a predetermined aspect ratio to each image of the plurality of frame images processed by the clipping unit; and an outputting unit configured to output a plurality of frame images which are processed by the clipping unit and masked by the masking unit as a moving image, wherein the masking unit masks the each image of the plurality of frame images so that a noise area included in the clipped image is hidden. ### Claim 36 An image processing method for performing image processing to a plurality of input frame images, the method comprising: clipping each image of the plurality of input frame images at a position determined based on a random value; masking to apply a mask having an opening of a predetermined aspect ratio to each image of the plurality of frame images processed in the clipping; and outputting a plurality of frame images which are processed in the clipping and masked in the masking as a moving image, wherein the each image of the plurality of frame images is masked in the masking so that a noise area included in the clipped image is hidden. ### Claim 37 (depends on 36) A non-transitory computer readable storage medium storing a program for controlling a computer to execute respective steps of an image processing method according to claim 36. ### Claim 38 An image processing apparatus which performs image processing to a plurality of input frame images, the image processing apparatus comprising: one or more processors; and a memory storing instructions which, when the instructions are executed by the one or more processors, cause the image processing apparatus to function as: a luminance changing unit configured to randomly change an input-output characteristic among the plurality of input frame images and change luminance among the plurality of input frame images based on the each input-output characteristic of luminance in order that the plurality of input frame images are like a film played back with a movie film projector; and an outputting unit configured to output a plurality of frame images which are processed by the luminance changing unit as a moving image.