Image processing device for generating reconstruction image, image generating method, and storage medium
AssigneeCasio Computer Co., Ltd.
InventorRyohei Yamamoto
Life of this patent
Estimating the term…
Abstract
A sub-image extractor extracts a target sub-image from a light field image. A partial area definer defines a predetermined area in the target sub-image as a partial area. A pixel extractor extracts pixels from the partial area, the number of pixels meeting correspondence areas of a generation image. The pixel arranger arranges the extracted pixels to the correspondence areas of the generation image in an arrangement according to the optical path of the optical system which photographs the light field image. Pixels are extracted for all sub-images in the light field image, and are arranged to the generation image to generate a reconstruction image.
Claims26
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a clipper that clips partial images from the sub-images;
- a generator that generates a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- a distance setter that sets a re-focal length of the reconstruction image;
- an interval determiner that determines an interval, at which the partial images are arranged on the reconstruction image, according to the re-focal length;
- and
- a size determiner that determines a clipping size of the partial images so that the partial images are overlapped on the reconstruction image.
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a clipper that clips partial images from the sub-images;
- a generator that generates a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- a size determiner that determines a clipping size of the partial images;
- and
- a position determiner that determines clipping positions of the partial images,
- wherein the generator combines partial images corresponding to the clipping positions based on the clipping size and the alignment position of the sub-images, to generate the reconstruction image.
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a clipper that clips partial images from the sub-images;
- a generator that generates a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- an image displacement obtainer that obtains image displacement degrees for the sub-images respectively, wherein each of the image displacement degrees indicates a displacement between a position of a predetermined part in the sub-image and a position of a part corresponding to a photographic object captured in the predetermined part in another sub-image;
- and
- a size determiner that determines a larger clipping size for the partial images with a larger image displacement degree.
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a clipper that clips partial images from the sub-images;
- a generator that generates a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- and
- a size determiner that determines a clipping size of the partial images to fit arrangement areas which are obtained by dividing the reconstruction image according to the sub-images.
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a clipper that clips partial images from the sub-images;
- a generator that generates a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- and
- a size determiner that determines a clipping size of the partial images,
- wherein the generator (a) divides the reconstruction image into arrangement areas corresponding to the sub-images, (b) reduces or expands the partial images to fit a size of a corresponding arrangement area, and (c) arranges the partial images.
An image processing device comprising:
- an image obtainer that obtains a multi-view image in which sub-images from viewpoints are aligned;
- a first selector that selects a first image from the sub-images;
- a pixel selector that selects a first pixel included in the first image;
- a second selector that selects a second image from the sub-images;
- a searcher that searches a second pixel corresponding to the first pixel among pixels included in the second image;
- a pixel processor that processes the sub-images by applying a blurring addition process to the first pixel and the second pixel in accordance with a blurring intensity, the blurring intensity being based on a positional relationship between the first pixel and the second pixel and a re-focal length;
- and
- a reconstructor that reconstructs an image from the sub-images processed by the pixel processor.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- setting a re-focal length of a reconstruction image;
- and
- generating the reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein generating the reconstruction image comprises determining an interval, at which the partial images are arranged on the reconstruction image, according to the re-focal length;
- and
- wherein clipping the partial images comprises determining a clipping size of the partial images so that the partial images are overlapped on the reconstruction image.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- setting a re-focal length of a reconstruction image;
- and
- generating the reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein generating the reconstruction image comprises determining an interval, at which the partial images are arranged on the reconstruction image, according to the re-focal length;
- and
- wherein clipping the partial images comprises determining a clipping size of the partial images so that the partial images are overlapped on the reconstruction image.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determining a clipping size of the partial images and clipping positions of the partial images;
- and
- wherein generating the reconstruction image comprises combining partial images corresponding to the clipping positions based on the clipping size and the alignment position of the sub-images, to generate the reconstruction image.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- obtaining image displacement degrees for the sub-images respectively, wherein each of the image displacement degrees indicates a displacement between a position of a predetermined part in the sub-image and a position of a part corresponding to a photographic object captured in the predetermined part in another sub-image;
- clipping partial images from the sub-images, wherein a larger clipping size is determined for the partial images with a larger image displacement degree;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determining a clipping size of the partial images to fit arrangement areas which are obtained by dividing the reconstruction image according to the sub-images.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determines a clipping size of the partial images;
- and
- wherein generating the reconstruction image comprises (a) dividing the reconstruction image into arrangement areas corresponding to the sub-images, (b) reducing or expanding the partial images to fit a size of a corresponding arrangement area, and (c) arranging the partial images.
An image generating method comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- selecting a first image from the sub-images;
- selecting a first pixel included in the first image;
- selecting a second image from the sub-images;
- searching a second pixel corresponding to the first pixel among pixels included in the second image;
- processing the sub-images by applying a blurring addition process to the first pixel and the second pixel in accordance with a blurring intensity, the blurring intensity being based on a positional relationship between the first pixel and the second pixel and a re-focal length;
- and
- reconstructing an image from the sub-images having been processed.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determining a clipping size of the partial images and clipping positions of the partial images;
- and
- wherein generating the reconstruction image comprises combining partial images corresponding to the clipping positions based on the clipping size and the alignment position of the sub-images, to generate the reconstruction image.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- obtaining image displacement degrees for the sub-images respectively, wherein each of the image displacement degrees indicates a displacement between a position of a predetermined part in the sub-image and a position of a part corresponding to a photographic object captured in the predetermined part in another sub-image;
- clipping partial images from the sub-images, wherein a larger clipping size is determined for the partial images with a larger image displacement degree;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determining a clipping size of the partial images to fit arrangement areas which are obtained by dividing the reconstruction image according to the sub-images.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- clipping partial images from the sub-images;
- and
- generating a reconstruction image by arranging the partial images based on an alignment position of the sub-images corresponding to the partial images;
- wherein clipping the partial images comprises determines a clipping size of the partial images;
- and
- wherein generating the reconstruction image comprises (a) dividing the reconstruction image into arrangement areas corresponding to the sub-images, (b) reducing or expanding the partial images to fit a size of a corresponding arrangement area, and (c) arranging the partial images.
A non-transitory computer-readable storage medium having a computer-executable program stored thereon, the program being executable to control a computer to execute functions comprising:
- obtaining a multi-view image in which sub-images from viewpoints are aligned;
- selecting a first image from the sub-images;
- selecting a first pixel included in the first image;
- selecting a second image from the sub-images;
- searching a second pixel corresponding to the first pixel among pixels included in the second image;
- processing the sub-images by applying a blurring addition process to the first pixel and the second pixel in accordance with a blurring intensity, the blurring intensity being based on a positional relationship between the first pixel and the second pixel and a re-focal length;
- and
- reconstructing an image from the sub-images having been processed.
Dependencies are inferred from the claim text.