# US 11,310,481 B2 · Imaging device, system, method and program for converting a first image into a plurality of second images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,481 B2 - Document ID: US11310481B2 - Status: Granted - Kind: B2 - Application number: 16/170,635 - Filed: 2018-10-25 - Published: 2019-05-02 - Granted: 2022-04-19 - Earliest claimed: 2017-10-26 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Paul Springer; Thimo Emmerich; Zoltan Facius - Web page: https://patentgrep.com/patent/US11310481B2 ## CPC - H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems - G02B 13/16: for use in conjunction with image converters or intensifiers {, or for use with projectors, e.g. objectives for projection TV} - G02B 27/08: Kaleidoscopes - G02B 27/10: Beam splitting or combining systems (polarising systems G02B27/28; mixing and splitting light signals using optical waveguides G02B6/28; {beam shaping, e.g. changing the cross-sectional area, by dividing or superposing multiple light beams G02B27/0905}) - G02B 27/1013: {for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors (spectral imaging systems G01J)} - G02B 27/106: {for splitting or combining a plurality of identical beams or images, e.g. image replication} - G02B 27/14: operating by reflection only - H04N 23/60: Control of cameras or camera modules - H04N 23/673: {based on contrast or high frequency components of image signals, e.g. hill climbing method} - H04N 23/73: by influencing the exposure time - H04N 23/74: by influencing the scene brightness using illuminating means - H04N 23/555: {for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes} - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract An imaging device for converting a first image into a plurality of second images, the imaging device comprising a light receiving unit having a first aperture configured to receive light of the first image, a light reflecting unit configured to reflect the light received by the light receiving unit along a number of paths having a predetermined number of reflections within the light reflecting unit according to a portion of the first aperture from which the light originated, and a light output unit configured to output at least a subset of the paths of light reflected by the light reflecting unit as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflecting unit. ## Claims ### Claim 1 An imaging system for converting a first image into a plurality of second images, the imaging system comprising: a first lens having a first aperture configured to receive light of the first image; a light reflector configured to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated; a second lens configured to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector; image capture circuitry configured to capture information constituting the plurality of second images output by the second lens; and image processing circuitry configured to process the information constituting the plurality of second images captured by the image capture circuitry and to determine, from the information constituting the plurality of second images, a first depth information for forming a three-dimensional image using a focal length of at least one of the plurality of second images based on a number of reflections. ### Claim 2 (depends on 1) The imaging system according to claim 1, wherein the light reflector comprises a solid rod having a refractive index such that the light received from the first lens is reflected along the number of paths having a predetermined number of reflections within the light reflector by total internal reflection within the solid rod. ### Claim 3 (depends on 1) The imaging system according to claim 1, wherein the light reflector comprises a tunnel configured such that the light received from the first lens is reflected along the number of paths having a predetermined number of reflections within the light reflector by reflection off the internal surfaces of the tunnel. ### Claim 4 (depends on 1) The imaging system according to claim 1, wherein the light reflector is a quadratic light reflecting unit and the plurality of second images are output by the second lens as a grid. ### Claim 5 (depends on 1) The imaging system according to claim 1, wherein the second lens is configured such that the subset of the paths of light output by the second lens comprises light experiencing no reflections, light experiencing a single reflection and light experiencing a double reflection within the light reflector. ### Claim 6 (depends on 1) The imaging system according to claim 1, wherein the image processing circuitry is further configured to determine from the information constituting the plurality of second images disparity information between at least two of the plurality of second. images. ### Claim 7 (depends on 6) The imaging system according to claim 6, wherein the image processing circuitry is further configured to determine a second depth information using the disparity information. ### Claim 8 (depends on 1) The imaging system according to claim 1, wherein the image processing circuitry is further configured to use at least one depth information determined from the information constituting the plurality of second images in order to generate a resultant image having an extended depth of field. ### Claim 9 (depends on 8) The imaging system according to claim 8, wherein generating t resultant image having an extended depth of field further comprises performing a sharpness transfer function between the plurality of second images. ### Claim 10 (depends on 1) The imaging system according to claim 1, wherein the image processing circuitry is further configured to use the information constituting the plurality of second images in order to generate a resultant multiview image. ### Claim 11 (depends on 1) The imaging system according to claim 1, wherein the image processing configured to compare to focus levels of the plurality of second images determine the first depth information. ### Claim 12 (depends on 1) A medical device comprising an imaging system according to claim 1 positioned between a probe and an image sensor. ### Claim 13 A method of operating an imaging device for converting a first image into a plurality of second images, the method comprising: controlling a first lens of the imaging device having a first aperture to receive light of the first image; controlling a light reflector of the imaging device to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated; controlling a second lens of the imaging device to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector; capturing information constituting the plurality of second images output by the second lens; and processing the information constituting the plurality of second images captured, processing including determining a first depth information for forming a three-dimensional image using a focal length of at least one of the plurality of second images by comparing focus levels of the plurality of second images based on a number of reflections. ### Claim 14 (depends on 13) The method according to claim 13, wherein determining a first depth information includes comparing focus levels of the plurality of second images. ### Claim 15 (depends on 13) A non-transitory computer readable medium having stored thereon a program that, when executed by a computer, causes the computer to perform a method according to claim 13. ### Claim 16 An imaging system for converting a first image into a plurality of second images, the imaging system comprising: a first lens having a first aperture configured to receive light of the first image; a light reflector configured to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated; a second lens configured to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector; image capture circuitry configured to capture information constituting the plurality of second images output by the second lens; and image processing circuitry configured to process the information constituting the plurality of second images captured by the image capture circuitry, wherein the image processing circuitry is further configured to use the information constituting the plurality of second images from different numbers of reflections to generate multiple unique three-dimensional images.