# US 2017/0366747 A1 · Generating high resolution images > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0366747 A1 - Document ID: US20170366747A1 - Status: Published application - Kind: A1 - Application number: 15/183,528 - Filed: 2016-06-15 - Published: 2017-12-21 - Earliest claimed: 2016-06-15 - Assignees: QUALCOMM Incorporated - Applicants: QUALCOMM Incorporated - Inventors: Bing Wen; Edward Chan; Shen-Ge Wang; Jian Ma; John Hong - Web page: https://patentgrep.com/patent/US20170366747A1 ## CPC - H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio - G06T 3/4053: based on super-resolution, i.e. the output image resolution being higher than the sensor resolution - H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability} - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Techniques are disclosed for generating a high resolution image from a plurality of images captured from a plurality of sensors. The pixels in one sensor have at least one of different size, shape, or orientation than pixels in another sensor. The difference in size, shape, or orientation of the pixels and the interconnection of pixels on respective sensors provides a high level of certainty that there will be sufficient difference in the captured images, with limited loss in image content, to generate a relatively high resolution image from the images captured by the respective sensors. ## Claims ### Claim 1 A method of image processing, the method comprising: generating pixel data for a first image from image content captured by a plurality of pixels of a first sensor, wherein the plurality of pixels of the first sensor includes a first pixel; generating pixel data for a second image from image content captured by a plurality of pixels of a second sensor, wherein the plurality of pixels of the second sensor includes a second pixel, wherein the second pixel is located in a same relative position in the plurality of pixels of the second senor as the first pixel in the plurality of pixels of the first sensor, and wherein the first pixel differs from the second pixel in at least one of shape, size, or orientation; processing the pixel data for the first image to construct the first image; and processing the pixel data for the second image to construct the second image. ### Claim 2 (depends on 1) The method of claim 1, further comprising: generating a high resolution image based at least on the first image and the second image, wherein the high resolution image includes more image pixels than image pixels in either of the first image or the second image. ### Claim 3 (depends on 2) The method of claim 2, wherein the high resolution image includes more than 2.5 times a number of image pixels in the first image or the second image. ### Claim 4 (depends on 1) The method of claim 1, wherein the shape, size, or orientation of the plurality of pixels of the first sensor configure the pixels of the first sensor to interconnect with each other to achieve 100% fill factor of the image content to capture the entire image content, and wherein the shape, size, or orientation of the plurality of pixels of the second sensor configure the pixels of the second sensor to interconnect with each other to achieve 100% fill factor of the image content to capture the entire image content. ### Claim 5 (depends on 1) The method of claim 1, wherein none of the plurality of pixels of the first sensor and second sensor includes a mask that reduces an amount of captured image content. ### Claim 6 (depends on 1) The method of claim 1, wherein an orientation of each of the pixels in the second sensor is rotated along an optical axis of the first sensor relative to an orientation of each of the pixels in the first sensor. ### Claim 7 (depends on 1) The method of claim 1, further comprising: generating pixel data for a plurality of additional images from image content captured by a plurality of pixels of one or more additional sensors, wherein the plurality of pixels of the one or more additional sensors differ from corresponding pixels of the first sensor and corresponding pixels of the second sensor in at least one of shape, size, or orientation; and processing the pixel data from the plurality of additional images to construct the plurality of additional images. ### Claim 8 (depends on 1) The method of claim 1, wherein the pixels of the first sensor comprise L-shaped pixels, and the pixels of the second sensor comprise L-shaped pixels, and wherein the L-shaped pixels of the first sensor are rotated along an optical axis of the first sensor relative to the L-shaped pixels of the second sensor. ### Claim 9 A device for image processing, the device comprising: a first sensor comprising a plurality of pixels, the first sensor configured to generate pixel data for a first image from image content captured by the plurality of pixels of the first sensor, wherein the plurality of pixels of the first sensor includes a first pixel; a second sensor comprising a plurality of pixels, the second sensor configured to generate pixel data for a second image from image content captured by the plurality of pixels of the second sensor, wherein the plurality of pixels of the second sensor includes a second pixel, wherein the second pixel is located in a same relative position in the plurality of pixels of the second senor as the first pixel in the plurality of pixels of the first sensor, and wherein the first pixel differs from the second pixel in at least one of shape, size, or orientation; and one or more sensor processors configured to: process the pixel data for the first image to construct the first image; and process the pixel data for the second image to construct the second image. ### Claim 10 (depends on 9) The device of claim 9, further comprising: processing circuitry configured to generate a high resolution image based at least on the first image and the second image, wherein the high resolution image includes more image pixels than image pixels in either of the first image or the second image. ### Claim 11 (depends on 10) The device of claim 10, wherein the high resolution image includes more than 2.5 times a number of image pixels in the first image or the second image. ### Claim 12 (depends on 9) The device of claim 9, wherein the shape, size, or orientation of the plurality of pixels of the first sensor configure the pixels of the first sensor to interconnect with each other to achieve 100% fill factor of the image content to capture the entire image content, and wherein the shape, size, or orientation of the plurality of pixels of the second sensor configure the pixels of the second sensor to interconnect with each other to achieve 100% fill factor of the image content to capture the entire image content. ### Claim 13 (depends on 9) The device of claim 9, wherein none of the plurality of pixels of the first sensor and second sensor includes a mask that reduces an amount of captured image content. ### Claim 14 (depends on 9) The device of claim 9, wherein an orientation of each of the pixels in the second sensor is rotated along an optical axis of the first sensor relative to an orientation of each of the pixels in the first sensor. ### Claim 15 (depends on 9) The device of claim 9, further comprising: one or more additional sensors each comprising a plurality of pixels, the one or more additional sensors configured to generate pixel data for a plurality of additional images from image content captured by the plurality of pixels of the one or more additional sensors, wherein the plurality of pixels of the one or more additional sensors differ from corresponding pixels of the first sensor and corresponding pixels of the second sensor in at least one of shape, size, or orientation, wherein the one or more sensor processors are configured to: process the pixel data from the plurality of additional images to construct the plurality of additional images. ### Claim 16 (depends on 9) The device of claim 9, wherein the pixels of the first sensor comprise L-shaped pixels, and the pixels of the second sensor comprise L-shaped pixels, and wherein the L-shaped pixels of the first sensor are rotated along an optical axis of the first sensor relative to the L-shaped pixels of the second sensor. ### Claim 17 (depends on 9) The device of claim 9, wherein the device comprises one of: a wireless communication device, a mobile telephone, a laptop, a desktop, a tablet computer, or a sensor device. ### Claim 18 A device for image processing, the device comprising: a first means for generating pixel data for a first image from image content captured by a plurality of pixels of the first means for generating, wherein the plurality of pixels of the first means for generating includes a first pixel; a second means for generating pixel data for a second image from image content captured by a plurality of pixels of the second means for generating, wherein the plurality of pixels of the second means for generating includes a second pixel, wherein the second pixel is located in a same relative position in the plurality of pixels of the second means for generating as the first pixel in the plurality of pixels of the first means for generating, and wherein the first pixel differs from the second pixel in at least one of shape, size, or orientation; means for processing the pixel data for the first image to construct the first image; and means for processing the pixel data for the second image to construct the second image. ### Claim 19 (depends on 18) The device of claim 18, further comprising: means for generating a high resolution image based at least on the first image and the second image, wherein the high resolution image includes more image pixels than image pixels in either of the first image or the second image. ### Claim 20 (depends on 18) The device of claim 18, wherein none of the plurality of pixels of the first sensor and second sensor includes a mask that reduces an amount of captured image content. ### Claim 21 A computer-readable storage medium having instructions stored thereon that when executed cause one or more processors of a device for image processing to: generate pixel data for a first image from image content captured by a plurality of pixels of a first sensor, wherein the plurality of pixels of the first sensor includes a first pixel; generate pixel data for a second image from image content captured by a plurality of pixels of a second sensor, wherein the plurality of pixels of the second sensor includes a second pixel, wherein the second pixel is located in a same relative position in the plurality of pixels of the second senor as the first pixel in the plurality of pixels of the first sensor, and wherein the first pixel differs from the second pixel in at least one of shape, size, or orientation; process the pixel data for the first image to construct the first image; and process the pixel data for the second image to construct the second image.