# US 10,502,967 B2 · Method for rendering three-dimensional image, imaging method and system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,502,967 B2 - Document ID: US10502967B2 - Status: Granted - Kind: B2 - Application number: 15/866,738 - Filed: 2018-01-10 - Published: 2019-05-02 - Granted: 2019-12-10 - Earliest claimed: 2017-10-27 - Assignees: Cheray Co. Ltd. - Applicants: Cheray Co. Ltd. - Inventors: Chun-Hsiang Yang; Yi-Pai Huang; Kai-Chieh Chang; Chih-Hung Ting; Jui-Yi Wu - Web page: https://patentgrep.com/patent/US10502967B2 ## CPC - H04N 13/307: using fly-eye lenses, e.g. arrangements of circular lenses - G02B 27/0075: {with means for altering, e.g. increasing, the depth of field or depth of focus} - G02B 30/26: of the autostereoscopic type - G02B 30/27: involving lenticular arrays - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - H04N 13/366: using viewer tracking - H04N 13/368: for two or more viewers - H04N 13/376: for tracking left-right translational head movements, i.e. lateral movements - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract The disclosure is related to a method for rendering a three-dimensional image, an imaging method and a system. The system receives three-dimensional image information regarding. A reference image with respect to the three-dimensional image can be created based on the information. According to the physical information relating to multiple optical elements of a display device, an element image corresponding to each optical element is calculated. The multiple elements images corresponding to the multiple optical elements render an integral image. The integral image is used to render the three-dimensional image through the multiple optical elements. In one embodiment, the optical element is a lens set. The integral image is inputted to a display driving unit of the display device so as to render the element image for every lens set. The display device then displays the integral image so as to from the three-dimensional image through a lens array. ## Claims ### Claim 1 A method for rendering a three-dimensional image, comprising: receiving three-dimensional image information, wherein the three-dimensional image information includes a plane image data and a depth map, or a set of coordinates and chromaticity value; using the three-dimensional image information to create a reference image used to render the three-dimensional image to be displayed on a display device; obtaining physical information relating to multi-optical elements of the display device, wherein the physical information of the multi-optical elements at least includes a spatial relation between spatial positions for displaying the three-dimensional image and every optical element, and another spatial relation between every optical element and a display panel of the display device; deriving a plurality of element images, and each of the element images corresponding to each optical element based on the reference image and the physical information relating to the multi-optical elements; forming an integral image corresponding to the plurality of element images with respect to the multi-optical elements for the display device to display the three-dimensional image through the multi-optical elements. ### Claim 2 (depends on 1) The method according to claim 1, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image. ### Claim 3 (depends on 1) The method according to claim 1, wherein, a viewing position is referred to for adjusting the reference image. ### Claim 4 (depends on 3) The method according to claim 3, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image. ### Claim 5 (depends on 1) The method according to claim 1, wherein the optical element is a lens set that is constituted of one or more convex lenses or concave lenses, and the multi-optical elements form a lens array. ### Claim 6 (depends on 1) The method according to claim 1, wherein, if the three-dimensional image information associates with a three-dimensional video, a series of reference images are created and a series of integral images are outputted; the three-dimensional video is displayed through the multi-optical elements. ### Claim 7 (depends on 6) The method according claim 6, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image. ### Claim 8 (depends on 1) An imaging method that is used to display the three-dimensional image rendered by the method according to claim 1, wherein the imaging method comprises: inputting an integral image to a display driving circuit of a display device; and the display driving circuit driving a display to display the integral image, so as to allow the multiple element images of the integral image to be displayed through the multi-optical elements correspondingly to display the three-dimensional image. ### Claim 9 (depends on 8) The method according to claim 8, wherein the three-dimensional image is displayed above, below, in front of or behind a display plane formed through the multi-optical elements of the display device. ### Claim 10 A system for rendering a three-dimensional image, comprising: a plurality of multi-optical elements that are used to render the three-dimensional image, wherein the three-dimensional image information includes a plane image data and a depth map, or a set of coordinates and chromaticity value; a display that is used to display an integral image and the three-dimensional image through the plurality of multi-optical elements; a display driving circuit that is used to drive the display to display the integral image; and an image processor that is used to perform a method for rendering the three-dimensional image comprising: receiving the three-dimensional image information from an image source; using the three-dimensional image information to create a reference image to render the three-dimensional image to be displayed on the display; calculating a plurality of element images, and each of the element images corresponding to each optical element based on the reference image and physical information relating to the plurality of multi-optical elements, wherein the physical information of the plurality of multi-optical elements at least includes a spatial relation between spatial position for displaying the three-dimensional image and every optical element, and another spatial relation between every optical element and a display panel of the display device; and forming an integral image corresponding to the plurality of element images with respect to the multi-optical elements for the display to display the three-dimensional image through the plurality of multi-optical elements. ### Claim 11 (depends on 10) The system according to claim 10, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image. ### Claim 12 (depends on 10) The system according to claim 10, wherein the optical element is a lens set that is constituted of one or more convex lenses or concave lenses, and the multi-optical elements form a lens array. ### Claim 13 (depends on 12) The system according to claim 12, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image. ### Claim 14 (depends on 10) The system according to claim 10, wherein, a viewing position is referred to for adjusting the reference image. ### Claim 15 (depends on 10) The system according to claim 10, wherein the three-dimensional image is displayed above, below, in front of or behind a display plane formed through the multi-optical elements of the display device. ### Claim 16 (depends on 10) The system according to claim 10, wherein, if the three-dimensional image information associates with a three-dimensional video, a series of reference images are created and a series of integral images are outputted; the three-dimensional video is displayed through the multi-optical elements. ### Claim 17 (depends on 16) The system according to claim 16, wherein the three-dimensional image information includes color information and 3D spatial information of the three-dimensional image.