# US 2019/0174115 A1 · Light field data representation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174115 A1 - Document ID: US20190174115A1 - Status: Published application - Kind: A1 - Application number: 15/761,095 - Filed: 2016-09-16 - Published: 2019-06-06 - Earliest claimed: 2015-09-17 - Assignees: Thomson Licensing - Applicants: THOMSON Licensing - Inventors: Valter DRAZIC; Guillaume BOISSON; Mozhdeh SEIFI - Web page: https://patentgrep.com/patent/US20190174115A1 ## CPC - H04N 13/178: Metadata, e.g. disparity information - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 7/557: from light fields, e.g. from plenoptic cameras - G06T 7/60: Analysis of geometric attributes - G06T 11/26: Drawing of charts or graphs - H04N 13/15: for colour aspects of image signals - H04N 23/957: Light-field or plenoptic cameras or camera modules - G06T 2200/21: involving computational photography - G06T 2207/10052: Images from lightfield camera - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method for reducing the parameters defining an acquired light field ray which enables only the colour associated with the light field ray to be stored instead of 4 light field co-ordinates (x,y,i,j) and its associated colour. ## Claims ### Claim 1 A computer implemented method for generating data representative of a light field, the method comprising: obtaining intersection data defining intersections of light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene, each set of intersection data corresponding to a light field ray having a colour value; determining, one or more data hyper-planes representing the intersection data in a parameter space of sampling cells; scanning data on or around the data hyper-planes by means of parametric equations to sample data representative of the light field ray providing a data format representative of the light field including at least one data parameter defining the at least one data hyper plane in the parameter space and the colour value associated with each light field ray. ### Claim 2 (depends on 1) A method according to claim 1, wherein the one or more data hyper-planes are determined by discrete radon transformation. ### Claim 3 (depends on 2) A method according to claim 2, wherein two orthogonal discrete radon transforms are applied in the parameter space to obtain the one or more hyper planes. ### Claim 4 (depends on 1) A method according to claim 1 wherein the one or more data hyper-planes are determined from data defining camera acquisition parameters ### Claim 5 A method according to any preceding claim wherein scanning the data comprises applying the following algorithm for each i ϵ [0, N— 1] ⊂ for each j ϵ [0, M − 1] ⊂ for each k ϵ [0, K − 1] ⊂ calculate l ϵ store RGB value of the ray located m cell i, j, k, l end for k end for j end for i ### Claim 6 A method according to any preceding clam wherein the data parameters defining the at least one data hyper-plane include data representative of at least one of: minimum value of intersection data of a first reference plane; maximum value of intersection data of the first reference plane; minimum value of intersection data of a second reference plane; maximum value of intersection data of the second reference plane; the number of sampling cells defining the parameter space; the position of the first reference plane; and the position of the second reference plane. ### Claim 7 A method according to any preceding claim wherein each data hyper-plane is defined by a plurality of cells of the parameter space, at least one first cell representative of the interception of the line with an axis and at least one second cell from which the slope of the line may be determined. ### Claim 8 A method according to any preceding claim wherein each digital hyper-plane is generated by application of Bresenham's algorithm. ### Claim 9 A method according to any preceding claim wherein a beam of rays is represented as a plurality of hyper-planes having the same slope and different axis interception points. ### Claim 10 (depends on 9) A method according to claim 9 wherein the data representative of the acquired light field data comprises data representative of the thickness of the beam based on upper and lower boundaries of the axis interception data of lines of the beam. ### Claim 11 A method for generating light field rays from light field data provided according to the method of any preceding claim comprising reading the meta data defining data parameters defining at least one hyper-plane and reading colour data cell by cell ### Claim 12 A device for providing metadata for captured light field data, the device comprising a light field data acquisition module for acquiring light field data captured by a light field camera and a light field data generation module configured to obtain intersection data defining intersections of light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene, each set of intersection data corresponding to a light field ray having a colour value; determine, one or more data hyper-planes representing the intersection data in a parameter space of sampling cells; scan data on or around the data hyper-planes by means of parametric equations to sample data representative of the light field ray provide a data format representative of the light field including at least one data parameter defining the hyper-plane in the parameter space and the colour value associated with each generated light field ray. ### Claim 13 (depends on 12) A light field imaging device comprising: an array of micro lenses arranged in a regular lattice structure; a photosensor configured to capture light projected on the photosensor from the array of micro lenses, the photosensor comprising sets of pixels, each set of pixels being optically associated with a respective micro lens of the array of micro lenses; and a device for providing metadata in accordance with claim 12. ### Claim 14 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11) A device for rendering an image from light field data obtained using a method in accordance with any one of claims 1 to 11. ### Claim 15 A data package for data representative of rays of a light field comprising at least one data parameter defining a hyper-plane in a parameter space, the hyper plane representing intersection data defining intersections of light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene, each set of intersection data corresponding to a light field ray having a colour value; and the colour value associated with each light field ray. ### Claim 16 A computer implemented method for generating data representative of a light field comprising acquiring (S701) light field data representative of light field rays captured from a scene; obtaining (S702) , from the acquired light field data, intersection data defining intersections of the light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene; and obtaining ray diagram parameters (S704, S705) defining the graphical representation of the intersection data in a ray diagram to provide data representative of the acquired light field data. ### Claim 17 (depends on 16) A method according to claim 16 wherein the interception data corresponding to the light field rays is graphically represented in the ray diagram as datelines and the ray diagram parameters include data representative of at least one of: the slope of a dateline; and an interception of a dateline with an axis of the ray diagram. ### Claim 18 (depends on 17) A method according to claim 17 wherein the datelines are detected in the ray diagram by applying a Radon transform. ### Claim 19 (depends on 17, 18) A method according to claim 17 or 18 wherein the graphical representation is provided as a matrix of cells to provide a digital dataline, each digital dataline format being defined by a plurality of cells, at least one first cell representative of the interception of the line with an axis and at least one second cell from which the slope of the line may be determined. ### Claim 20 (depends on 19) A method according to claim 19 wherein each digital dataline is generated by application of Bresenham's algorithm. ### Claim 21 (depends on 19, 20) A method according to claim 19 or 20 wherein the data representative of the acquired light field data comprises data defining the matrix of cells. ### Claim 22 (depends on 16, 17, 18, 19, 20, 21) A method according to any one of claims 16 to 21 wherein the data representative of the acquired light field data further comprises colour data representing the colour of the corresponding light field rays. ### Claim 23 (depends on 16, 17, 18, 19, 20, 21, 22) A method according to any one of claims 16 to 22 wherein the data representative of the acquired light field data comprises data defining the number of cameras used to capture the light field rays. ### Claim 24 (depends on 17, 18, 19, 20, 21, 22, 23) A method according to any one of claims 17 to 23 wherein a beam of rays is represented as a plurality of lines having the same slope and different axis interception points. ### Claim 25 (depends on 24) A method according to claim 24 wherein the data representative of the acquired light field data comprises data representative of the thickness of the beam based on upper and lower boundaries of the axis interception data of lines of the beam. ### Claim 26 (depends on 25) A method according to claim 25 wherein the data representative of the acquired light field data is provided as meta data, the header of meta data comprising the ray diagram parameters defining the graphical representation of the intersection data in a ray diagram and the body of the metadata comprising data representative of colour of the ray. ### Claim 27 A device for providing metadata for captured light field data, the device comprising a light field data acquisition module for acquiring light field data captured by a light field camera and a light field data generation module configured to obtain, from the acquired light field data, intersection data defining intersections of the light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene; and obtain ray diagram parameters defining the graphical representation of the intersection data in a ray diagram to provide data representative of the acquired light field data. ### Claim 28 (depends on 12) A light field imaging device comprising: an array of micro lenses arranged in a regular lattice structure; a photosensor configured to capture light projected on the photosensor from the array of micro lenses, the photosensor comprising sets of pixels, each set of pixels being optically associated with a respective micro lens of the array of micro lenses; and a device for providing metadata in accordance with claim 12. ### Claim 29 (depends on 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26) A device for rendering an image from light field data a processor for processing data obtained in accordance with the method of any one of claims 16 to 26; and a display for rendering an image in accordance with the processed data ### Claim 30 A data package for data representative of rays of a light field comprising ray diagram parameters defining the graphical representation in a ray diagram of intersection data of the light rays, the intersection data defining intersections of the light field rays from the scene with a plurality of given reference planes, said reference planes corresponding to different depths in the scene; and colour data defining colours of the light field ray. ### Claim 31 (depends on 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26) A computer program product for a programmable apparatus, the computer program product comprising a sequence of instructions for implementing a method according to any one of claims 1 to 10 or 16 to 26 when loaded into and executed by the programmable apparatus.