# US 2016/0196685 A1 · Generating Data for Use in Image Based Lighting Rendering > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0196685 A1 - Document ID: US20160196685A1 - Status: Published application - Kind: A1 - Application number: 15/067,869 - Filed: 2016-03-11 - Published: 2016-07-07 - Earliest claimed: 2009-04-01 - Assignees: Lightmap Limited - Applicants: Lightmap Limited - Inventors: MARK SIMON SEGASBY; SIMON CHRISTOPHER SMITH - Web page: https://patentgrep.com/patent/US20160196685A1 ## CPC - G06T 15/506: {Illumination models} - G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts - G06T 2200/04: involving 3D image data - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2215/16: Using real world measurements to influence rendering - G06T 2219/2021: Shape modification - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method of generating data for use in image based lighting rendering, including displaying a 2-dimensional canvas (202), each point on the 2-dimensional canvas representing a surface co-ordinate of a 3-dimensional object having at least one surface. User input describing creation/modification of at least one shape (205, 205′) having an associated lightness value for use in image based lighting rendering is received via the 2-dimensional canvas. The 2-dimensional canvas is updated in accordance with the user input to display a representation of the at least one shape as created/modified by the user input, the representation on the canvas being distorted to indicate mapping of the at least one shape with respect to at least one said surface of the 3-dimensional object. Data describing the at least one shape for use in graphics rendering is generated. ## Claims ### Claim 1 A method of generating image data for use in image based lighting rendering, the method including: displaying a two-dimensional canvas, each point on the two-dimensional canvas representing a surface coordinate of a three-dimensional scene to be rendered in the image based lighting rendering, said displayed two-dimensional canvas including at least one shape having an associated lightness value, said shape being distorted within said displayed two-dimensional canvas to define an undistorted representation thereof in said three-dimensional scene; receiving, via a computer, user input via interaction with said displayed two-dimensional canvas, said user input describing creation of at least one shape having an associated lightness value or modification of said at least one shape within said displayed two-dimensional canvas; using the computer to update the displayed two-dimensional canvas in accordance with the user input to display said two-dimensional canvas including said created/modified at least one shape distorted within said displayed two-dimensional canvas to define an undistorted representation thereof within said three-dimensional scene; and using the computer to generate the image data describing the distorted representation of the at least one shape for use in graphics rendering of the three-dimensional scene, wherein said image data is lighting image data derived from said displayed two-dimensional canvas including said created/modified at least one shape, and said at least one shape is representative of a light source included in said lighting image data and for use in a graphical rendering process. ### Claim 2 (depends on 1) A method according to claim 1, wherein the image data describing the distorted representation of the at least one shape and derived from said displayed two-dimensional canvas includes a map projection representing the at least one shape within the displayed two-dimensional canvas mapped onto at least a portion of said three-dimensional scene, or an image map. ### Claim 3 (depends on 1) A method according to claim 1, further including performing an image based lighting rendering process based on the data describing the distorted representation of the at least one shape and using the associated lightness value of each said shape. ### Claim 4 (depends on 3) A method according to claim 3, wherein an image produced by the rendering process is output in one of a selection of file formats. ### Claim 5 (depends on 2) A method according to claim 2, wherein the image map comprises a high dynamic range image. ### Claim 6 (depends on 1) A method according to claim 1, wherein the step of updating the displayed two-dimensional canvas is performed substantially instantaneously upon receipt of the user input. ### Claim 7 (depends on 1) A method according to claim 1, wherein the displayed two-dimensional canvas represents a total area of all or at least a portion of said three-dimensional scene. ### Claim 8 (depends on 1) A method according to claim 1, wherein the user input describes modification properties of the at least one shape, the properties being selected from a set including: position of a said shape with respect to at least a portion of said three-dimensional scene; orientation of a shape with respect to at least a portion of said three-dimensional scene; area/extent of a said shape with respect to said three-dimensional scene. ### Claim 9 (depends on 8) A method according to claim 8, wherein the properties of said light source include colour of light projected by said light source or level of lightness projected by said light source. ### Claim 10 (depends on 9) A method according to claim 9, wherein the representation of said light source is generated by a synthetic light generation algorithm/model. ### Claim 11 (depends on 9) A method according to claim 9, wherein the representation of the light source includes an image of a real-world light source. ### Claim 12 (depends on 1) A method according to claim 1, wherein a said shape has a user-defined number and arrangement of sides for its outline. ### Claim 13 (depends on 1) A method according to claim 1, wherein the user input describes modification properties including exposure level of a background upon which at least a portion of said three-dimensional scene is displayed. ### Claim 14 A system configured to generate image data for use in image based lighting rendering, the system including: a display configured to display a two-dimensional canvas, each point on the two-dimensional canvas representing a surface coordinate of a three-dimensional scene to be rendered in the image based lighting rendering, said displayed two-dimensional canvas including at least one shape having an associated lightness value for use in image based lighting rendering, said shape being distorted within said displayed two-dimensional canvas to define an undistorted representation thereof in said three-dimensional scene; a user input device configured to receive user input via interaction with said displayed two-dimensional canvas, said user input describing creation of at least one shape having an associated lightness value for use in image based lighting rendering or modification of said at least one shape within said displayed two-dimensional canvas; a processing component configured to: update the displayed two-dimensional canvas in accordance with the user input to display said two-dimensional canvas including said created/modified at least one shape distorted within said displayed two-dimensional canvas to define an undistorted representation thereof within said three-dimensional scene; and generate the image data describing the distorted representation of the at least one shape for use in graphics rendering of the three-dimensional scene, wherein said image data is lighting image data derived from said displayed two-dimensional canvas including said created/modified at least one shape, and said at least one shape is representative of a light source included in said lighting image data and for use in a graphical rendering process. ### Claim 15 (depends on 1) A computer program product comprising a non-transitory computer readable medium, having thereon computer program code, when the program code is loaded, to make the computer execute a method of generating data for use in image based lighting rendering according to claim 1. ### Claim 16 A method of generating image data for use in image based lighting rendering, the method including: displaying a two-dimensional canvas, each point on the two-dimensional canvas representing a surface coordinate of a three-dimensional scene to be rendered in the image based lighting rendering, said displayed two-dimensional canvas including at least one shape having an associated lightness value, said shape being distorted within said displayed two-dimensional canvas to define an undistorted representation thereof in said three-dimensional scene; repeatedly receiving, via a computer, user input via interaction with said displayed two-dimensional canvas, said user input describing creation of at least one shape having an associated lightness value or modification of said at least one shape within said displayed two-dimensional canvas; and substantially instantaneously updating the displayed two-dimensional canvas in accordance with each user input to display said two-dimensional canvas including said respective created/modified at least one shape distorted within said displayed two-dimensional canvas to define an undistorted representation thereof within said three-dimensional scene; and using the computer to generate the image data describing the distorted representation of the at least one shape for use in graphics rendering of the three-dimensional scene, wherein said image data is lighting image data derived from said displayed two-dimensional canvas including said created/modified at least one shape, and said at least one shape is representative of a light source included in said lighting image data and for use in a graphical rendering process.