# US 2021/0279947 A1 · Methods and Systems for Using Dynamic Lightmaps to Present 3D Graphics

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279947 A1
- Document ID: US20210279947A1
- Status: Published application
- Kind: A1
- Application number: 17/329,419
- Filed: 2021-05-25
- Published: 2021-09-09
- Earliest claimed: 2019-07-31
- Assignees: Verizon Patent and Licensing Inc.
- Applicants: Verizon Patent and Licensing Inc.
- Inventors: Oliver S. Castaneda; William Robert Davey
- Web page: https://patentgrep.com/patent/US20210279947A1

## CPC

- G06T 15/506: {Illumination models}
- G06T 15/04: Texture mapping
- G06T 15/06: Ray-tracing
- G06T 15/20: Perspective computation
- G06T 15/50: Lighting effects
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- H04L 65/765: {intermediate}
- G06T 2215/12: Shadow map, environment map
- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Illustrative methods and systems described herein use lightmaps to present 3D graphics. For example, a method includes identifying a viewpoint within a 3D scene and receiving a dynamic lightmap for an object represented by a 3D model in the 3D scene. The identified viewpoint is selected by a user of a media player device presenting the 3D scene to the user and the dynamic lightmap is generated or updated at a first level of detail determined based on the identified viewpoint. The method further includes rendering an image for presentation to the user from the identified viewpoint. This rendering of the image includes rendering the 3D model at a second level of detail that is lower than the first level of detail, and applying the dynamic lightmap at the first level of detail to the 3D model rendered at the second level of detail. Corresponding systems are also disclosed.

## Claims

### Claim 1

A method comprising:
identifying a viewpoint within a 3D scene, the viewpoint selected by a user of a media player device presenting the 3D scene to the user;
receiving a dynamic lightmap for an object represented by a 3D model in the 3D scene, the dynamic lightmap generated or updated at a first level of detail determined based on the identified viewpoint; and
rendering an image for presentation to the user from the identified viewpoint, the rendering of the image including:
rendering the 3D model at a second level of detail that is lower than the first level of detail, and
applying the dynamic lightmap generated or updated at the first level of detail to the 3D model rendered at the second level of detail.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first level of detail at which the dynamic lightmap is generated or updated is further determined based on a size of the object as presented within the 3D scene.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first level of detail at which the dynamic lightmap is generated or updated is determined based on the identified viewpoint by being determined based on a proximity, within the 3D scene, of a location of the object to a location associated with the identified viewpoint.

### Claim 4 (depends on 1)

The method of claim 1, wherein:
the dynamic lightmap is associated with a particular scene geometry for the 3D model of the object in the 3D scene;
within the particular scene geometry, a surface point included on the 3D model is located at a first location within the 3D scene and is illuminated by a light source located at a second location within the 3D scene; and
the dynamic lightmap is generated or updated based on raytracing of virtual light rays from the second location to the first location.

### Claim 5 (depends on 4)

The method of claim 4, wherein the light source that illuminates the surface point within the 3D scene is a direct light source generating the virtual light rays that are traceable, via the raytracing, from the direct light source immediately to the surface point.

### Claim 6 (depends on 4)

The method of claim 4, wherein the light source that illuminates the surface point within the 3D scene is an indirect light source reflecting the virtual light rays generated by a direct light source or reflecting from an additional indirect light source, the virtual light rays traceable, via the raytracing, from the indirect light source to the surface point.

### Claim 7 (depends on 1)

The method of claim 1, wherein:
when received, the dynamic lightmap for the object is included within a tiled lightmap frame together with an additional dynamic lightmap for an additional object represented by an additional 3D model in the 3D scene; and
the method further comprises extracting the dynamic lightmap and the additional dynamic lightmap from the tiled lightmap frame prior to the rendering of the image for presentation to the user.

### Claim 8 (depends on 1)

The method of claim 1, wherein the receiving of the dynamic lightmap includes:
receiving an encoded video stream representative of a lightmap frame sequence that includes a sequence of lightmap frames each depicting the dynamic lightmap as generated or updated for a respective time during a time period throughout which the 3D scene is presented by the media player device; and
decoding the encoded video stream to extract the lightmap frame sequence and the dynamic lightmap for each of the respective times during the time period.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
receiving, together with the sequence of lightmap frames for each of the respective times during the time period, metadata indicative of a respective timestamp for each of the respective times during the time period; and
rendering, based on the metadata and the sequence of lightmap frames, a sequence of images for presentation to the user during the time period, the sequence of images including the image and the rendering of the sequence of images including the rendering of the image.

### Claim 10

A system comprising:
a memory storing instructions; and
a processor communicatively coupled to the memory and configured to execute the instructions to:
identify a viewpoint within a 3D scene, the viewpoint selected by a user of a media player device presenting the 3D scene to the user;
receive a dynamic lightmap for an object represented by a 3D model in the 3D scene, the dynamic lightmap generated or updated at a first level of detail determined based on the identified viewpoint; and
render an image for presentation to the user from the identified viewpoint, wherein the processor renders the image by performing operations including:
rendering the 3D model at a second level of detail that is lower than the first level of detail, and
applying the dynamic lightmap generated or updated at the first level of detail to the 3D model rendered at the second level of detail.

### Claim 11 (depends on 10)

The system of claim 10, wherein the first level of detail at which the dynamic lightmap is generated or updated is further determined based on a size of the object as presented within the 3D scene.

### Claim 12 (depends on 10)

The system of claim 10, wherein the first level of detail at which the dynamic lightmap is generated or updated is determined based on the identified viewpoint by being determined based on a proximity, within the 3D scene, of a location of the object to a location associated with the identified viewpoint.

### Claim 13 (depends on 10)

The system of claim 10, wherein:
the dynamic lightmap is associated with a particular scene geometry for the 3D model of the object in the 3D scene;
within the particular scene geometry, a surface point included on the 3D model is located at a first location within the 3D scene and is illuminated by a light source located at a second location within the 3D scene; and
the dynamic lightmap is generated or updated based on raytracing of virtual light rays from the second location to the first location.

### Claim 14 (depends on 13)

The system of claim 13, wherein the light source that illuminates the surface point within the 3D scene is a direct light source generating the virtual light rays that are traceable, via the raytracing, from the direct light source immediately to the surface point.

### Claim 15 (depends on 13)

The system of claim 13, wherein the light source that illuminates the surface point within the 3D scene is an indirect light source reflecting the virtual light rays generated by a direct light source or reflecting from an additional indirect light source, the virtual light rays traceable, via the raytracing, from the indirect light source to the surface point.

### Claim 16 (depends on 10)

The system of claim 10, wherein:
when received, the dynamic lightmap for the object is included within a tiled lightmap frame together with an additional dynamic lightmap for an additional object represented by an additional 3D model in the 3D scene; and
the processor is further configured to execute the instructions to extract the dynamic lightmap and the additional dynamic lightmap from the tiled lightmap frame prior to the rendering of the image for presentation to the user.

### Claim 17 (depends on 10)

The system of claim 10, wherein the processor receives the dynamic lightmap by performing operations including:
receiving an encoded video stream representative of a lightmap frame sequence that includes a sequence of lightmap frames each depicting the dynamic lightmap as generated or updated for a respective time during a time period throughout which the 3D scene is presented by the media player device; and
decoding the encoded video stream to extract the lightmap frame sequence and the dynamic lightmap for each of the respective times during the time period.

### Claim 18

A non-transitory computer-readable medium storing instructions that, when executed, direct a processor of a computing device to:
identify a viewpoint within a 3D scene, the viewpoint selected by a user of a media player device presenting the 3D scene to the user;
receive a dynamic lightmap for an object represented by a 3D model in the 3D scene, the dynamic lightmap generated or updated at a first level of detail determined based on the identified viewpoint; and
render an image for presentation to the user from the identified viewpoint, wherein the processor renders the image by performing operations including:
rendering the 3D model at a second level of detail that is lower than the first level of detail, and
applying the dynamic lightmap generated or updated at the first level of detail to the 3D model rendered at the second level of detail.

### Claim 19 (depends on 18)

The non-transitory computer-readable medium of claim 18, wherein the first level of detail at which the dynamic lightmap is generated or updated is further determined based on a size of the object as presented within the 3D scene.

### Claim 20 (depends on 19)

The non-transitory computer-readable medium of claim 19, wherein the first level of detail at which the dynamic lightmap is generated or updated is determined based on the identified viewpoint by being determined based on a proximity, within the 3D scene, of a location of the object to a location associated with the identified viewpoint.
