# US 2022/0284656 A1 · Semantic texture mapping system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284656 A1
- Document ID: US20220284656A1
- Status: Published application
- Kind: A1
- Application number: 17/752,331
- Filed: 2022-05-24
- Published: 2022-09-08
- Earliest claimed: 2019-04-01
- Assignees: Snap Inc.
- Applicants: : Snap Inc.
- Inventors: Piers Cowburn; David Li; Isac Andreas Müller Sandvik; Qi Pan
- Web page: https://patentgrep.com/patent/US20220284656A1

## CPC

- G06T 15/04: Texture mapping
- G06F 18/2148: {characterised by the process organisation or structure, e.g. boosting cascade}
- G06T 7/11: Region-based segmentation
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06V 30/274: {Syntactic or semantic context, e.g. balancing}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A semantic texture map system to generate a semantic texture map based on a 3D model that comprises a plurality of vertices that include coordinate that indicate positions of the plurality of vertices, a UV map, and a semantic segmentation image that comprises a set of semantic labels.

## Claims

### Claim 1

A method comprising:
causing display of image data at a client device, the image data corresponding with a location;
accessing a repository based on the location, the repository comprising a set of semantic labels that correspond with the location;
retrieving Augmented-Reality (AR) content based on user profile data associated with a user of the client device; and
causing display of a presentation of the AR content at the client device based on the set of semantic labels that correspond with the location.

### Claim 2 (depends on 1)

The method of claim 1, wherein the set of semantic labels include a semantic label that corresponds with a material parameter, and wherein the causing display of the presentation of the AR content is based on the material parameter.

### Claim 3 (depends on 2)

The method of claim 2, wherein the material parameter includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

### Claim 4 (depends on 1)

The method of claim 1, wherein the image data comprises metadata, and the method further comprises:
retrieving the AR content based on the user profile data associated with the user of the client device, and the metadata of the image data.

### Claim 5 (depends on 4)

The method of claim 4, wherein the metadata includes temporal data.

### Claim 6 (depends on 1)

The method of claim 1, wherein the image data comprises a set of image features, and the method further comprises:
identifying the location based on the set of image features.

### Claim 7 (depends on 6)

The method of claim 6, wherein the identifying the location based on the set of image features further comprises:
identifying an object based on the set of image features, the object corresponding with the location; and
identifying the location based on the object.

### Claim 8

A system comprising:
a memory; and
at least one hardware processor coupled to the memory and comprising instructions that causes the system to perform operations comprising:
causing display of image data at a client device, the image data corresponding with a location;
accessing a repository based on the location, the repository comprising a set of semantic labels that correspond with the location;
retrieving Augmented-Reality (AR) content based on user profile data associated with a user of the client device; and
causing display of a presentation of the AR content at the client device based on the set of semantic labels that correspond with the location.

### Claim 9 (depends on 8)

The system of claim 8, wherein the set of semantic labels include a semantic label that corresponds with a material parameter, and wherein the causing display of the presentation of the AR content is based on the material parameter.

### Claim 10 (depends on 9)

The system of claim 9, wherein the material parameter includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

### Claim 11 (depends on 8)

The system of claim 8, wherein the image data comprises metadata, and the method further comprises:
retrieving the AR content based on the user profile data associated with the user of the client device, and the metadata of the image data.

### Claim 12 (depends on 11)

The system of claim 11, wherein the metadata includes temporal data.

### Claim 13 (depends on 8)

The system of claim 8, wherein the image data comprises a set of image features, and the operations further comprise:
identifying the location based on the set of image features.

### Claim 14 (depends on 13)

The system of claim 13, wherein the identifying the location based on the set of image features further comprises:
identifying an object based on the set of image features, the object corresponding with the location; and
identifying the location based on the object.

### Claim 15

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
causing display of image data at a client device, the image data corresponding with a location;
accessing a repository based on the location, the repository comprising a set of semantic labels that correspond with the location;
retrieving Augmented-Reality (AR) content based on user profile data associated with a user of the client device; and
causing display of a presentation of the AR content at the client device based on the set of semantic labels that correspond with the location.

### Claim 16 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the set of semantic labels include a semantic label that corresponds with a material parameter, and wherein the causing display of the presentation of the AR content is based on the material parameter.

### Claim 17 (depends on 16)

The non-transitory machine-readable storage medium of claim 16, wherein the material parameter includes one or more of:
a roughness value;
a metallic value;
a specular value; and
a base color value.

### Claim 18 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the image data comprises metadata, and the method further comprises:
retrieving the AR content based on the user profile data associated with the user of the client device, and the metadata of the image data.

### Claim 19 (depends on 18)

The non-transitory machine-readable storage medium of claim 18, wherein the metadata includes temporal data.

### Claim 20 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the image data comprises a set of image features, and the operations further comprise:
identifying the location based on the set of image features.