# US 2025/0097548 A1 · Mixed reality media content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0097548 A1
- Document ID: US20250097548A1
- Status: Published application
- Kind: A1
- Application number: 18/970,441
- Filed: 2024-12-05
- Published: 2025-03-20
- Earliest claimed: 2022-09-29
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Sharon Moll; Piotr Gurgul; Dawei Zhang
- Web page: https://patentgrep.com/patent/US20250097548A1

## CPC

- H04N 21/8545: for generating interactive applications
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06K 19/06037: {multi-dimensional coding}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS

## Abstract

A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

## Claims

### Claim 1

A method comprising:
causing display of image data at a client device, the image data depicting a graphical code on a surface of an object;
detecting the graphical code within the image data;
determining one or more edges of the surface of the object responsive to the detecting the graphical code; and
causing display of a presentation of media content at a position within the image data based on the one or more edges of the surface of the object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the determining the one or more edges of the surface of the object includes:
generating a depth map that depicts the surface of the object; and
determining the one or more edges based on the depth map.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving an input that selects the presentation of the media content; and
executing the media content responsive to the input that selects the presentation of the media content.

### Claim 4 (depends on 3)

The method of claim 3, wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:
executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

### Claim 5 (depends on 1)

The method of claim 1, wherein the media content comprises video data.

### Claim 6 (depends on 1)

The method of claim 1, wherein the graphical code includes a QR code.

### Claim 7 (depends on 1)

The method of claim 1, wherein the causing display of the presentation of the media content at the position within the bounding box further comprises:
determining an orientation of the object; and
causing display of the presentation of the media content based on the orientation of the object.

### Claim 8

A system comprising:
one or more processors of a machine; and
a memory storing instructions that, when executed by at least one processor among the one or more processors, causes the machine to perform operations comprising:
causing display of image data at a client device, the image data depicting a graphical code on a surface of an object;
detecting the graphical code within the image data;
determining one or more edges of the surface of the object responsive to the detecting the graphical code; and
causing display of a presentation of media content at a position within the image data based on the one or more edges of the surface of the object.

### Claim 9 (depends on 8)

The system of claim 8, wherein the determining the one or more edges of the surface of the object includes:
generating a depth map that depicts the surface of the object; and
determining the one or more edges based on the depth map.

### Claim 10 (depends on 8)

The system of claim 8, wherein the operations further comprise:
receiving an input that selects the presentation of the media content; and
executing the media content responsive to the input that selects the presentation of the media content.

### Claim 11 (depends on 10)

The system of claim 10, wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:
executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

### Claim 12 (depends on 8)

The system of claim 8, wherein the media content comprises video data.

### Claim 13 (depends on 8)

The system of claim 8, wherein the graphical code includes a QR code.

### Claim 14 (depends on 8)

The system of claim 8, wherein the causing display of the presentation of the media content at the position within the bounding box further comprises:
determining an orientation of the object; and
causing display of the presentation of the media content based on the orientation of the object.

### Claim 15

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:
causing display of image data at a client device, the image data depicting a graphical code on a surface of an object;
detecting the graphical code within the image data;
determining one or more edges of the surface of the object responsive to the detecting the graphical code; and
causing display of a presentation of media content at a position within the image data based on the one or more edges of the surface of the object.

### Claim 16 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the determining the one or more edges of the surface of the object includes:
generating a depth map that depicts the surface of the object; and
determining the one or more edges based on the depth map.

### Claim 17 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the operations further comprise:
receiving an input that selects the presentation of the media content; and
executing the media content responsive to the input that selects the presentation of the media content.

### Claim 18 (depends on 17)

The non-transitory machine-readable storage medium of claim 17, wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:
executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

### Claim 19 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the media content comprises video data.

### Claim 20 (depends on 15)

The non-transitory machine-readable storage medium of claim 15, wherein the graphical code includes a QR code.
