# US 2023/0410154 A1 · Systems and methods for inserting contextual advertisements into a virtual environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410154 A1
- Document ID: US20230410154A1
- Status: Published application
- Kind: A1
- Application number: 18/239,598
- Filed: 2023-08-29
- Published: 2023-12-21
- Earliest claimed: 2018-12-20
- Assignees: Rovi Guides, Inc.
- Applicants: Rovi Guides, Inc.
- Inventors: Alejandro Sanchez Pulido; Carla Mack
- Web page: https://patentgrep.com/patent/US20230410154A1

## CPC

- G06Q 30/0251: Targeted advertisements
- G06Q 30/0269: {based on user profile or attribute}
- G06Q 30/0276: {Advertisement creation}
- G06T 3/60: Rotation of whole images or parts thereof
- G06T 11/65: on geographic maps
- G10L 25/54: for retrieval
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Systems and methods are described herein for inserting contextual advertisements into a virtual environment. While presenting a virtual environment, a media device receives speech input. The media device selects an advertisement from an advertisement database based on the speech. The media device then determines the current environment of the virtual environment and generates a virtual object that is related to the current environment. The media device overlays the selected advertisement over the generated virtual object and displays the generated virtual object in the virtual environment.

## Claims

### Claim at position 1

-55. (canceled)

### Claim 56

A method comprising:
determining a respective surface of a number of surfaces displayed in a virtual environment for placement of a selected advertisement;
determining a currently-displayed viewing angle relative to a fixed reference position in the virtual environment;
determining an orientation of a virtual object relative to the fixed reference position;
calculating a currently-displayed angle of a surface of the virtual object;
calculating an image transformation matrix that matches the currently-displayed angle of the surface of the virtual object;
transforming an image of the selected advertisement using the image transformation matrix; and
displaying the virtual object with the transformed image of the selected advertisement overlaid over the surface of the virtual object at the currently-displayed angle of the surface of the virtual object.

### Claim 57 (depends on 56)

The method of claim 56, wherein the determining the respective surface comprises:
determining, by a processor, whether each respective surface of the number of surfaces displayed in the virtual environment is suitable for placement of the selected advertisement; and
selecting the respective surface for placement of the selected advertisement.

### Claim 58 (depends on 27)

The method of claim 27, wherein the determining whether each respective surface is suitable for placement of the selected advertisement comprises:
analyzing a size, lighting and curvature of the respective surface, as viewed from a perspective of a user from which a user input was received.

### Claim 59 (depends on 56)

The method of claim 56, further comprising:
monitoring a user's speech for keywords; and
detecting a keyword from the user's speech, wherein the selecting the advertisement is based on the detected keyword.

### Claim 60 (depends on 59)

The method of claim 59, wherein the selecting the advertisement based on the keyword further comprises:
identifying a category of advertisement related to a user input;
determining a particular respective advertisement based on a user profile and the identified category; and
selecting the particular respective advertisement.

### Claim 61 (depends on 56)

The method of claim 56, wherein the determining the orientation of the virtual object relative to the fixed reference position comprises:
using content processing circuitry to track a single point, surface edge, or vertex of the virtual object as a reference point from which to display the virtual object; and
comparing the virtual object reference point with the fixed reference position.

### Claim 62 (depends on 56)

The method of claim 56, wherein the determining the orientation of the virtual object relative to the fixed reference position comprises:
identifying a plurality of virtual objects currently being displayed in the virtual environment; and
retrieving metadata of a first virtual object of the plurality of virtual objects.

### Claim 63 (depends on 56)

The method of claim 56, wherein calculating the currently-displayed angle of the surface of the virtual object comprises:
using content processing circuitry to identify the fixed reference position;
analyzing a point in the virtual environment that is identified by a set of coordinates describing a number of degrees from the fixed reference position in a horizontal plane and a number of degrees above or below the fixed reference position in a vertical plane; and
calculating an angle between the point and the fixed reference position.

### Claim 64 (depends on 56)

The method of claim 56, further comprising:
determining whether the virtual object currently displayed in the virtual environment is suitable for displaying the selected advertisement by:
identifying a plurality of virtual objects currently being displayed in the virtual environment;
identifying a respective type of each of the plurality of virtual objects; and
determining whether any virtual object of the plurality of virtual objects is of a type that is suitable for displaying the selected advertisement.

### Claim 65 (depends on 56)

The method of claim 56, wherein the virtual environment is an augmented reality environment.

### Claim 66

A system comprising:
a memory; and
a control circuitry configured to:
determine a respective surface of a number of surfaces displayed in a virtual environment for placement of a selected advertisement;
determine a currently-displayed viewing angle relative to a fixed reference position in the virtual environment;
determine an orientation of a virtual object relative to the fixed reference position;
calculate a currently-displayed angle of a surface of the virtual object;
calculate an image transformation matrix that matches the currently-displayed angle of the surface of the virtual object;
transform an image of the selected advertisement using the image transformation matrix, wherein the transformed image is stored in the memory; and
display the virtual object with the transformed image of the selected advertisement overlaid over the surface of the virtual object at the currently-displayed angle of the surface of the virtual object.

### Claim 67 (depends on 66)

The system of claim 66, wherein the control circuitry is configured to determine the respective surface by:
determining, by a processor, whether each respective surface of the number of surfaces displayed in the virtual environment is suitable for placement of the selected advertisement; and
selecting the respective surface for placement of the selected advertisement.

### Claim 68 (depends on 67)

The system of claim 67, wherein the control circuitry is configured to determine whether each respective surface is suitable for placement of the selected advertisement by:
analyzing a size, lighting and curvature of the respective surface, as viewed from a perspective of a user from which a user input was received.

### Claim 69 (depends on 66)

The system of claim 66, the control circuitry is further configured to:
monitor a user's speech for keywords; and
detect a keyword from the user's speech, wherein the selecting the advertisement is based on the detected keyword.

### Claim 70 (depends on 69)

The system of claim 69, wherein the control circuitry is further configured to select the advertisement based on the keyword by:
identifying a category of advertisement related to a user input;
determining a particular respective advertisement based on a user profile and the identified category; and
selecting the particular respective advertisement.

### Claim 71 (depends on 66)

The system of claim 66, wherein the control circuitry is configured to determine the orientation of the virtual object relative to the fixed reference position by:
using content processing circuitry to track a single point, surface edge, or vertex of the virtual object as a reference point from which to display the virtual object; and
comparing the virtual object reference point with the fixed reference position.

### Claim 72 (depends on 66)

The system of claim 66, wherein the control circuitry is configured to determine the orientation of the virtual object relative to the fixed reference position by:
identifying a plurality of virtual objects currently being displayed in the virtual environment; and
retrieving metadata of a first virtual object of the plurality of virtual objects.

### Claim 73 (depends on 66)

The system of claim 66, wherein the control circuitry is configured to calculate the currently-displayed angle of the surface of the virtual object by:
using content processing circuitry to identify the fixed reference position;
analyzing a point in the virtual environment that is identified by a set of coordinates describing a number of degrees from the fixed reference position in a horizontal plane and a number of degrees above or below the fixed reference position in a vertical plane; and
calculating an angle between the point and the fixed reference position.

### Claim 74 (depends on 66)

The system of claim 66, wherein the control circuitry is further configured to:
determine whether the virtual object currently displayed in the virtual environment is suitable for displaying the selected advertisement by:
identifying a plurality of virtual objects currently being displayed in the virtual environment;
identifying a respective type of each of the plurality of virtual objects; and
determining whether any virtual object of the plurality of virtual objects is of a type that is suitable for displaying the selected advertisement.

### Claim 75 (depends on 66)

The system of claim 66, wherein the virtual environment is an augmented reality environment.
