# US 11,443,511 B2 · Systems and methods for presenting supplemental content in augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,443,511 B2
- Document ID: US11443511B2
- Status: Granted
- Kind: B2
- Application number: 17/171,479
- Filed: 2021-02-09
- Published: 2021-06-03
- Granted: 2022-09-13
- Earliest claimed: 2017-12-28
- Assignees: ROVl GUIDES, INC.
- Applicants: Rovi Guides, Inc.
- Inventors: Adam Bates; Jesse F. Patterson; Mark K. Berner; Eric Dorsey; Jonathan A. Logan; David W. Chamberlin; Paul Stevens; Herbert A. Waterman
- Web page: https://patentgrep.com/patent/US11443511B2

## CPC

- G06Q 10/40: Business processes related to social networking or social networking services
- G06F 16/583: using metadata automatically derived from the content
- G06F 16/5854: {using shape and object relationship}
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/20: in augmented reality scenes
- H04L 51/52: for supporting social networking services
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Systems and methods provided for presenting supplemental content in an augmented reality environment where an object within a field of view of an augmented reality device of a user is identified and processed to detect a reference related to a participant in an event. A user profile or user social network is searched to identify a message from the user about the participant. The message may be combined with the object in the augmented reality field of view.

## Claims

### Claim 1

A method comprising:
detecting an object within a field of view of an augmented reality device of a user;
based on the object, querying a database to search for a social network message related to the object;
in response to identifying the social network message related to the object:
presenting an option to transmit a post to a social network, wherein the post comprises an image of the object and text based on the identified social network message; and
in response to selection of the option, transmitting the post to the social network.

### Claim 2 (depends on 1)

The method of claim 1, wherein the social network message was previously transmitted to the social network of the user, and wherein the social network message is obtained from social network history of the user.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
determining metadata associated with the object based on image analysis of the object; and
parsing the social network message related to the object to determine metadata associated with the social network message.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
comparing the metadata associated with the object to the metadata associated with the social network message to determine whether the social network message is related to the object.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
identifying a list of social network messages related to the object; and
selecting at least one social network message from the list based on time information associated with one or more social network messages included in the list of social network messages.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
identifying a list of social network messages related to the object; and
selecting at least one social network message from the list based on context information associated with one or more social network messages included in the list of the social network messages.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
using the augmented reality device, overlaying the post over the field of view of the augmented reality device of the user.

### Claim 8 (depends on 1)

The method of claim 1, further comprises storing in the database the post with the field of view of the augmented reality device of the user.

### Claim 9 (depends on 1)

The method of claim 1, further comprises presenting an option to share the post with another user.

### Claim 10 (depends on 1)

The method of claim 1, wherein the object comprises a logo, a name, or a symbol of an entity.

### Claim 11

A system comprising:
control circuitry configured to:
detect an object within a field of view of an augmented reality device of a user;
based on the object, query a database to search for a social network message related to the object;
in response to identifying the social network message related to the object:
present an option to transmit a post to a social network, wherein the post comprises an image of the object and text based on the identified social network message; and
in response to selection of the option, transmit the post to the social network.

### Claim 12 (depends on 11)

The system of claim 11, wherein the social network message was previously transmitted to the social network of the user, and wherein the social network message is obtained from social network history of the user.

### Claim 13 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
determine metadata associated with the object based on image analysis of the object; and
parse the social network message related to the object to determine metadata associated with the social network message.

### Claim 14 (depends on 13)

The system of claim 13, wherein the control circuitry is further configured to:
compare the metadata associated with the object to the metadata associated with the social network message to determine whether the social network message is related to the object.

### Claim 15 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
identify a list of social network messages related to the object; and
select at least one social network message from the list based on time information associated with one or more social network messages included in the list of social network messages.

### Claim 16 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
identify a list of social network messages related to the object; and
select at least one social network message from the list based on context information associated with one or more social network messages included in the list of the social network messages.

### Claim 17 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to:
overlay the post over the field of view of the augmented reality device of the user.

### Claim 18 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to store in the database the post with the field of view of the augmented reality device of the user.

### Claim 19 (depends on 11)

The system of claim 11, wherein the control circuitry is further configured to present an option to share the post with another user.

### Claim 20 (depends on 11)

The system of claim 11, wherein the object comprises a logo, a name, or a symbol of an entity.