# US 2015/0106200 A1 · Enhancing a user's experience by providing related content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0106200 A1
- Document ID: US20150106200A1
- Status: Published application
- Kind: A1
- Application number: 14/514,685
- Filed: 2014-10-15
- Published: 2015-04-16
- Earliest claimed: 2013-10-15
- Inventors: David Elmekies
- Web page: https://patentgrep.com/patent/US20150106200A1

## CPC

- G06Q 30/0255: {based on user history}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

The present invention is directed to a modified display for a computing device, where a computing device recognizes a marker in a display, communicates with a remote server to return content associated with the recognized marker, and augments the display by inserting the returned content to a preferred position and orientation in the display.

## Claims

### Claim 1

A method for a processor-controlled computing device in communication with a video display to customize said video display by concurrently displaying a plurality of video feeds, comprising the steps of:
receiving a first video feed from a camera in communication with said computing device,
identifying an encoding in said first video feed, including identifying said encoding's position and orientation,
said processor tracking movement of said encoding's position and orientation,
said processor querying a database for an entry associated with said encoding, wherein data of said entry represent content for a superimposed feed and instructions for display of said content, and
said processor directing said video display to display said content in accordance with said instructions;
wherein the position and orientation of said superimposed feed are synchronized with any changing position and orientation of said encoding.

### Claim 2 (depends on 1)

The method of claim 1 wherein said encoding is recognized as border points of an image.

### Claim 3 (depends on 1)

The method of claim 1 wherein said encoding represents an object in the field of vision.

### Claim 4 (depends on 1)

The method of claim 1 wherein said superimposed feed appears as an augmented reality display.

### Claim 5 (depends on 1)

The method of claim 1 wherein said superimposed feed is a still image.

### Claim 6 (depends on 1)

The method of claim 1 wherein said superimposed feed is in the form of video.

### Claim 7 (depends on 1)

The method of claim 1, wherein said computing device further includes an audio player and said processor concurrently delivers audio to said audio player and said superimposed image changes at least in part based on said audio.

### Claim 8 (depends on 1)

The method of claim 1, wherein said superimposed image changes based on user input, where said input includes at least one of a keystroke, multi-touch, or audio.

### Claim 9

A system for concurrently displaying a live video feed and a superimposed video feed comprising:
a video camera;
a processor-controlled computer;
a video display;
an encoded object;
a data library with entries including digital content and display instructions for displaying said digital content;
a tracker to track the movement and orientation of an encoding in said encoded object;
wherein said live video camera delivers said live video feed for display on said video display; and
wherein said processor identifies an encoding in said encoded object, identifies an entry in said data library corresponding to said encoding, superimposes a video feed in at least in the position of said encoding, and synchronizes the superimposed video feed to any changing position and orientation of said encoding.

### Claim 10 (depends on 9)

The system of claim 9 wherein said encoding is recognized as border points of an image.

### Claim 11 (depends on 9)

The system of claim 9 wherein said encoding represents an object in the field of vision.

### Claim 12 (depends on 9)

The system of claim 9 wherein said superimposed feed appears as an augmented reality display.

### Claim 13 (depends on 9)

The system of claim 9 wherein said superimposed feed is a still image.

### Claim 14 (depends on 9)

The system of claim 9 wherein said superimposed feed is in the form of video.

### Claim 15 (depends on 9)

The system of claim 9 wherein said computing device further includes an audio player and said processor concurrently delivers audio to said audio player and said superimposed image changes at least in part based on said audio.

### Claim 16 (depends on 15)

The system of claim 15 wherein said audio is selected by said processor based on at least one of a microphone input or audio playback from said computer or an external sound delivery device.

### Claim 17 (depends on 9)

The system of claim 9 wherein said superimposed image changes based on user input, where said input includes at least one of a keystroke, multi-touch, or audio.

### Claim 18

A method for a processor based computing device to form a merged image on a video display comprising the steps of:
receiving a first video feed from a camera associated with a computing device, where said first video feed;
recognizing an image and its position and orientation in said first video feed;
querying a database and receiving in response data content and instructions for display of said data content; and
delivering a merged video feed inclusive of representation of said content to said display which includes an augmented reality effect relative to the position of said image;
wherein said merged video feed is adjusted based on the position and orientation of said image.

### Claim 19 (depends on 18)

The method of claim 18 wherein said image is recognized based upon recognizing at least some of its border points.

### Claim 20 (depends on 18)

The method of claim 18 wherein said superimposed content is included in the form of video.
