# US 2013/0254651 A1 · Digital Image and Content Display Systems and Methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0254651 A1
- Document ID: US20130254651A1
- Status: Published application
- Kind: A1
- Application number: 13/777,917
- Filed: 2013-02-26
- Published: 2013-09-26
- Earliest claimed: 2012-03-22
- Assignees: Luminate, Inc.
- Applicants: Luminate, Inc.
- Inventors: Amy Lee
- Web page: https://patentgrep.com/patent/US20130254651A1

## CPC

- G06F 16/958: Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F 16/434: {using image data, e.g. images, photos, pictures taken by a user}
- G06F 16/438: Presentation of query results
- G06F 40/154: Tree transformation for tree-structured or markup documents, e.g. XSLT, XSL-FO or stylesheets
- G06F 40/166: Editing, e.g. inserting or deleting
- G06Q 30/00: Commerce
- G06T 13/80: Two-dimensional [2D] animation, e.g. using sprites
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Disclosed herein are systems and methods for displaying images and contextually relevant content on a digital content platform, such as a web page. In one embodiment, for example, the systems and methods include: (1) providing a publisher of the image with a reference script for publication with the image, wherein the reference script is a computer-readable instruction that causes an end-user device to call to a content server; and (2) configuring the content server to (a) receive a request for content from the end-user device, (b) identify content that is contextually relevant to the image, (c) deliver the content to the end-user device, and (d) deliver a computer-readable instruction that causes the end-user device to perform an animation that modifies the image and displays the content in a spatial relationship with respect to the image as originally published.

## Claims

### Claim 1

A non-transient computer-readable storage medium for displaying additional content associated with images published on a digital content platform, comprising:
instructions executable by at least one processing device that, when executed, cause the processing device to
(a) publish one or more images on the digital content platform,
(b) provide an interface that allows an end-user to activate a published image,
(c) request additional content for the activated image from a content server,
(d) submit image data for the activated image to a content decision engine of the content server,
wherein the image data is selected from the group consisting of: the activated image, an image identifier, an image hash, an image unique reference locator (URL), an image tag, and combinations thereof,
wherein the content server uses the image data to identify additional content for association with the activated image,
wherein the additional content is selected from the group consisting of: an advertisement, text, data, an image, a video, one or more controls, applications, computer-readable instructions, interactive functions, informational functions, third-party in-image applications, and combinations thereof, and
(e) receive the additional content from the content server, and
(f) perform an animation that modifies the activated image, based on the additional content received from the content server, so as to display the additional content to appear on a backside of the activated image, to overlay the activated image, or to completely cover the activated image, wherein the additional content includes content contextually relevant to the activated image and wherein the additional content is identified by the content decision engine based on input selected from the group consisting of: algorithmic identification or analysis of the image, image recognition protocols, proximate text recognition algorithms that search for contextual information of the image based on text published proximate to the image, a submission of the image to a crowdsource network to identify the context of the image and tag the image with relevant data, a thematic tagging engine to identify and tag the image with relevant data based on a pre-defined theme, and publisher provided data on the image.

### Claim 2 (depends on 1)

The computer-readable storage medium of claim 1, wherein the digital content platform is a mobile device application.

### Claim 3 (depends on 1)

The computer-readable storage medium of claim 1, wherein the digital content platform is selected from the group consisting of: a web page, a website, a browser-based web application, software application, and a TV widget.

### Claim at position 4

-5. (canceled)

### Claim 6

A non-transient computer-readable storage medium for displaying contextually relevant content associated with images published in a mobile application, comprising:
instructions executable by at least one processing device that, when executed, cause the processing device to
(a) publish one or more images in the mobile application,
(b) provide a user interface that allows an end-user to request additional content for at least one of the published images by activating the image with the user interface,
(c) submit image data for the activated image to a content decision engine of a content server,
wherein the image data is selected from the group consisting of: the published image, an image identifier, an image hash, an image unique reference locator (URL), and an image tag, and
wherein the content decision engine uses the image data to identify additional content for association with the image,
(d) receive the additional content for the activated image from the content decision engine, and
(e) perform an animation that modifies the activated image to display the additional content so as to appear on a backside of the activated image, to overlay the activated image with the additional content, or to completely cover the activated image with the additional content, wherein the additional content includes content contextually relevant to the activated image and wherein the additional content is identified by the content decision engine based on input selected from the group consisting of: algorithmic identification or analysis of the image, image recognition protocols, proximate text recognition algorithms that search for contextual information of the image based on text published proximate to the image, a submission of the image to a crowdsource network to identify the context of the image and tag the image with relevant data, a thematic tagging engine to identify and tag the image with relevant data based on a pre-defined theme, and publisher provided data on the image.

### Claim 7 (depends on 6)

The computer-readable storage medium of claim 6, wherein the additional content is an advertisement.

### Claim at position 7

-9. (canceled)

### Claim 10

A non-transient computer-readable storage medium for displaying content related to images published on a digital content platform, comprising:
instructions executable by at least one processing device that, when executed, cause the processing device to
(a) publish one or more images on the digital content platform,
(b) provide a user interface that allows an end-user to activate a published image,
(c) identify content related to the activated image, and
(d) perform an animation that modifies the activated image to display the related content so as to appear on a backside of the activated image, to overlay the activated image with the related content, or to completely cover the activated image with the related content, wherein the related content includes content contextually relevant to the activated image and wherein the additional content is identified by a content decision receiving input selected from the group consisting of: algorithmic identification or analysis of the image, image recognition protocols, proximate text recognition algorithms that search for contextual information of the image based on text published proximate to the image, a submission of the image to a crowdsource network to identify the context of the image and tag the image with relevant data, a thematic tagging engine to identify and tag the image with relevant data based on a pre-defined theme, and publisher provided data on the image.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the related content is identified by receiving the related content from a service provider's content server.

### Claim 12

(canceled)

### Claim 13 (depends on 10)

The computer-readable storage medium of claim 10, wherein the digital content platform is a mobile device application.

### Claim 14 (depends on 10)

The computer-readable storage medium of claim 10, wherein the digital content platform is selected from the group consisting of: a web page, a website, a browser-based web application, software application, and a TV widget.

### Claim 15 (depends on 10)

The computer-readable storage medium of claim 10, wherein the related content is an advertisement.

### Claim 16

(canceled)

### Claim 17 (depends on 10)

The computer-readable storage medium of claim 10, wherein the additional content is selected from the group consisting of: an advertisement, text, data, an image, a video, one or more controls, applications, computer-readable instructions, interactive functions, informational functions, third-party in-image applications, and combinations thereof.

### Claim 18

A computer-implemented method for displaying contextually relevant content associated with an image published on a digital content platform, comprising:
providing a publisher of the image with a reference script for publication with the image, wherein the reference script is a computer-readable instruction that causes an end-user device to provide an interface that allows an end-user to activate the image and thereby perform a request for content call to a content server; and
configuring the content server to
(a) receive the request for content call from the end-user device,
(b) identify the activated image,
(c) identify whether the activated image meets one or more pre-defined requirements,
(d) identify content that is contextually relevant to the activated image,
(e) deliver the content to the end-user device, and
(f) deliver a computer-readable instruction that causes the end-user device to display the content so as to appear on a backside of the activated image, to overlay the activated image with the content, or to completely cover the activated image with the content, wherein the content is identified by receiving input selected from the group consisting of: algorithmic identification or analysis of the image, image recognition protocols, proximate text recognition algorithms that search for contextual information of the image based on text published proximate to the image, submission of the image to a crowdsource network to identify the context of the image and tag the image with relevant data, a thematic tagging engine to identify and tag the image with relevant data based on a pre-defined theme, and publisher provided data on the image.

### Claim 19 (depends on 18)

The computer-implemented method of claim 18, wherein the content is identified with a crowdsourcing network.

### Claim 20

(canceled)

### Claim 21 (depends on 18)

The computer-implemented method of claim 18, wherein the digital content platform is a mobile device application.

### Claim 22 (depends on 18)

The computer-implemented method of claim 18, wherein the digital content platform is selected from the group consisting of: a web page, a website, a browser-based web application, software application, and a TV widget.

### Claim 23 (depends on 18)

The computer-implemented method of claim 18, wherein the contextually relevant content is an advertisement.

### Claim 24

(canceled)

### Claim 25 (depends on 18)

The computer-implemented method of claim 18, wherein the contextually relevant content is selected from the group consisting of: an advertisement, text, data, an image, a video, one or more controls, applications, computer-readable instructions, interactive functions, informational functions, third-party in-image applications, and combinations thereof.
