# US 2014/0198127 A1 · Overlaying Text In Images For Display To A User Of A Digital Magazine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0198127 A1
- Document ID: US20140198127A1
- Status: Published application
- Kind: A1
- Application number: 14/155,053
- Filed: 2014-01-14
- Published: 2014-07-17
- Earliest claimed: 2013-01-15
- Assignees: Flipboard, Inc.
- Applicants: Flipboard, Inc.
- Inventors: Charles H. Ying
- Web page: https://patentgrep.com/patent/US20140198127A1

## CPC

- G06T 11/60: Creating or editing images; Combining images with text
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06F 16/9536: Search customisation based on social or collaborative filtering
- G06T 7/11: Region-based segmentation
- G06T 7/136: involving thresholding
- G06F 16/24578: {using ranking}
- G06F 16/93: Document management systems
- G06F 16/958: Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F 40/10: Text processing (natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40)
- G06F 40/106: Display of layout of documents; Previewing
- G06F 40/114: Pagination
- G06F 40/131: Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
- G06F 40/186: Templates
- G06T 2207/10024: Color image
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A digital magazine server presents content retrieved from various sources to a user. The content may include various images, with images selected by the digital magazine server for presentation to a user along with additional content. Text associated with an image may also be retrieved and presented to the user along with the image. To improve presentation of images with text, the digital magazine server identifies features in an image and identifies regions of the image where text is capable of being presented without obscuring or being obscured by features of the image. The image is modified to present text associated with the image in one or more of the identified images, allowing the text to be presented without detracting from features of the image.

## Claims

### Claim 1

A method comprising:
obtaining an image for presentation to a user of a digital magazine server;
identifying one or more features of the image, the features identifying regions containing one or more objects included in the image;
identifying one or more regions in the image capable of including text based at least in part on the one or more identified features, a region in the image capable of including text having at least a threshold distance from an identified feature;
selecting text for presentation along with the image;
selecting one or more of the one or more regions in the image capable of including text; and
modifying the image to present the selected text in the one or more selected regions in the image capable of including text.

### Claim 2 (depends on 1)

The method of claim 1, wherein identifying one or more features of the image further comprises:
identifying edges associated with one or more of the objects included in the image; and
identifying regions containing one or more objects included in the image, based at least in part on the identified edges associated with one or more of the objects included in the image.

### Claim 3 (depends on 1)

The method of claim 1, wherein identifying one or more features of the image comprises:
determining a location of a feature relative to one or more boundaries of the image;
associating information describing the location with the feature; and
storing the information describing the location of the feature in association with an identifier associated with the feature.

### Claim 4 (depends on 3)

The method of claim 3, wherein the information describing the location of the feature includes one or more selected from a group consisting of: size information describing one or more dimensions of the feature, information describing a shape of the feature, information describing the location of the feature relative to one or more boundaries of the image, and any combination thereof.

### Claim 5 (depends on 1)

The method of claim 1, wherein identifying one or more features of the image comprises:
generating a feature identifier associated with a feature, the feature identifier associating the feature with the image.

### Claim 6 (depends on 1)

The method of claim 1, wherein identifying one or more regions in the image capable of including text based at least in part on the one or more identified features further comprises:
determining information describing one or more attributes of a region based at least in part on a location of a region relative to one or more boundaries of the image; and
storing the information describing one or more attributes of the region in association with an identifier corresponding to the region.

### Claim 7 (depends on 6)

The method of claim 6, wherein the information describing the one or more attributes of the region include information selected from a group consisting of: the location of the region relative to one or more boundaries of the image, a description of a shape of the region, a description of one or more dimensions of the region, and any combination thereof.

### Claim 8 (depends on 6)

The method of claim 6 wherein the identifier corresponding to the region associates the region with the image.

### Claim 9 (depends on 1)

The method of claim 1, wherein selecting text for presentation along with the image further comprises:
identifying text associated with the image; and
retrieving the identified text for presentation along with the image.

### Claim 10 (depends on 1)

The method of claim 1, wherein selecting one or more of the one or more regions in the image capable of including text comprises:
identifying text associated with the image;
identifying one or more portion of the identified text, each portion of the identified text associated with one or more attributes; and
selecting a region in the image capable of including text in which a portion of the identified text is presented based at least in part on one or more of the attributes associated with the portion of the identified text.

### Claim 11

A method comprising:
obtaining an image for presentation to a user of a digital magazine server;
identifying one or more features of the image, the features identifying regions containing one or more objects included in the image;
identifying one or more regions in the image capable of including text based at least in part on the one or more identified features, a region in the image capable of including text having at least a threshold distance from an identified feature;
selecting text for presentation along with the image;
selecting one or more of the one or more regions in the image capable of including text;
modifying the image to present the selected text in the one or more selected regions in the image capable of including text; and
displaying the modified image to the user of the digital magazine sever.

### Claim 12 (depends on 11)

The method of claim 11, wherein selecting one or more of the one or more regions in the image capable of including text further comprises:
identifying an image template including region for presenting text having at least a threshold similarity to at least a threshold number of the one or more identified regions capable of presenting text;
selecting one or more regions for presenting text in the identified image template for presenting text; and
identifying regions in the image capable of including text based on locations associated with the selected one or more regions for presenting text in the identified image template.

### Claim 13 (depends on 11)

The method of claim 11, wherein selecting one or more of the one or more regions in the image capable of including text further comprises:
identifying an image template including region for presenting text having at least a threshold similarity to at least a threshold number of the one or more identified regions capable of presenting text;
selecting one or more regions for presenting text in the identified image template for presenting text based at least in part on location information associated with the regions for presenting text in the identified image template identifying positions of the regions for presenting text relative to one or more boundaries of the identified image template; and
identifying regions in the image capable of including text based on locations associated with the selected one or more regions for presenting text in the identified image template.

### Claim 14 (depends on 11)

The method of claim 11, wherein selecting one or more of the one or more regions in the image capable of including text further comprises:
identifying one or more portions of the selected text for presentation in a region in the image capable of including text based at least in part on characteristics of the region in the image capable of including text; and
associating the one or more portions of the selected text with the region in the image capable of including text.

### Claim 15 (depends on 11)

The method of claim 11, wherein modifying the image to present the selected text in the one or more selected regions in the image capable of including text further comprises:
identifying one or more locations of the image corresponding to each of the one or more selected regions in the image; and
overlaying the selected text in the identified one or more locations of the image.

### Claim 16

A computer program product comprising a computer-readable medium having instructions encoded thereon that, when executed by a processor, cause the processor to:
obtain an image for presentation to a user of a digital magazine server;
identify one or more features of the image, the features identifying regions containing one or more objects included in the image;
identify one or more regions in the image capable of including text based at least in part on the one or more identified features, a region in the image capable of including text having at least a threshold distance from an identified feature;
select text for presentation along with the image;
select one or more of the one or more regions in the image capable of including text;
modify the image to present the selected text in the one or more selected regions in the image capable of including text; and
display the modified image to the user of the digital magazine server.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein select one or more of the one or more regions in the image capable of including text further comprises:
identify an image template including region for presenting text having at least a threshold similarity to at least a threshold number of the one or more identified regions capable of presenting text;
select one or more regions for presenting text in the identified image template for presenting text; and
identify regions in the image capable of including text based on locations associated with the selected one or more regions for presenting text in the identified image template.

### Claim 18 (depends on 16)

The computer program product of claim 16, wherein select one or more of the one or more regions in the image capable of including text further comprises:
identify an image template including region for presenting text having at least a threshold similarity to at least a threshold number of the one or more identified regions capable of presenting text;
select one or more regions for presenting text in the identified image template for presenting text based at least in part on location information associated with the regions for presenting text in the identified image template identifying positions of the regions for presenting text relative to one or more boundaries of the identified image template; and
identify regions in the image capable of including text based on locations associated with the selected one or more regions for presenting text in the identified image template.

### Claim 19 (depends on 16)

The computer program product of claim 16, wherein select one or more of the one or more regions in the image capable of including text comprises:
identify text associated with the image;
identify one or more portion of the identified text, each portion of the identified text associated with one or more attributes; and
select a region in the image capable of including text in which a portion of the identified text is presented based at least in part on one or more of the attributes associated with the portion of the identified text.

### Claim 20 (depends on 16)

The computer program product of claim 16, wherein identify one or more regions in the image capable of including text based at least in part on the one or more identified features further comprises:
determine information describing one or more attributes of a region based at least in part on a location of a region relative to one or more boundaries of the image; and
store the information describing one or more attributes of the region in association with an identifier corresponding to the region.

### Claim 21 (depends on 20)

The computer program product of claim 20, wherein the information describing the one or more attributes of the region include information selected from a group consisting of: the location of the region relative to one or more boundaries of the image, a description of a shape of the region, a description of one or more dimensions of the region, and any combination thereof.

### Claim 22 (depends on 16)

The computer program product of claim 16, wherein identify one or more regions in the image capable of including text based at least in part on the one or more identified features further comprises:
determine one or more colors associated with a region.

### Claim 23 (depends on 16)

The computer program product of claim 16, wherein select text for presentation along with the image further comprises:
identify text associated with the image;
determine one or more colors associated with one or more portions of the identified text; and
retrieving one or more portions of the identified text for presentation along with the image based at least in part on the one or more colors associated with the one or more portions of the identified text.

### Claim 24 (depends on 16)

The computer program product of claim 16, wherein modify the image to present the selected text in the one or more selected regions in the image capable of including text further comprises:
modifying the selected text based on one or more colors associated with the one or more selected regions.

### Claim 25 (depends on 24)

The computer program product of claim 24, wherein modifying the selected text further comprises: presenting an outline around one or more borders of the selected text, modifying a color of the selected text, modifying a font of the selected text, and any combination thereof.
