# US 2018/0024703 A1 · Techniques to modify content and view content on a mobile device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0024703 A1
- Document ID: US20180024703A1
- Status: Published application
- Kind: A1
- Application number: 15/723,040
- Filed: 2017-10-02
- Published: 2018-01-25
- Earliest claimed: 2009-07-14
- Assignees: Zumobi, Inc.
- Applicants: Zumobi, Inc.
- Inventors: Benjamin B. Bederson; John SanGiovanni
- Web page: https://patentgrep.com/patent/US20180024703A1

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A computer-based method for rendering modified graphical content is disclosed. The graphical content includes a plurality of cells. The method includes receiving the graphical content with metadata modifying the graphical content, rendering the graphical content upon a screen according to the metadata, and receiving user input. The method also includes in response to the user input, progressing through at least a subset of the cells, wherein the progressing includes moving a camera view from cell to cell in the at least a subset, each of the cells in the at least a subset being displayed as a focus point with surrounding area being adjusted in opacity according to the metadata.

## Claims

### Claim 1

A computer-based method for rendering modified graphical content, the graphical content including a plurality of cells, the method comprising:
rendering the graphical content upon a screen according to metadata that modifies the graphical content;
defining, by a processor, polygonal overlay metadata for each cell in at least a subset of the plurality of cells, wherein the polygonal overlay metadata includes a sequence of polygons defining a surrounding area for said each cell;
rendering, under control of the processor, the sequence of polygons, in accordance with the polygonal overlay metadata, such that the defined surrounding area is adjusted in opacity and is de-emphasized with respect to salient features within said each cell;
receiving user input; and
in response to the user input, progressing through the at least a subset of the cells, wherein the progressing includes moving a camera view from cell to cell, each of the cells in the at least a subset being displayed as a focus point with the surrounding area being adjusted in opacity according to the polygonal overlay metadata, wherein the metadata specifies the polygonal overlay metadata.

### Claim at position 2

-7. (canceled)

### Claim 8 (depends on 1)

The method of claim 1 wherein the rendering comprises:
receiving user input selecting a portion of the graphical content;
comparing the selected portion of the graphical content to the salient features in the metadata;
selecting a first cell of the plurality of cells based upon the comparing;
in response to selecting the first cell, displaying the first cell as a focus point by adjusting opacity of one or more other cells of the plurality of cells according to the polygonal overlay metadata;
receiving a second user input;
comparing information associated with the second user input to the salient features in the metadata;
selecting a second cell of the plurality of cells based upon the comparing; and
in response to selecting the second cell, displaying the second cell as a focus point by adjusting opacity of the other cells of the plurality of cells according to the polygonal overlay metadata, the other cells including at least the first cell.

### Claim at position 4

-13. (canceled)

### Claim 14

A computer program product having a non-transitory computer readable medium having computer program logic recorded thereon for rendering modified graphical content, the graphical content including a plurality of cells, said computer program product comprising:
code for rendering the graphical content upon a screen according to metadata, the metadata modifying the graphical content, the metadata specifying a viewpoint for each of the cells and a polygonal overlay for each of the cells;
code for defining polygonal overlay metadata for each cell in at least a subset of the plurality of cells, wherein the polygonal overlay metadata includes a sequence of polygons defining a surrounding area for said each cell;
code for rendering the sequence of polygons, in accordance with the polygonal overlay metadata, such that the defined surrounding area is adjusted in opacity and is de-emphasized with respect to salient features within said each cell;
code for receiving user input; and
code for progressing through the at least a subset of the cells, in response to the user input, wherein the progressing includes moving a camera view from cell to cell, each of the cells in the at least a subset being displayed as a focus point with the surrounding area being adjusted in opacity according to the metadata, wherein the metadata specifies the polygonal overlay metadata.

### Claim at position 6

-21. (canceled)

### Claim 22

A computer-based method for associating metadata with graphical content, wherein the graphical content is divided into a plurality of cells, the method comprising:
associating metadata with the graphical content, the metadata describing salient visual features within each of the cells, the salient visual features being previously identified by a user as being salient;
using computer vision algorithms to process the graphical content and associate at least one of the following metadata items with the graphical content:
viewpoint metadata for each of the cells;
polygonal overlay metadata for each of the cells, wherein said polygonal overlay metadata for a first cell in said each of the cells specifies a sequence of polygons defining a polygonal mask for adjusting opacity of areas around said first cell such that said areas are de-emphasized with respect to said salient visual features; and
providing the user with an opportunity to reject and manually change at least one of the metadata items.

### Claim 23 (depends on 22)

The method of claim 22 further comprising:
receiving user input indicating the following metadata to be associated with the graphical content:
pixels corresponding to text within each cell; and
areas of each cell not to be obstructed by text.

### Claim 24 (depends on 22)

The method of claim 22 further comprising one or more of the following:
sending the graphical content, metadata, and metadata items to a viewing application to be rendered for an end-user; and
publishing the graphical content, metadata, and metadata items to a network resource to be downloaded by end-users.

### Claim 25

(canceled)

### Claim 26 (depends on 22)

The method of claim 22 in which the viewpoint metadata comprises:
center point, magnification, and rotation for each of the cells.

### Claim at position 12

-28. (canceled)
