# US 2006/0041605 A1 · Determining actions involving captured information and electronic content associated with rendered documents

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0041605 A1
- Document ID: US20060041605A1
- Status: Published application
- Kind: A1
- Application number: 11/097,093
- Filed: 2005-04-01
- Published: 2006-02-23
- Earliest claimed: 2004-04-01
- Inventors: Martin King; Dale Grover; Clifford Kushler; James Stafford-Fraser
- Web page: https://patentgrep.com/patent/US20060041605A1

## CPC

- G06F 16/93: Document management systems
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Information is captured from a rendered document with a handheld document data capture device. Electronic information associated with the rendered document is applied to determine the system's actions and/or behaviors in response to the data capture. In some embodiments, the electronic information is markup data or an action map associated with the rendered document. In some embodiments, an electronic counterpart corresponding to the rendered document is located, and information associated with the electronic counterpart is applied to determine actions and/or behaviors available to a user of the handheld document data capture device.

## Claims

### Claim 1

A method comprising:
using a handheld document data capture device to capture information from a rendered document;
locating an electronic counterpart corresponding to the rendered document; and
applying information associated with the rendered document to determine actions and/or behaviors available to a user of the handheld document data capture device.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining actions further comprises:
determining a location in the document from which the information was captured.

### Claim 3 (depends on 2)

The method of claim 2, wherein the location in the document from which the information was captured further comprises:
proximity to at least one of a title, heading, photo, illustration, caption, footnote, endnote, citation, keyword, name, location, phone number, or address.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
determining at least one distance of the captured information from one or more context points within the document, and ranking an action based at least in part on the at least one distance.

### Claim 5 (depends on 4)

The method of claim 4, wherein ranking an action further comprises:
determining the likelihood that a user of the handheld document data capture device will select the action.

### Claim 6 (depends on 4)

The method of claim 4, wherein the distance of the captured information further comprises:
at least one of a word distance, a sentence distance, a paragraph distance, or a physical distance.

### Claim 7 (depends on 4)

The method of claim 4, wherein the context points within the document further comprises at least one selected from the group of a title, a heading, a photo, an illustration, a caption, a footnote, an endnote, a citation, a keyword, a name, a location, a phone number, and an address.

### Claim 8 (depends on 1)

The method of claim 1, further comprising:
identifying markup information in the captured information, the markup information associated with actions.

### Claim 9 (depends on 1)

The method of claim 1, wherein determining actions further comprises:
identifying at least one keyword in the captured information;
locating the at least one keyword in markup data associated with the rendered document; and
performing an action associated with the keyword in the markup data.

### Claim 10 (depends on 1)

The method of claim 1, wherein the information associated with the rendered document further comprises:
at least one of selected from the group of markup data associated with the rendered document, static information, rules, and markup data associated with the electronic counterpart.

### Claim 11 (depends on 1)

The method of claim 1, further comprising:
determining at least one categories with which the rendered document is associated, and selecting an action or actions associated with the at least one categories.

### Claim 12 (depends on 11)

The method of claim 11, wherein determining at least one categories further comprises:
a lookup of categories previously associated with the rendered document.

### Claim 13 (depends on 11)

The method of claim 11, wherein determining at least one categories further comprises:
analysis of at least a portion of the electronic counterpart to determine, after locating the electronic counterpart, categories to associate with the rendered document.

### Claim 14 (depends on 1)

The method of claim 1, wherein determining actions further comprises:
identifying a region or regions of the document from which the captured information was captured, and selecting actions associated with, and/or applying rules for determining actions associated with, the region or regions .

### Claim 15 (depends on 14)

The method of claim 14, wherein selecting actions associated with, and/or applying rules for determining actions associated with, the region or regions further comprises:
selecting at least one of an intersection or union of actions associated with, and/or applying at least one an intersection or union of rules for determining actions associated with, the region or regions.

### Claim 16 (depends on 14)

The method of claim 14, wherein identifying a region or regions of the document further comprises:
identifying a type or types of a region or regions of the document.

### Claim 17 (depends on 16)

The method of claim 16, wherein identifying a type or types of a region or regions of the document further comprises:
identifying at least one of an advertising region, a product or products region, a sports region, a news region, a political region, a science region, a technology region, a hobby region, an entertainment region, an opinion region, a finance region, a business region, a classifieds region, an arts region, a real estate region, or a subject region.

### Claim 18 (depends on 14)

The method of claim 14, wherein selecting actions associated with, and/or applying rules for determining actions associated with, the region or regions further comprises:
combining actions for multiple regions comprising the captured information.

### Claim 19 (depends on 14)

The method of claim 14, wherein selecting actions associated with, and/or applying rules for determining actions associated with, the region or regions further comprises:
combining actions from regions of multiple related documents.

### Claim 20 (depends on 14)

The method of claim 14, wherein selecting actions associated with, and/or applying rules for determining actions associated with, the region or regions further comprises:
combining actions defined by regions of multiple documents in a document hierarchy.

### Claim 21 (depends on 20)

The method of claim 20, wherein the document hierarchy further comprises:
a page within an article within a magazine, a page within a section within a newspaper, or a page within a chapter within a book within an anthology.
