# US 2016/0253052 A1 · Semantic selection and purpose facilitation

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0253052 A1
- Document ID: US20160253052A1
- Status: Published application
- Kind: A1
- Application number: 15/058,102
- Filed: 2016-03-01
- Published: 2016-09-01
- Earliest claimed: 2011-10-05
- Assignees: Google Inc.
- Applicants: Google Inc.
- Inventors: Paul NORDSTROM; Casey Stuart WHITELAW
- Web page: https://patentgrep.com/patent/US20160253052A1

## CPC

- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 16/9577: {Optimising the visualization of content, e.g. distillation of HTML documents}
- G06Q 30/02: Marketing; Price estimation or determination; Fundraising
- H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Computer-implemented methods for proposing actions to a user to select based on the user's predicted purpose for selecting content are provided. In one aspect, a method includes receiving an identifier of a referent entity associated with user-selectable content, identifying, based on a prediction of a purpose in selecting the content, at least one action to be executed that is associated with the entity, and providing, for display, at least one identifier of the at least one action to the device for selection by a user. Systems, graphical user interfaces, and machine-readable media are also provided.

## Claims

### Claim 1

A computer-implemented method for proposing actions to a user to select based on the user's predicted purpose for selecting content, the method comprising:
receiving an identifier of a referent entity from a device, the referent entity selected from a list of suggested entities identified from content displayed on the device;
identifying at least one descriptor associated with the referent entity;
identifying, based on a context in which the referent entity is selected by a user from the list of suggested entities, at least one action to be executed for the referent entity that is selected from a list of actions associated with the descriptor and the referent entity; and
providing, for display, at least one identifier of the at least one action to the device for selection by the user,
wherein at least one of the suggested entities is associated with a weight value indicating a likelihood that the at least one suggested entity is a referent of the content, and
wherein the at least one action is added to the list of actions in response to a previous action taken by the user or another user after the referent entity has been identified.

### Claim 2 (depends on 1)

The computer implemented method of claim 1, wherein the context comprises at least one of a current location of the device, a past location of the device, the type of the device, a previous action associated with the referent entity taken by the user or another user, a search query, information on another user associated with the user, the file from which the content was selected, and the remaining content from which the content was selected.

### Claim 3

(canceled)

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein another action from the list of actions is manually added by another user to the list of actions associated with the descriptor.

### Claim 5 (depends on 1)

The computer-implemented method of claim 1, wherein, when the referent entity is a product, the at least one action comprises providing a review of the product, identifying a seller of the product, providing a price for the product, or providing an offer associated with the product.

### Claim 6 (depends on 5)

The computer-implemented method of claim 5, wherein, when the product is software, the at least one action further comprises providing a location for downloading the software, or installing the software.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein, when the referent entity is a service, the at least one action comprises providing a review of the service, identifying an availability of the service, identifying a location where the service is being provided, or providing an option to purchase the service.

### Claim 8 (depends on 1)

The computer-implemented method of claim 1, wherein, when the referent entity is a location, the at least one action comprises providing a review of the location, identifying an address of the location, providing directions to the location, providing information on availability of the location, providing information on parking associated with the location, or providing an offer associated with the location.

### Claim 9 (depends on 1)

The computer-implemented method of claim 1, wherein, when the referent entity is a person, the at least one action comprises providing contact information for the person, a description of the person, an image of the person, or information on a relationship with the person.

### Claim 10

A system for proposing actions to a user to select based on the user's predicted purpose for selecting content, the system comprising:
a memory comprising content; and
a processor configured to:
receive an identifier of a referent entity from a device, the referent entity selected from a list of suggested entities identified from content displayed on the device;
identify at least one descriptor associated with the referent entity;
identify, based on a context in which the referent entity is selected by a user from the list of suggested entities, at least one action to be executed for the referent entity that selected from a list of actions associated with the descriptor and the referent entity; and
provide, for display, at least one identifier of the at least one action to the device for selection by the user, and
wherein at least one of the suggested entities is associated with a weight value indicating a likelihood that the at least one suggested entity is a referent of the content, and
wherein the at least one action is added to the list of actions in response to a previous action taken by the user or another user after the referent entity has been identified.

### Claim 11 (depends on 10)

The system of claim 10, wherein the context comprises at least one action based on at least one of a current location of the device, a past location of the device, the type of the device, a previous action associated with the referent entity taken by the user or another user, a search query, information on another user associated with the user, the file from which the content was selected, and the remaining content from which the content was selected.

### Claim 12 (depends on 10)

The system of claim 10, wherein, when the referent entity is a product, the at least one action comprises providing a review of the product, identifying a seller of the product, providing a price for the product, or providing an offer associated with the product.

### Claim 13 (depends on 12)

The system of claim 12, wherein, when the product is software, the at least one action further comprises providing a location for downloading the software, or installing the software.

### Claim 14 (depends on 10)

The system of claim 10, wherein, when the referent entity is a service, the at least one action comprises providing a review of the service, identifying an availability of the service, identifying a location where the service is being provided, or providing an option to purchase the service.

### Claim 15 (depends on 10)

The system of claim 10, wherein, when the referent entity is a location, the at least one action comprises providing a review of the location, identifying an address of the location, providing directions to the location, providing information on availability of the location, providing information on parking associated with the location, or providing an offer associated with the location.

### Claim 16 (depends on 10)

The system of claim 10, wherein, when the referent entity is a person, the at least one action comprises providing contact information for the person, a description of the person, an image of the person, or information on a relationship with the person.

### Claim 17 (depends on 10)

The system of claim 10, wherein another action from the list of actions is manually added by another user to the list of actions associated with the descriptor.

### Claim at position 18

18-19. (canceled)

### Claim 20

A non-transitory machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for proposing actions to a user to select based on the user's predicted purpose for selecting content, the method comprising:
receiving an identifier of a referent entity from a device, the referent entity selected by a user from a list of suggested entities identified from content displayed on the device;
identifying at least one descriptor associated with the referent entity;
identifying at least one action, from a list of actions associated with the descriptor and the referent entity, to be executed for the referent entity based on at least one of a current location of the device, a past location of the device, the type of the device, a previous action associated with the referent entity taken by the user or another user, a search query, information on another user associated with the user, the file from which the content was selected, and the remaining content from which the content was selected; and
providing, for display, at least one identifier of the at least one action to the device for selection by the user,
wherein at least one of the suggested entities is associated with a weight value indicating a likelihood that the at least one suggested entity is a referent of the content, and
wherein the at least one action is added to the list of actions in response to a previous action taken by the user or another user after the referent entity has been identified.

### Claim 21 (depends on 20)

The non-transitory machine-readable storage medium of claim 20, wherein, when the referent entity is a product, the at least one action comprises providing a review of the product, identifying a seller of the product, providing a price for the product, or providing an offer associated with the product.

### Claim 22 (depends on 21)

The non-transitory machine-readable storage medium of claim 21, wherein, when the product is software, the at least one action further comprises providing a location for downloading the software, or installing the software.

### Claim 23 (depends on 20)

The non-transitory machine-readable storage medium of claim 20, wherein, when the referent entity is a service, the at least one action comprises providing a review of the service, identifying an availability of the service, identifying a location where the service is being provided, or providing an option to purchase the service.
