# US 2013/0254647 A1 · Multi-application content interactions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0254647 A1
- Document ID: US20130254647A1
- Status: Published application
- Kind: A1
- Application number: 13/425,280
- Filed: 2012-03-20
- Published: 2013-09-26
- Earliest claimed: 2012-03-20
- Assignees: A9.com, Inc.
- Inventors: Matthew W. Amacker; Joel D. Tesler
- Web page: https://patentgrep.com/patent/US20130254647A1

## CPC

- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Information from a position and/or gesture detection system can be embedded in a Web page, or other such presentation of content, and used to select or otherwise interact with content on the page. In some embodiments, video is captured and displayed showing a current view of the user. Position data corresponding to the video is provided and used to determine directions and extents of motion without having to do significant amounts of image processing. The position data is used to determine locations on the page where the user is attempting to provide input, such as to select an item of content. The content can be modified and/or rendered to appear to be associated with the user in the rendered view. Information from multiple gesture systems can be combined on a single page, and information from one or more gesture systems can be shared among multiple pages and devices.

## Claims

### Claim 1

A computer-implemented method of rendering content, comprising:
receiving a request for a first Web page from a first user of a computing device;
sending a first request for content for the Web page and a second request for position data and image data from a gesture system;
receiving the position data and image data from the gesture system through a response configured to delay a completion of loading in order to provide a data stream, the image data including a view of a current orientation of a user and the position data corresponding to features of the user at the current orientation;
rendering the first Web page including the requested content and a view of the image data through a gesture module on a first Web page, the view including a representation of the current orientation of the user, the first Web page including a plurality of user-selectable objects outside of the gesture module;
analyzing the position data to determine at least one of a motion or gesture of the user, the motion or gesture of the user capable of indicating at least one of the user-selectable objects; and
in response to the motion or gesture indicating one of the user-selectable objects, causing information for the item to be sent to an application capable of providing information for the item to be displayed on a second Web page.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the second Web page is rendered on a second computing device.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, wherein the second computing device is associated with a second user.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein the second computing device has a second gesture system operable to capture position data and image data for a current orientation of the second user, and wherein the second user is enabled to select user-selectable objects on the second Web page to cause information to be sent to the browser rendering the first Web page for the first user.

### Claim 5 (depends on 2)

The computer-implemented method of claim 2, wherein the second Web page displays at least one of a shopping list or a wish list for the first user including information for an item associated with the indicated user-selectable object.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1, wherein the first Web page is provided in an iframe presented with the second Web page.

### Claim 7

A computer-implemented method, comprising:
under control of one or more computer systems configured with executable instructions,
receiving position data from a gesture system, the position data corresponding to a current orientation of a first user;
rendering a first page of content including a representation of the current orientation of the first user through a gesture module on the first page, the first page including a plurality of user-selectable objects outside of the gesture module;
analyzing the position data to determine at least one of a motion or gesture of the first user, the motion or gesture of the first user capable of indicating at least one of the user-selectable objects; and
in response to the motion or gesture indicating one of the user-selectable objects, causing an action to be performed with respect to a second page of content.

### Claim 8 (depends on 7)

The computer-implemented method of claim 7, wherein the gesture system is part of a computing device rendering the first page and separate from a provider of content for the first page.

### Claim 9 (depends on 8)

The computer-implemented method of claim 8, wherein the gesture system includes at least one video camera capable of providing video image data and at least one structured light subsystem operable to provide the position data.

### Claim 10 (depends on 7)

The computer-implemented method of claim 7, wherein the second Web page is rendered on a second computing device.

### Claim 11 (depends on 10)

The computer-implemented method of claim 10, wherein the second computing device is associated with a second user, and wherein the second computing device has a second gesture system operable to capture position data and image data for a current orientation of the second user, the second user being enabled to select user-selectable objects on the second Web page to cause information to be sent to the browser rendering the first Web page for the first user.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, wherein the first and second users are enabled to interact using different computing devices at different locations using the respective gesture systems.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein each of the first and second users is able to see a view of the current orientation of the other user.

### Claim 14 (depends on 7)

The computer-implemented method of claim 7, wherein the second Web page displays at least one of a shopping list or a wish list for the first user including information for an item associated with the indicated user-selectable object.

### Claim 15 (depends on 7)

The computer-implemented method of claim 7, wherein the first page is a Web page, the position data is received as a stream of JSON data, and JavaScript executing in a browser application is configured to accept and analyze the stream of JSON data to determine at least one of a motion or gesture of the first user.

### Claim 16 (depends on 7)

The computer-implemented method of claim 7, wherein the gesture module is sourced from a first domain and at least a portion of content of the first page is sourced from a second domain, and wherein an application rendering the first page includes a frame configured to enable data to pass between the first domain and the second domain.

### Claim 17 (depends on 7)

The computer-implemented method of claim 7, wherein the user-selectable objects are images of clothing items that are available for the user to purchase, and wherein performing an action associated with the indicated user-selectable object includes causing a view of a clothing item in an indicated image to be displayed on the second page.

### Claim 18 (depends on 7)

The computer-implemented method of claim 7, wherein a type of data transferred by the gesture system is configurable.

### Claim 19

A computing device, comprising:
a device processor;
a display screen; and
a memory device including instructions operable to be executed by the device processor to perform a set of actions, enabling the computing device to:
obtain position data from a gesture system, the position data corresponding to a current orientation of a first user;
render a first page of content including a representation of the current orientation of the first user through a gesture module on the display screen, the first page including a plurality of user-selectable objects outside of the gesture module;
analyze the position data to determine at least one of a motion or gesture of the first user, the motion or gesture of the first user capable of indicating at least one of the user-selectable objects; and
cause an action to be performed with respect to a second page of content in response to the motion or gesture indicating one of the user-selectable objects on the first page.

### Claim 20 (depends on 19)

The computing device of claim 19, wherein the gesture system is part of a computing device rendering the first page and separate from a provider of content for the first page.

### Claim 21 (depends on 19)

The computing device of claim 19, wherein the gesture system includes at least one video camera capable of providing video image data and at least one structured light subsystem operable to provide the position data.

### Claim 22 (depends on 19)

The computing device of claim 19, wherein the second page is rendered on a second computing device associated with a second user, the second computing device having a second gesture system operable to capture position data and image data for a current orientation of the second user, the second user being enabled to select user-selectable objects on the second page to cause information to be sent to the browser rendering the first page for the first user.

### Claim 23 (depends on 22)

The computing device of claim 22, wherein the first and second users are enabled to interact using different computing devices at different locations using the respective gesture systems, and wherein each of the first and second users is able to see a view of the current orientation of the other user.

### Claim 24

A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a computing device, cause the computing device to:
receive position data from a gesture system, the position data corresponding to a current orientation of a first user;
render a first page of content including a representation of the current orientation of the first user through a gesture module on the first page, the first page including a plurality of user-selectable objects outside of the gesture module;
analyze the position data to determine at least one of a motion or gesture of the first user, the motion or gesture of the first user capable of indicating at least one of the user-selectable objects; and
cause an action to be performed with respect to a second page of content in response to the motion or gesture indicating one of the user-selectable objects on the first page.

### Claim 25 (depends on 24)

The non-transitory computer-readable storage medium of claim 24, wherein the gesture module is sourced from a first domain and at least a portion of content of the page is sourced from a second domain, and wherein an application rendering the page includes a frame configured to enable data to pass between the first domain and the second domain.

### Claim 26 (depends on 24)

The non-transitory computer-readable storage medium of claim 24, wherein the user-selectable objects are images of clothing items that are available for the user to purchase, and wherein performing an action associated with the indicated user-selectable object includes sending information enabling one or more images of clothing items to be displayed on the second page.

### Claim 27 (depends on 24)

The non-transitory computer-readable storage medium of claim 24, wherein the second page is rendered on a second computing device associated with a second user, the second computing device having a second gesture system operable to capture position data and image data for a current orientation of the second user, the second user being enabled to select user-selectable objects on the second page to cause information to be sent to the browser rendering the first page for the first user.
