# US 12,118,182 B2 · Generating suggested content for workspaces

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,118,182 B2
- Document ID: US12118182B2
- Status: Granted
- Kind: B2
- Application number: 18/153,198
- Filed: 2023-01-11
- Published: 2023-10-19
- Granted: 2024-10-15
- Earliest claimed: 2020-07-14
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Aaron M. Burns; Scott M. Andrus; David M. Schattel
- Web page: https://patentgrep.com/patent/US12118182B2

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In accordance with some embodiments, an exemplary process for controlling the generation and display of suggested additional content based on a context of a workspace is described.

## Claims

### Claim 1

A wearable electronic device, comprising:
a display;
one or more processors; and
memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display of the wearable electronic device, a virtual representation of a workspace, wherein the virtual representation of the workspace includes;
a first set of content displayed at a first location in the virtual representation of the workspace, the first set of content including a first set of one or more items of content; and
a second set of content displayed at a second location in the virtual representation of the workspace, the second set of content including a second set of one or more items of content;
determining a first context associated with the first set of content based on a first spatial characteristic of the first set of one or more items of content with respect to the first location of the first set of content in the virtual representation of the workspace;
providing a first set of one or more candidate items of content, wherein the first set of the one or more candidate items of content are determined based on the first context associated with the first set of content of the virtual representation of the workspace;
determining a second context associated with the second set of content based on a second spatial characteristic of the second set of one or more items of content with respect to the second location of the second set of content in the virtual representation of the workspace; and
providing a second set of one or more candidate items of content, wherein the second set of the one or more candidate items of content are determined based on the second context associated with the second set of content of the virtual representation of the workspace.

### Claim 2 (depends on 1)

The wearable electronic device of claim 1, the one or more programs further including instructions for:
receiving a user selection of at least one candidate item of content of the first set of one or more candidate items of content; and
performing a task associated with the selected at least one candidate item of content.

### Claim 3 (depends on 1)

The wearable electronic device of claim 1, wherein the first set of content includes items of a first type and items of a second type, and wherein the items of the first type are spatially grouped in a first region of the virtual representation and items of the second type are spatially grouped in a second region of the virtual representation different than the first region, and wherein determining the first context includes determining the first context based on a location of a first item in the first region relative to a location of a second item in the first region within the virtual representation of the workspace.

### Claim 4 (depends on 1)

The wearable electronic device of claim 1, wherein determining the first context includes determining the first context based on a location of a third set of content relative to a location of a fourth set of content within the virtual representation of the workspace.

### Claim 5 (depends on 1)

The wearable electronic device of claim 1, wherein providing the first set of the one or more candidate items of content includes:
providing a selectable indicator, within an extended reality (XR) environment, indicating that a suggestion of the one or more candidate items of content is available;
receiving a user selection of the selectable indicator; and
in response to receiving the user selection of the selectable indicator, displaying the first set of the one or more candidate items of content.

### Claim 6 (depends on 1)

The wearable electronic device of claim 1, wherein providing the first set of the one or more candidate items of content includes displaying at least one item of the first set of the one or more candidate items of content adjacent to at least one item of the first set of content displayed at the first location in the virtual representation of the workspace.

### Claim 7 (depends on 1)

The wearable electronic device of claim 1, wherein the virtual representation is a three-dimensional (3D) representation.

### Claim 8 (depends on 1)

The wearable electronic device of claim 1, wherein determining the first context includes determining the first context based on a depth of the first set of the one or more items of content.

### Claim 9

A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a wearable electronic device including a display, the one or more programs including instructions for:
displaying, via the display of the wearable electronic device, a virtual representation of a workspace, wherein the virtual representation of the workspace includes:
a first set of content displayed at a first location in the virtual representation of the workspace, the first set of content including a first set of one or more items of content; and
a second set of content displayed at a second location in the virtual representation of the workspace, the second set of content including a second set of one or more items of content;
determining a first context associated with the first set of content based on a first spatial characteristic of the first set of one or more items of content with respect to the first location of the first set of content in the virtual representation of the workspace;
providing a first set of one or more candidate items of content, wherein the first set of the one or more candidate items of content are determined based on the first context associated with the first set of content of the virtual representation of the workspace;
determining a second context associated with the second set of content based on a second spatial characteristic of the second set of one or more items of content with respect to the second location of the second set of content in the virtual representation of the workspace; and
providing a second set of one or more candidate items of content, wherein the second set of the one or more candidate items of content are determined based on the second context associated with the second set of content of the virtual representation of the workspace.

### Claim 10 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, the one or more programs further including instructions for:
receiving a user selection of at least one candidate item of content of the first set of one or more candidate items of content; and
performing a task associated with the selected at least one candidate item of content.

### Claim 11 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the first set of content includes items of a first type and items of a second type, and wherein the items of the first type are spatially grouped in a first region of the virtual representation and items of the second type are spatially grouped in a second region of the virtual representation different than the first region, and wherein determining the first context includes determining the first context based on a location of a first item in the first region relative to a location of a second item in the first region within the virtual representation of the workspace.

### Claim 12 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein determining the first context includes determining the first context based on a location of a third set of content relative to a location of a fourth set of content within the virtual representation of the workspace.

### Claim 13 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the first set of the one or more candidate items of content includes:
providing a selectable indicator, within an extended reality (XR) environment, indicating that a suggestion of the one or more candidate items of content is available;
receiving a user selection of the selectable indicator; and
in response to receiving the user selection of the selectable indicator, displaying the first set of the one or more candidate items of content.

### Claim 14 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein providing the first set of the one or more candidate items of content includes displaying at least one item of the first set of the one or more candidate items of content adjacent to at least one item of the first set of content displayed at the first location in the virtual representation of the workspace.

### Claim 15 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein the virtual representation is a three-dimensional (3D) representation.

### Claim 16 (depends on 9)

The non-transitory computer-readable storage medium of claim 9, wherein determining the first context includes determining the first context based on a depth of the first set of the one or more items of content.

### Claim 17

A method, comprising:
at a wearable electronic device with a display:
displaying, via the display of the wearable electronic device, a virtual representation of a workspace, wherein the virtual representation of the workspace includes:
a first set of content displayed at a first location in the virtual representation of the workspace, the first set of content including a first set of one or more items of content; and
a second set of content displayed at a second location in the virtual representation of the workspace, the second set of content including a second set of one or more items of content;
determining a first context associated with the first set of content based on a first spatial characteristic of the first set of one or more items of content with respect to the first location of the first set of content in the virtual representation of the workspace;
providing a first set of one or more candidate items of content, wherein the first set of the one or more candidate items of content are determined based on the first context associated with the first set of content of the virtual representation of the workspace;
determining a second context associated with the second set of content based on a second spatial characteristic of the second set of one or more items of content with respect to the second location of the second set of content in the virtual representation of the workspace; and
providing a second set of one or more candidate items of content, wherein the second set of the one or more candidate items of content are determined based on the second context associated with the second set of content of the virtual representation of the workspace.

### Claim 18 (depends on 17)

The method of claim 17, further comprising:
receiving a user selection of at least one candidate item of content of the first set of one or more candidate items of content; and
performing a task associated with the selected at least one candidate item of content.

### Claim 19 (depends on 17)

The method of claim 17, wherein the first set of content includes items of a first type and items of a second type, and wherein the items of the first type are spatially grouped in a first region of the virtual representation and items of the second type are spatially grouped in a second region of the virtual representation different than the first region, and wherein determining the first context includes determining the first context based on a location of a first item in the first region relative to a location of a second item in the first region within the virtual representation of the workspace.

### Claim 20 (depends on 17)

The method of claim 17, wherein determining the first context includes determining the first context based on a location of a third set of content relative to a location of a fourth set of content within the virtual representation of the workspace.

### Claim 21 (depends on 17)

The method of claim 17, wherein providing the first set of the one or more candidate items of content includes:
providing a selectable indicator, within an extended reality (XR) environment, indicating that a suggestion of the one or more candidate items of content is available;
receiving a user selection of the selectable indicator; and
in response to receiving the user selection of the selectable indicator, displaying the first set of the one or more candidate items of content.

### Claim 22 (depends on 17)

The method of claim 17, wherein providing the first set of the one or more candidate items of content includes displaying at least one item of the first set of the one or more candidate items of content adjacent to at least one item of the first set of content displayed at the first location in the virtual representation of the workspace.

### Claim 23 (depends on 17)

The method of claim 17, wherein the virtual representation is a three-dimensional (3D) representation.

### Claim 24 (depends on 17)

The method of claim 17, wherein determining the first context includes determining the first context based on a depth of the first set of the one or more items of content.
