# US 2024/0004536 A1 · Systems and methods of reducing obstruction by three-dimensional content

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0004536 A1
- Document ID: US20240004536A1
- Status: Published application
- Kind: A1
- Application number: 18/335,978
- Filed: 2023-06-15
- Published: 2024-01-04
- Earliest claimed: 2022-06-30
- Assignees: Apple Inc.
- Applicants: Apple Inc.
- Inventors: Samuel M. WEINIG; Lucie BELANGER; Angel Suet Yan CHEUNG; David H. HUANG; Dean JACKSON
- Web page: https://patentgrep.com/patent/US20240004536A1

## CPC

- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/0485: Scrolling or panning
- G06F 3/0486: Drag-and-drop
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods for preventing three-dimensional content from obscuring portions of a web browser or other user interface in a three-dimensional environment. In some embodiments, the methods include applying one or more visual treatments to the three-dimensional content. In some embodiments, the methods further include applying one or more visual treatments to portions of the web browser or portions of the other user interface. In some embodiments, the one or more visual treatments are applied at least from a viewpoint of a user. In some embodiments, applying the or more visual treatments is based on a three-dimensional visual effect of the three-dimensional content.

## Claims

### Claim 1

A method comprising:
at a computer system in communication with a display and one or more input devices:
presenting, via the display, a user interface having a first user interface region and a second user interface region from a viewpoint, wherein the first user interface region includes a user interface object at a first location of the first user interface region, the user interface object having a three-dimensional visual effect;
while presenting the user interface, receiving, via the one or more input devices, an input corresponding to a request to move the user interface object towards a boundary of the first user interface region; and
in response to detecting the input:
moving the user interface object to a second location, different from the first location, in the first user interface region in accordance with the input;
in accordance with a determination that the user interface object at the second location satisfies a set of one or more visibility criteria with respect to the second user interface region from the viewpoint, applying a first visual treatment to the user interface object; and
in accordance with a determination that the user interface object at the second location does not satisfy the one or more visibility criteria, forgoing applying the first visual treatment to the user interface object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the set of one or more visibility criteria include a criterion that is satisfied when the user interface object at the second location includes the three-dimensional visual effect that, without applying the first visual treatment, at least partially obscures a portion of the second user interface region from the viewpoint.

### Claim 3 (depends on 1)

The method of claim 1, wherein applying the first visual treatment to the user interface object according to a view volume from the viewpoint includes presenting a clipped user interface object at an intersection of the user interface object and a plane of the view volume such that a portion of the user interface object outside the view volume is not presented.

### Claim 4 (depends on 1)

The method of claim 1, wherein the user interface is associated with an instance of a web browser application.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first user interface region is associated with a content region having the user interface object and includes content for a web page.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second user interface region is associated with a navigation region having an address bar and a plurality of affordances.

### Claim 7 (depends on 1)

The method of claim 1, wherein applying the first visual treatment to the user interface object includes presenting a first portion of the user interface object on a first side of a plane without presenting a second portion of the user interface object on the first side of the plane and applying an appearance of an exterior surface of the second portion of the user interface object to the exterior surface of the user interface object at the plane.

### Claim 8 (depends on 1)

The method of claim 1, wherein the one or more visibility criteria include a criterion that is satisfied when the user interface object at the second location intersects a plane of a view volume defined by a direction and angle from the viewpoint.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
in accordance with the determination that the user interface object at the second location satisfies the set of one or more visibility criteria, applying a second visual treatment to the user interface object or applying the second visual treatment to the boundary of the first user interface region, wherein the second visual treatment comprises highlighting.

### Claim 10

An electronic device, comprising:
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
presenting, via a display, a user interface having a first user interface region and a second user interface region from a viewpoint, wherein the first user interface region includes a user interface object at a first location of the first user interface region, the user interface object having a three-dimensional visual effect;
while presenting the user interface, receiving, via one or more input devices, an input corresponding to a request to move the user interface object towards a boundary of the first user interface region; and
in response to detecting the input:
moving the user interface object to a second location, different from the first location, in the first user interface region in accordance with the input;
in accordance with a determination that the user interface object at the second location satisfies a set of one or more visibility criteria with respect to the second user interface region from the viewpoint, applying a first visual treatment to the user interface object; and
in accordance with a determination that the user interface object at the second location does not satisfy the one or more visibility criteria, forgoing applying the first visual treatment to the user interface object.

### Claim 11 (depends on 10)

The electronic device of claim 10, wherein the set of one or more visibility criteria include a criterion that is satisfied when the user interface object at the second location includes the three-dimensional visual effect that, without applying the first visual treatment, at least partially obscures a portion of the second user interface region from the viewpoint.

### Claim 12 (depends on 10)

The electronic device of claim 10, wherein applying the first visual treatment to the user interface object according to a view volume from the viewpoint includes presenting a clipped user interface object at an intersection of the user interface object and a plane of the view volume such that a portion of the user interface object outside the view volume is not presented.

### Claim 13 (depends on 10)

The electronic device of claim 10, wherein the user interface is associated with an instance of a web browser application.

### Claim 14 (depends on 10)

The electronic device of claim 10, wherein the first user interface region is associated with a content region having the user interface object and includes content for a web page.

### Claim 15 (depends on 10)

The electronic device of claim 10, wherein the second user interface region is associated with a navigation region having an address bar and a plurality of affordances.

### Claim 16 (depends on 10)

The electronic device of claim 10, wherein applying the first visual treatment to the user interface object includes presenting a first portion of the user interface object on a first side of a plane without presenting a second portion of the user interface object on the first side of the plane and applying an appearance of an exterior surface of the second portion of the user interface object to the exterior surface of the user interface object at the plane.

### Claim 17 (depends on 10)

The electronic device of claim 10, wherein the one or more visibility criteria include a criterion that is satisfied when the user interface object at the second location intersects a plane of a view volume defined by a direction and angle from the viewpoint.

### Claim 18 (depends on 10)

The electronic device of claim 10, further comprising:
in accordance with the determination that the user interface object at the second location satisfies the set of one or more visibility criteria, applying a second visual treatment to the user interface object or applying the second visual treatment to the boundary of the first user interface region, wherein the second visual treatment comprises highlighting.

### Claim 19

A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising:
presenting, via a display, a user interface having a first user interface region and a second user interface region from a viewpoint, wherein the first user interface region includes a user interface object at a first location of the first user interface region, the user interface object having a three-dimensional visual effect;
while presenting the user interface, receiving, via one or more input devices, an input corresponding to a request to move the user interface object towards a boundary of the first user interface region; and
in response to detecting the input:
moving the user interface object to a second location, different from the first location, in the first user interface region in accordance with the input;
in accordance with a determination that the user interface object at the second location satisfies a set of one or more visibility criteria with respect to the second user interface region from the viewpoint, applying a first visual treatment to the user interface object; and
in accordance with a determination that the user interface object at the second location does not satisfy the one or more visibility criteria, forgoing applying the first visual treatment to the user interface object.

### Claim 20 (depends on 19)

The non-transitory computer readable storage medium of claim 19, wherein the set of one or more visibility criteria include a criterion that is satisfied when the user interface object at the second location includes the three-dimensional visual effect that, without applying the first visual treatment, at least partially obscures a portion of the second user interface region from the viewpoint.
