# US 2019/0377487 A1 · Augmented reality scrollbar

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0377487 A1
- Document ID: US20190377487A1
- Status: Published application
- Kind: A1
- Application number: 16/425,029
- Filed: 2019-05-29
- Published: 2019-12-12
- Earliest claimed: 2018-06-07
- Assignees: Magic Leap, Inc.
- Applicants: Magic Leap, Inc.
- Inventors: Richard St. Clair Bailey; Brian Everett Meaney; John Austin Day; Lorena Pazmino; James Cameron Petty; James M. Powderly; Savannah Niles
- Web page: https://patentgrep.com/patent/US20190377487A1

## CPC

- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/04855: Interaction with scrollbars
- G02B 27/017: {Head mounted}
- G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS

## Abstract

Systems and methods for displaying a group of virtual objects and a scrollbar in a virtual, augmented, or mixed reality environment are disclosed. The group of virtual objects can be scrolled, and a virtual control panel can be displayed indicating objects that are upcoming in the scroll. The scrollbar can provide real-time feedback that can give the user an indication of the point from which the scrolling started, the point at which the scrolling currently has reached, an amount of the group of virtual objects that are displayed to the user relative to the total amount of the group of virtual objects, or a relative position of the currently-viewable virtual objects relative to the entire group of virtual objects.

## Claims

### Claim 1

A wearable display system comprising:
a display configured to be positioned in front of an eye of a user, the display configured to project virtual content toward an eye of the user; and
non-transitory storage configured to store virtual content associated with a library of virtual content;
a hardware processor in communication with the display and the non-transitory storage, the hardware processor programmed to:
direct the display to render a virtual layout of virtual content associated with a subset of the library of virtual content;
receive a user indication to scroll the virtual layout;
direct the display to render a scrollbar that comprises a bar having a temporarily fixed edge and a movable edge, the temporarily fixed edge rendered during scrolling at a fixed position that is representative of an initial scrolling location associated with the subset of the library of virtual content;
direct the display to render, during scrolling, the movable end at a movable position that is representative of a current scrolling location associated with the library of virtual content; and
direct the display to render, after scrolling ceases, the temporarily fixed edge at a position such that a length of the bar relative to a length of the scrollbar is representative of a fractional amount of the library of virtual content that is rendered in the virtual layout.

### Claim 2 (depends on 1)

The wearable display system of claim 1, wherein the virtual layout comprises a grid.

### Claim 3 (depends on 1)

The wearable display system of claim 1, wherein to receive the user indication to scroll the virtual layout, the hardware processor is programmed to receive an input from a user-input device, to detect hovering of a cursor near a region of the virtual layout, or to receive a detection of a user gesture.

### Claim 4 (depends on 1)

The wearable display system of claim 1, wherein the scrollbar is not rendered by the display prior to the receipt of the user indication to scroll the virtual layout.

### Claim 5 (depends on 1)

The wearable display system of claim 1, wherein after expiration of a period of inactivity, the hardware processor directs the display to cease rendering the scrollbar.

### Claim 6 (depends on 1)

The wearable display system of claim 1, wherein the scrollbar comprises a trough, and the bar is rendered at least partially within the trough.

### Claim 7 (depends on 6)

The wearable display system of claim 6, wherein the hardware processor is programmed to direct the display to render the bar in a graphical style that is different from a graphical style used for the trough.

### Claim 8 (depends on 1)

The wearable display system of claim 1, wherein the length of the bar is a distance between the position of the temporarily fixed edge and the position of the movable edge after scrolling ceases.

### Claim 9 (depends on 1)

The wearable display system of claim 1, wherein the hardware processor is further programmed to direct the display to render additional graphical elements indicative of a scroll direction or a scroll amount.

### Claim 10 (depends on 1)

The wearable display system of claim 1, wherein the scrollbar is elongated along a scrollbar axis, and the hardware processor is programmed to direct the display to render the scrollbar such that the scrollbar axis is in a direction of the scrolling.

### Claim 11 (depends on 1)

The wearable display system of claim 1, wherein the hardware processor is programmed to direct the display to render the scrollbar, after scrolling ceases, at a position relative to the scrollbar that is representative of the current scrolling location relative to the library of virtual content.

### Claim 12 (depends on 1)

The wearable display system of claim 1, wherein the hardware processor is programmed to direct the display to render the movable position of the movable edge at a rate that is representative of a scrolling speed of the scroll.

### Claim 13 (depends on 1)

The wearable display system of claim 1, wherein, after scrolling ceases, the hardware processor is programmed to direct the display to snap the position of the temporarily fixed edge to the position such that a length of the bar relative to a length of the scrollbar is representative of a fractional amount of the library of virtual content that is rendered in the virtual layout.

### Claim 14 (depends on 1)

The wearable display system of claim 1, wherein the virtual content comprises an icon grid.

### Claim 15

A method comprising:
under control of a display system comprising computer hardware:
directing a display to render a virtual layout of virtual content associated with a subset of the library of virtual content;
receiving a user indication to scroll the virtual layout;
directing the display to render a scrollbar that comprises a bar having a temporarily fixed edge and a movable edge, the temporarily fixed edge rendered during scrolling at a fixed position that is representative of an initial scrolling location associated with the subset of the library of virtual content;
directing the display to render, during scrolling, the movable end at a movable position that is representative of a current scrolling location associated with the library of virtual content; and
directing the display to render, after scrolling ceases, the temporarily fixed edge at a position such that a length of the bar relative to a length of the scrollbar is representative of a fractional amount of the library of virtual content that is rendered in the virtual layout.

### Claim 16

A display system comprising:
a display configured to be positioned in front of an eye of a user, the display configured to project virtual content in a field of view (FOV) toward an eye of the user; and
non-transitory storage configured to store virtual content associated with a library of virtual content;
a hardware processor in communication with the display and the non-transitory storage, the hardware processor programmed to:
direct the display to render virtual content associated with a subset of the library of virtual content in at least a portion of the FOV;
receive a user indication to scroll the virtual layout;
direct the display to render, during scrolling, a scrollbar that comprises a bar having a first end and a second end, the first end rendered at a fixed position representative of an initial scrolling location associated with the library of virtual content, and the second end rendered at a moving position representative of a current scrolling location associated with the library of virtual content; and
direct the display to render, after scrolling ceases, the first end at a position such that a length of the bar relative to a length of the scrollbar is representative of a fractional amount of the library of virtual content that is rendered in the at least a portion of the FOV.

### Claim 17

A display system comprising:
a display configured to be positioned in front of an eye of a user, the display configured to project virtual content in a field of view (FOV) toward an eye of the user; and
non-transitory storage configured to store virtual content associated with a library of virtual content;
a hardware processor in communication with the display and the non-transitory storage, the hardware processor programmed to:
direct the display to render a first subset of a library of virtual content;
direct the display to render a scroll graphic comprising a first graphical element and a second graphical element, the scroll graphic having a scroll length;
direct the display to render, during scrolling, the first graphical element of the scroll graphic at a fixed position that is representative of an initial location of the first subset of the library of virtual content;
direct the display to render, during the scrolling, the second graphical element of the scroll graphic at a movable position that is representative of a current location of the scrolling within the library of virtual content;
direct the display to render, after the scrolling ceases, a second subset of the library of virtual content; and
direct the display to render, after the scrolling ceases, the first graphical element at a first position and the second graphical element at a second position,
wherein a distance between the first position and the second position relative to the scroll length of the scroll graphic is representative of an amount of the second subset relative to the entire library of virtual content.

### Claim 18

A method comprising:
under control of a display system comprising computer hardware:
directing a display to render virtual content associated with a subset of a library of virtual content in at least a portion of a field of view (FOV);
receiving a user indication to scroll a virtual layout;
directing the display to render, during scrolling, a scrollbar that comprises a bar having a first end and a second end, the first end rendered at a fixed position representative of an initial scrolling location associated with the library of virtual content, and the second end rendered at a moving position representative of a current scrolling location associated with the library of virtual content; and
directing the display to render, after scrolling ceases, the first end at a position such that a length of the bar relative to a length of the scrollbar is representative of a fractional amount of the library of virtual content that is rendered in the at least a portion of the FOV.

### Claim 19

A method comprising:
under control of a display system comprising computer hardware:
directing a display to render a first subset of a library of virtual content, the display configured to project virtual content in a field of view (FOV) toward an eye of a user;
directing the display to render a scroll graphic comprising a first graphical element and a second graphical element, the scroll graphic having a scroll length;
directing the display to render, during scrolling, the first graphical element of the scroll graphic at a fixed position that is representative of an initial location of the first subset of the library of virtual content;
directing the display to render, during the scrolling, the second graphical element of the scroll graphic at a movable position that is representative of a current location of the scrolling within the library of virtual content;
directing the display to render, after the scrolling ceases, a second subset of the library of virtual content; and
directing the display to render, after the scrolling ceases, the first graphical element at a first position and the second graphical element at a second position,
wherein a distance between the first position and the second position relative to the scroll length of the scroll graphic is representative of an amount of the second subset relative to the entire library of virtual content.