# US 2022/0075839 A1 · Digital multimedia pinpoint bookmark device, method, and system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0075839 A1
- Document ID: US20220075839A1
- Status: Published application
- Kind: A1
- Application number: 17/526,924
- Filed: 2021-11-15
- Published: 2022-03-10
- Earliest claimed: 2017-03-07
- Assignees: Enemy Tree LLC
- Applicants: Enemy Tree LLC
- Inventors: John P. Rokos
- Web page: https://patentgrep.com/patent/US20220075839A1

## CPC

- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 16/9562: {Bookmark management}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0485: Scrolling or panning
- G06F 16/41: Indexing; Data structures therefor; Storage structures
- G06V 20/20: in augmented reality scenes
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46)
- H04L 67/1097: for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Embodiments of the inventive concept enable a user to define exactly what and/or where they would like to set a digital pinpoint bookmark, and at a later time, engage the use of the pinpoint bookmark so that they can jump back to the very spot where they left off. In an augmented reality environment, the pinpoint bookmark may point to a real object or a virtual object. In a virtual reality environment, the pinpoint bookmark may point to a virtual object. The pinpoint bookmark is a visual mark that overlays the digital content and that points directly to the spot (i.e., directly to a punctuation mark, letter, word, paragraph, image, video clip, audio clip, real object, virtual object, or the like) so that it is easy and quick for the user to get back to the exact position. The pinpoint bookmark can be cleared using a button. Multiple pinpoint bookmarks across various different personal computing devices associated with a single user can be centrally stored and managed using a remote pinpoint bookmark database.

## Claims

### Claim 1

A pair of augmented reality smart glasses, comprising:
a translucent display;
a memory device;
a hand controller configured to select a real object that is viewable via the translucent display; and
a pinpoint bookmark control logic section coupled to the memory device,
wherein:
the hand controller is configured to be grasped by a user to select the real object in an augmented reality environment; and
the pinpoint bookmark control logic section is configured to cause the display to overlay a pinpoint bookmark on the display pointing to the real object in the augmented reality environment.

### Claim 2 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein the pinpoint bookmark control logic section is configured to automatically reposition the pinpoint bookmark on the display to keep the pinpoint bookmark pointing at the real object.

### Claim 3 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein the pinpoint bookmark control logic section is configured to automatically resize the pinpoint bookmark on the display to keep the pinpoint bookmark pointing at the real object.

### Claim 4 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein the memory device is configured to save the pinpoint bookmark.

### Claim 5 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein:
the pinpoint bookmark is a first pinpoint bookmark;
the hand controller is configured to be grasped by the user to select a virtual object in the augmented reality environment; and
the pinpoint bookmark control logic section is configured to cause the display to overlay a second pinpoint bookmark on the display pointing to the virtual object in the augmented reality environment.

### Claim 6 (depends on 5)

The pair of augmented reality smart glasses of claim 5, wherein the pinpoint bookmark control logic section is configured to automatically reposition the second pinpoint bookmark on the display to keep the second pinpoint bookmark pointing at the virtual object.

### Claim 7 (depends on 6)

The pair of augmented reality smart glasses of claim 6, wherein the pinpoint bookmark control logic section is configured to automatically resize the second pinpoint bookmark on the display to keep the second pinpoint bookmark pointing at the virtual object.

### Claim 8 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein:
the pinpoint bookmark is a first pinpoint bookmark;
the hand controller is configured to be grasped by the user to select a combination of a virtual object and the real object in the augmented reality environment;
the pinpoint bookmark control logic section is configured to cause the display to overlay a second pinpoint bookmark on the display pointing to the combination of the virtual object and the real object in the augmented reality environment;
the pinpoint bookmark control logic section is configured to automatically reposition the second pinpoint bookmark on the display to keep the second pinpoint bookmark pointing at the combination of the virtual object and the real object; and
the pinpoint bookmark control logic section is configured to automatically resize the second pinpoint bookmark on the display to keep the second pinpoint bookmark pointing at the combination of the virtual object and the real object.

### Claim 9 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein:
the pinpoint bookmark is a first pinpoint bookmark;
the hand controller is configured to be grasped by the user to highlight at least one of i) the real object, ii) a virtual object, or iii) a combination of the real object and the virtual object on the display in the augmented reality environment; and
responsive to a voice command from the user, the pinpoint bookmark control logic section is configured to cause the display to overlay a second pinpoint bookmark on the display pointing directly to the highlighted at least one of i) the real object, ii) the virtual object, or iii) the combination of the real object and the virtual object in the augmented reality environment.

### Claim 10 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein the pinpoint bookmark is a translucent elongated pinpoint bookmark having the form of an arrow with a single termination point on an end thereof.

### Claim 11 (depends on 1)

The pair of augmented reality smart glasses of claim 1, wherein the pinpoint bookmark control logic section is configured to detect a selection by the user of at least one of a pinpoint bookmark creation icon or menu option visible on the display.

### Claim 12

Virtual reality head gear, comprising:
a display;
a memory device;
a hand controller configured to select a virtual object that is viewable via the display; and
a pinpoint bookmark control logic section coupled to the memory device,
wherein:
the hand controller is configured to be grasped by a user to select the virtual object in a virtual reality environment; and
the pinpoint bookmark control logic section is configured to cause the display to overlay a pinpoint bookmark on the display pointing to the virtual object in the virtual reality environment.

### Claim 13 (depends on 12)

The virtual reality head gear of claim 12, wherein the pinpoint bookmark control logic section is configured to automatically reposition the pinpoint bookmark on the display to keep the pinpoint bookmark pointing at the virtual object.

### Claim 14 (depends on 12)

The virtual reality head gear of claim 12, wherein the pinpoint bookmark control logic section is configured to automatically resize the pinpoint bookmark on the display to keep the pinpoint bookmark pointing at the virtual object.

### Claim 15 (depends on 12)

The virtual reality head gear of claim 12, wherein the memory device is configured to save the pinpoint bookmark.

### Claim 16 (depends on 12)

The virtual reality head gear of claim 12, wherein:
the hand controller is configured to be grasped by the user to highlight the virtual object on the display in the virtual reality environment; and
responsive to a voice command from the user, the pinpoint bookmark control logic section is configured to cause the display to overlay the pinpoint bookmark on the display pointing directly to the highlighted virtual object in the virtual reality environment.

### Claim 17 (depends on 12)

The virtual reality head gear of claim 12, wherein the pinpoint bookmark is a translucent elongated pinpoint bookmark having the form of an arrow with a single termination point on an end thereof.

### Claim 18 (depends on 17)

The virtual reality head gear of claim 17, wherein the pinpoint bookmark control logic section is configured to cause an automatic scroll button to appear within the pinpoint bookmark on the display when the termination point of the pinpoint bookmark is not visible on the display.

### Claim 19 (depends on 17)

The virtual reality head gear of claim 17, wherein the pinpoint bookmark control logic section is configured to automatically scroll the virtual reality environment on the display when the termination point of the pinpoint bookmark is not visible on the display.

### Claim 20

An apparatus, comprising:
a display;
a memory device;
at least one of a real object or a virtual object that is viewable via the display;
a pinpoint bookmark control logic section coupled to the memory device; and
selection means for a user to select the at least one of the real object or the virtual object in at least one of an augmented reality environment or a virtual reality environment,
wherein the pinpoint bookmark control logic section is configured to cause the display to overlay a pinpoint bookmark on the display pointing to the at least one of the real object or the virtual object in the at least one of the augmented reality environment or the virtual reality environment.
