# US 10,768,421 B1 · Virtual monocle interface for information visualization

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,768,421 B1
- Document ID: US10768421B1
- Status: Granted
- Kind: B1
- Application number: 15/653,469
- Filed: 2017-07-18
- Granted: 2020-09-08
- Earliest claimed: 2016-07-18
- Applicants: Knowledge Initiatives LLC
- Inventors: Barr Rosenberg; Mark Gilbeau Howard; Alex Howard; Ian Howard
- Web page: https://patentgrep.com/patent/US10768421B1

## CPC

- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1673: {Arrangements for projecting a virtual keyboard}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/015: {Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- H04N 13/286: having separate monoscopic and stereoscopic modes
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A virtual monocle interface system comprising multiple interfaces for accessing, presenting, and interacting with multi-dimensional information objects is described. The information objects are visualized in multiple formats across multiple different display units, and displayed for the user to see in two dimensional, two-and-one-half dimensional, or three dimensional forms. The information objects can also be visualized using virtual reality.

## Claims

### Claim 1

A computer-implemented method for visualizing a structured, multi-dimensional dataset on multiple display units, comprising:
(a) receiving, from a database, datasets according to a user request, the datasets comprising a plurality of information objects, wherein the plurality of information objects are a set of records linked or related using a mathematical relationship defined in a multi-dimensional space and wherein each information object comprises structured data including sub-objects;
(b) displaying, on a first graphical user interface of a first device, a first visualization of the plurality of information objects;
(c) determining, by one or more processors, which subset of the plurality of information objects to be displayed on a second graphical user interface based at least on user information, user inputs, and information obtained from the first device and a second device, wherein the information comprises one or more members selected from the group consisting of a position, distance, and orientation of the second device with respect to the first device once the first device is connected to the second device; and
(d) displaying, on the second graphical user interface of the second device, a second visualization of the subset of the information objects, the second visualization different in form from the first visualization.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first visualization is in a three-dimensional space.

### Claim 3 (depends on 2)

The method of claim 2, wherein the second visualization is in a two-dimensional space.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first visualization or the second visualization is in a virtual reality environment.

### Claim 5 (depends on 2)

The method of claim 2, wherein the plurality of information objects are represented in the three-dimensional space using aerial projections.

### Claim 6 (depends on 5)

The method of claim 5, wherein the subset of the plurality of information objects are represented in a two-dimensional space, wherein the subset of the plurality of information objects are flattened into a two-dimensional space and additional contextual information related to the information objects are introduced on the second graphical user interface.

### Claim 7 (depends on 5)

The method of claim 5, wherein the information objects have different geometric shapes based at least on the type of the information, the importance of the information, and user feedback or input.

### Claim 8 (depends on 7)

The method of claim 7, wherein the geometric shapes comprise barrels, cones, cubes, cylinders, ellipsoids, polygons, and pyramids.

### Claim 9 (depends on 5)

The method of claim 5, wherein the more important information objects have larger sized geometric shapes compared to less important information objects.

### Claim 10 (depends on 5)

The method of claim 5, wherein the correlation among information objects is visualized using edges, wherein the edges comprise lines or arrows.

### Claim 11 (depends on 5)

The method of claim 5, wherein the information objects are repositioned and highlighted for visualization of contextual information.

### Claim 12 (depends on 2)

The method of claim 2, wherein the plurality of information objects are represented in a cityscape visual format, wherein each information object is represented by a building structure and the structured data within each information object is represented as floors of the building structure.

### Claim 13 (depends on 12)

The method of claim 12, wherein the first visualization includes building structures and the second visualization includes floors.

### Claim 14 (depends on 1)

The method of claim 1, wherein the first graphical user interface is larger than the second graphical user interface.

### Claim 15 (depends on 1)

The method of claim 1, wherein the second device is a mobile device.

### Claim 16 (depends on 4)

The method of claim 4, wherein the first device is a head-mounted display configured to project the plurality of objects in the virtual environment and wherein the subset of the plurality of information objects are determined based at least on the orientation and eye-movement of a user of the head-mounted display.

### Claim 17 (depends on 1)

The method of claim 1, wherein the second device is a head-mounted display configured to project the subset of the plurality of objects in a virtual environment.

### Claim 18 (depends on 1)

The method of claim 1, wherein the information obtained by the first device and the second device comprises orientation and motion data, wherein the orientation and motion data is obtained from sensors onboard the first device and second device.

### Claim 19 (depends on 1)

The method of claim 1, wherein the dataset further comprises a context array, the context array comprising data on the user including the user's identity, historic activity, and preferences, and wherein the first visualization and the second visualization are based at least on the context array.

### Claim 20 (depends on 1)

The method of claim 1, wherein the user inputs comprise gestures.

### Claim 21 (depends on 20)

The method of claim 20, wherein the gestures comprise tap, double-tap, drag, pinch, press, swipe.

### Claim 22

A virtual monocle interface system for visualizing information, comprising:
a database configured to store a plurality of information objects, wherein the plurality of information objects are a set of records linked or related using a mathematical relationship defined in a multi-dimensional space and wherein each information object comprises structured data including sub-objects;
a first device comprising a first graphics user interface;
a second device comprising a second graphical user interface; and
one or more processors in communication with a computer readable medium storing software instructions that are executable by the one or more processors in order to cause the virtual monocle interface system to:
receive, from the database, the plurality of information objects corresponding to a user request;
display, on the first graphical user interface of the first device, a first visualization of the plurality of information objects;
determine, by the one or more processors, which subset of the plurality of information objects to be displayed on the second graphical user interface based at least on user information, user inputs, and information obtained from the first device and the second device, wherein the information comprises one or more members selected from the group consisting of a position, distance, and orientation of the second device with respect to the first device once the first device is connected to the second device; and
display, on the second graphical user interface of the second device, a second visualization of the subset of the information objects, the second visualization different in form from the first visualization.

### Claim 23 (depends on 22)

The system of claim 22, wherein the first visualization is in a three-dimensional space.

### Claim 24 (depends on 23)

The system of claim 23, wherein the second visualization is in a two-dimensional space.

### Claim 25 (depends on 22)

The system of claim 22, wherein the first visualization or the second visualization are in a virtual reality environment.

### Claim 26 (depends on 23)

The system of claim 23, wherein the plurality of information objects are represented in the three-dimensional space using aerial projections.