# US 2023/0065719 A1 · User interface with augmented work environments

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0065719 A1
- Document ID: US20230065719A1
- Status: Published application
- Kind: A1
- Application number: 17/411,841
- Filed: 2021-08-25
- Published: 2023-03-02
- Earliest claimed: 2021-08-25
- Assignees: Bank of America Corporation
- Applicants: Bank of America Corporation
- Inventors: Matthew K. Bryant; Jesse Wiggins
- Web page: https://patentgrep.com/patent/US20230065719A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G01S 7/4863: Detector arrays, e.g. charge-transfer gates
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G01S 17/894: Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
- G06F 21/31: User authentication
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database}
- G06T 7/50: Depth or shape recovery
- G06T 15/20: Perspective computation
- G08B 5/22: using electric transmission; using electromagnetic transmission
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04L 67/51: Discovery or management thereof, e.g. service location protocol [SLP] or web services
- H04L 67/75: Indicating network or usage conditions on the user display
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2219/024: Multi-user, collaborative environment
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

With the advent of augmented reality devices becoming increasingly prevalent, accessible, and cross-compatible, there is an opportunity to leverage the capabilities of such devices in order to streamline workflow and information access in number of contexts. The present invention provides an integrated, dynamic system for leveraging the capabilities of augmented reality systems in order to provide users with personalized information in a dependable, seamless, and secure manner.

## Claims

### Claim 1

A system for dynamically augmenting a user environment, the system comprising:
a memory device; and
a processing device operatively coupled to the memory device, wherein the processing device is configured to execute computer-readable program code to:
receive one or more user preference selections for a workspace environment and store the user preference selections in a unique user configuration;
receive imaging data from an augmented reality system or a user device;
based on the received imaging data, determine a perspective view and surface structure of a user's surroundings;
identify one or more compatible user devices on a shared network of the one or more compatible user devices and the augmented reality system;
determine an access level for a user based on receiving one or more authentication credentials and task information; and
continually transmit a display of one or more virtual objects to the augmented reality system based on the user preference selections, received imaging data, and the access level for the user, wherein the display of the one or more virtual objects is dynamically altered in response to chances to the task information.

### Claim 2 (depends on 1)

The system of claim 1, further configured to determine the one or more virtual objects based on one or more authentication credentials provided by a user via the user device.

### Claim 3 (depends on 1)

The system of claim 1, wherein the one or more virtual objects further comprise three dimensional virtual renderings or representations for the one or more compatible user devices.

### Claim 4 (depends on 1)

The system of claim 1, wherein the imaging data further comprises light detection and ranging (LiDAR) data.

### Claim 5 (depends on 1)

The system of claim 1, further configured to receive notification information from the one or more compatible user devices; and
alter display of the one or more virtual objects in response to the notification information.

### Claim 6 (depends on 1)

The system of claim 1, wherein continually transmitting a display of one or more virtual objects further comprises transmitting display information at a refresh rate of at least 30 frames per second.

### Claim 7 (depends on 1)

The system of claim 1, further configured to receive notification information from the one or more compatible user devices; and
transmit an interactive notification prompt to the augmented reality system.

### Claim 8

A computer program product for dynamically augmenting a user environment, the computer program product comprising at least one non-transitory computer readable medium comprising computer readable instructions, the instructions comprising instructions for:
receiving one or more user preference selections for a workspace environment and store the user preference selections in a unique user configuration;
receiving imaging data from an augmented reality system or a user device;
based on the received imaging data, determining a perspective view and surface structure of a user's surroundings;
identifying one or more compatible user devices on a shared network of the one or more compatible user devices and the augmented reality system;
determining an access level for a user based on receiving one or more authentication credentials and task information; and
continually transmitting a display of one or more virtual objects to the augmented reality system based on the user preference selections, received imaging data, and the access level for the user, wherein the display of the one or more virtual objects is dynamically altered in response to chances to the task information.

### Claim 9 (depends on 8)

The computer program product of claim 8, further configured to determine the one or more virtual objects based on one or more authentication credentials provided by a user via the user device.

### Claim 10 (depends on 8)

The computer program product of claim 8, wherein the one or more virtual objects further comprise three dimensional virtual renderings or representations for the one or more compatible user devices.

### Claim 11 (depends on 8)

The computer program product of claim 8, wherein the imaging data further comprises light detection and ranging (LiDAR) data.

### Claim 12 (depends on 8)

The computer program product of claim 8, further comprising:
receiving notification information from the one or more compatible user devices; and
altering display of the one or more virtual objects in response to the notification information.

### Claim 13 (depends on 8)

The computer program product of claim 8, wherein continually transmitting a display of one or more virtual objects further comprises transmitting display information at a refresh rate of at least 30 frames per second.

### Claim 14 (depends on 8)

The computer program product of claim 8, further comprising:
receiving notification information from the one or more compatible user devices; and
transmitting an interactive notification prompt to the augmented reality system.

### Claim 15

A computer implemented method for dynamically augmenting a user environment, said computer implemented method comprising:
providing a computing system comprising a computer processing device and a non-transitory computer readable medium, where the computer readable medium comprises configured computer program instruction code, such that when said instruction code is operated by said computer processing device, said computer processing device performs the following operations:
receiving one or more user preference selections for a workspace environment and store the user preference selections in a unique user configuration;
receiving imaging data from an augmented reality system or a user device;
based on the received imaging data, determining a perspective view and surface structure of a user's surroundings;
identifying one or more compatible user devices on a shared network of the one or more compatible user devices and the augmented reality system;
determining an access level for a user based on receiving one or more authentication credentials and task information; and
continually transmitting a display of one or more virtual objects to the augmented reality system based on the user preference selections, received imaging data, and the access level for the user, wherein the display of the one or more virtual objects is dynamically altered in response to chances to the task information.

### Claim 16 (depends on 15)

The computer implemented method of claim 15, further configured to determine the one or more virtual objects or based on one or more authentication credentials provided by a user via the user device.

### Claim 17 (depends on 15)

The computer implemented method of claim 15, wherein the one or more virtual objects further comprise three dimensional virtual renderings or representations for the one or more compatible user devices.

### Claim 18 (depends on 15)

The computer implemented method of claim 15, wherein imaging data further comprises light detection and ranging (LiDAR) data.

### Claim 19 (depends on 15)

The computer implemented method of claim 15, further comprising:
receiving notification information from the one or more compatible user devices; and
altering display of the one or more virtual objects in response to the notification information.

### Claim 20 (depends on 15)

The computer implemented method of claim 15, wherein continually transmitting a display of one or more virtual objects further comprises transmitting display information at a refresh rate of at least 30 frames per second.
