# US 2023/0410503 A1 · User scanning and one-way augmented reality viewing system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0410503 A1
- Document ID: US20230410503A1
- Status: Published application
- Kind: A1
- Application number: 18/459,993
- Filed: 2023-09-01
- Published: 2023-12-21
- Earliest claimed: 2019-07-02
- Assignees: Truist Bank
- Applicants: Truist Bank
- Inventors: Michael Anthony Dascola; Jacob Atticus Grady; Kaitlyn Stahl
- Web page: https://patentgrep.com/patent/US20230410503A1

## CPC

- G06V 20/20: in augmented reality scenes
- A61B 5/112: {Gait analysis}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/1438: {using more than one graphics controller}
- G06F 3/147: using display panels
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06Q 30/0269: {based on user profile or attribute}
- G06T 7/207: for motion estimation over a hierarchy of resolutions (multi-resolution motion estimation or hierarchical motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/53)
- G06T 7/74: {involving reference images or patches}
- G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships}
- G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities
- G09G 5/14: Display of multiple viewports
- H04L 63/102: {Entity profiles}
- H04L 63/105: {Multiple levels of security}
- H04L 63/1433: {Vulnerability analysis}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/117: Identification of persons (methods or arrangements for recognising patterns, e.g. fingerprints, G06F18/00, G06V40/00; identification of persons by analysing their voice or speech G10L17/00)
- A61B 5/1176: {Recognition of faces}
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- H04L 2463/082: applying multi-factor authentication
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method for providing augmented reality content includes identifying a customer at a customer interaction location, retrieving customer-specific interaction data, determining locations of a customer service representative in an area adjacent to a first side of a transparent panel and the customer in an area adjacent to a second side of the transparent panel, and projecting an augmented reality element to the first side of a transparent panel, the augmented reality element displaying the customer-specific interaction data on the first side of the transparent panel.

## Claims

### Claim 1

A method for providing augmented reality content, the method comprising:
determining, at a customer interaction location, locations of a customer service representative in an area adjacent to a first surface of a transparent panel and a customer in an area adjacent to a second surface of the transparent panel;
tracking movements of the customer to different locations in the area adjacent to the second surface of the transparent panel;
projecting, with a projection system configured to determine locations on the first surface of the transparent panel at which customer-specific interaction data is to be projected, an augmented reality element comprising the customer-specific interaction data such that the locations of the projected customer-specific interaction data follow the movements of the customer and a relationship is maintained between the locations of the customer service representative, the projected customer-specific interaction data, and the different locations of the customer,
wherein the customer-specific interaction data is visible only to the customer service representative located in the area adjacent to the first surface of the transparent panel while the customer is visible to the customer service representative.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving sensor data corresponding to the customer interaction location from a camera device, the sensor data including visual data;
analyzing the sensor data to detect the customer within a proximity of the location;
detecting, based on analyzing the sensor data, a characteristic of the customer;
comparing the characteristic of the customer to a data store storing characteristics for a plurality of customers; and
identifying a customer profile based on the comparison, wherein the customer profile matches the characteristic of the customer.

### Claim 3 (depends on 2)

The method of claim 2, wherein a characteristic of the customer is a visual characteristic corresponding to facial features of the customer.

### Claim 4 (depends on 1)

The method of claim 1, further comprising:
detecting, based on analyzing sensor data corresponding to the customer interaction location, a set of characteristics of the customer;
comparing the set of characteristic of the customer to stored characteristics for a plurality of customers; and
identifying a customer profile based on multi-factor matching of the set of characteristics to the stored characteristics.

### Claim 5 (depends on 4)

The method of claim 4, wherein the set of characteristics of the customer includes one or more of:
biometric data collected from the customer via biometric sensors;
a height measurement of the customer collected by a camera;
a gait profile of the customer collected by the camera;
ear features of the customer collected by the camera; or
a voiceprint of the customer collected by a microphone,
wherein a customer profile is determined from customer characteristics stored in a data store based on the biometric data, the height measurement, the gait profile, the ear features, or the voiceprint.

### Claim 6 (depends on 1)

The method of claim 1, wherein projecting the augmented reality element including the customer-specific interaction data to the customer service representative comprises:
determining an eye gaze location of the customer service representative on the first surface of the transparent panel; and
projecting the augmented reality element including the customer-specific interaction data at the determined eye gaze location of the customer service representative on the first surface of the transparent panel.

### Claim 7 (depends on 1)

The method of claim 1, further comprising:
retrieving customer-specific interaction data from a data store having a plurality of user profiles with user characteristics stored therein for a plurality of users;
determining strategies for interactions with the customer based on the retrieved customer-specific interaction data, wherein the strategies for interaction include a product or service offering, or identification of a security risk; and
transmitting the strategies for interactions to an augmented reality system of a customer service representative at the customer interaction location.

### Claim 8

An augmented reality system, comprising:
one or more camera devices configured to track movements of a customer service representative in an area adjacent to a first surface of a transparent panel and a customer in an area adjacent to a second surface of the transparent panel and to capture personally identifying characteristic data of the customer;
a projection system configured to determine locations on the first surface of the transparent panel at which customer-specific interaction data is to be projected, and project an augmented reality element comprising the customer-specific interaction data such that the locations of the projected customer-specific interaction data follow the movements of the customer and a relationship is maintained between the locations of the customer service representative, the projected customer-specific interaction data, and different locations of the customer,
wherein the customer-specific interaction data is visible only to the customer service representative located in the area adjacent to the first surface of the transparent panel while the customer is visible to the customer service representative.

### Claim 9 (depends on 8)

The augmented reality system of claim 8, wherein the projection system is further configured to:
determine an eye gaze location of the customer service representative on the first surface of the transparent panel; and
project the augmented reality element including the customer-specific interaction data at the determined eye gaze location of the customer service representative on

### Claim 10 (depends on 8)

The augmented reality system of claim 8, further comprising a processor, wherein the processor is configured to:
receive sensor data corresponding to the area adjacent to the second surface of the transparent panel from the one or more camera devices, the sensor data including visual data;
analyze the sensor data to detect a customer within the area adjacent to the second surface of the transparent panel;
detect, based on analyzing the sensor data, a characteristic of the customer;
compare the characteristic of the customer to a data store storing characteristics for a plurality of customers; and
identify a customer profile based on the comparison, wherein the customer profile matches the characteristic of the customer.

### Claim 11 (depends on 10)

The augmented reality system of claim 10, wherein a characteristic of the customer is a visual characteristic corresponding to facial features of the customer.

### Claim 12 (depends on 10)

The augmented reality system of claim 10, wherein the processor is further configured to:
detect, based on analyzing the sensor data, a set of characteristics of the customer;
compare the set of characteristic of the customer to stored characteristics for a plurality of customers; and
identify a customer profile based on multi-factor matching of the set of characteristics to the stored characteristics.

### Claim 13 (depends on 12)

The augmented reality system of claim 12, further comprising:
biometric sensors; and
a microphone,
wherein the set of characteristics of the customer includes one or more of:
biometric data collected from the customer via biometric sensors;
a height measurement of the customer collected by a camera;
a gait profile of the customer collected by the camera;
ear features of the customer collected by the camera; or
a voiceprint of the customer collected by a microphone,
wherein the processor is further configured to determine a customer profile from customer characteristics stored in a data store based on the biometric data, the height measurement, the gait profile, the ear features, or the voiceprint.

### Claim 14 (depends on 13)

The augmented reality system of claim 13, wherein the processor is further configured to:
retrieve data from a data store having a plurality of user profiles with user characteristics stored therein for a plurality of users;
determine strategies for interactions with the customer based on the retrieved data, wherein the strategies for interaction include a product or service offering, or identification of a security risk; and
transmit the strategies for interactions to the augmented reality system of a customer service representative.
