# US 2023/0274516 A1 · Context aware dual display to augment reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0274516 A1
- Document ID: US20230274516A1
- Status: Published application
- Kind: A1
- Application number: 18/314,380
- Filed: 2023-05-09
- Published: 2023-08-31
- Earliest claimed: 2019-01-22
- Assignees: Cognixion Corporation
- Applicants: Cognixion Corporation
- Inventors: Joseph Andreas Forsland; Leonard Zerman
- Web page: https://patentgrep.com/patent/US20230274516A1

## CPC

- G06F 3/147: using display panels
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G02B 27/017: {Head mounted}
- G06F 3/0237: {using prediction or retrieval techniques}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- G06F 16/383: using metadata automatically derived from the content
- H04N 7/14: Systems for two-way working ({H04N7/12, } H04N7/173 take precedence)
- G09G 2300/023: Display panel composed of stacked panels
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A method and system of a user interface device with dual-sided display which may include a system using a brain computer interface with an Augmented Reality (AR) headset. The user's intent is sent to the system, which processes, analyzes and maps the user's intent. An output corresponding to the user's intent is projected using the user interface device. This output is displayed on the user's side of the display. An image corresponding to the output is displayed on the observer's side of the display.

## Claims

### Claim 1

A method comprising:
receiving a signal that represents a user's evoked potential through a sensor or an input device on a user interface device, wherein the user initiates the signal by an activity;
sending the signal to an interpretation unit, wherein the interpretation unit comprises:
a converter, wherein the converter converts the signal corresponding to the user's evoked potential to a digital signal;
an intent database, wherein the intent database includes actions associated with curated digital signals;
a message database, wherein the message database includes messages corresponding to curated actions; and
a comparator, wherein the comparator generates at least one of a user-initiated action and a message corresponding to the user-initiated action by comparing the digital signal to the curated digital signals in the intent database to generate the user-initiated action and by comparing the user-initiated action to curated actions in the message database to generate the message;
sending the user-initiated action and the message to a user interface controller to display the user-initiated action and the message; and
displaying the user-initiated action and the message on the user interface device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the user initiates the signal by the activity that may include at least one of a physical activity, a mental activity, an environmental stimulus, and combinations thereof.

### Claim 3 (depends on 1)

The method of claim 1, wherein the user interface device comprises at least one of an augmented reality headset, a transparent or semi-transparent screen, an optical projection, a medium through which the user and an observer would see one another and combinations thereof.

### Claim 4 (depends on 1)

The method of claim 1, wherein the user interface controller may select to display at least one of the user-initiated action, the message and combinations thereof.

### Claim 5 (depends on 1)

The method of claim 1, further comprising displaying the user-initiated action to a contextually related display to an observer.

### Claim 6 (depends on 5)

The method of claim 5, wherein the contextually related display is a portion of a transparent, semi-transparent, or projected screen on the user interface device.

### Claim 7 (depends on 1)

The method of claim 1, wherein the signal is a request to display a virtual keyboard on the user interface device.

### Claim 8 (depends on 7)

The method of claim 7, further comprising initiating a command from the virtual keyboard to communicate to an observer.

### Claim 9 (depends on 1)

The method of claim 1, further comprising receiving a communication from a third party and displaying the communication to a contextually related display.

### Claim 10 (depends on 1)

The method of claim 1, further comprising determining if the intent database and the message database include a desired action or a desired message, wherein at least one of the intent database and the message database is located on the user interface device.

### Claim 11 (depends on 10)

The method of claim 10, wherein at least one of the intent database and the message database is located on a cloud server or local edge computing device.

### Claim 12 (depends on 10)

The method of claim 10, further comprising updating at least one of the intent database and the message database with the desired action or the desired message.

### Claim 13

An apparatus comprising:
a processor; and
a memory storing instructions that, when executed by the processor, configure the apparatus to:
receive a signal that represents a user's evoked potential through a sensor on a user interface device, wherein the user initiates the signal by an activity;
send the signal to an interpretation unit; wherein the interpretation unit comprises:
a converter, wherein the converter converts the signal corresponding to the user's evoked potential to a digital signal;
an intent database, wherein the intent database includes actions associated with curated digital signals;
a message database, wherein the message database includes messages corresponding to curated actions; and
a comparator, wherein the comparator generates at least one of a user-initiated action and a message corresponding to the user-initiated action by comparing the digital signal to curated digital signals in the intent database to generate the user-initiated action and by comparing the user-initiated action to curated actions in the message database to generate the message;
send the user-initiated action and the message to a user interface controller to display the user-initiated action and the message; and
display the user-initiated action and the message on the user interface device.

### Claim 14 (depends on 13)

The apparatus of claim 13, wherein the user interface device comprises at least one of an augmented reality headset, a transparent or semi-transparent screen, an optical projection, a medium through which the user and an observer would see one another and combinations thereof.

### Claim 15 (depends on 14)

The apparatus of claim 14, wherein the transparent or semi-transparent screen is a transparent organic light emitting diode (TOLED) screen or a projection on a semi-reflective medium.

### Claim 16 (depends on 14)

The apparatus of claim 14, wherein the transparent or semi-transparent screen is replaced by two non-transparent displays, wherein the two non-transparent displays show contextually related information.

### Claim 17 (depends on 13)

The apparatus of claim 13, wherein the user interface controller may select to display at least one of the user-initiated action, the message and combinations thereof.

### Claim 18 (depends on 13)

The apparatus of claim 13, wherein the user initiates the signal by the activity that may include at least one of a physical activity, a mental activity, an environmental stimulus, an independently received digital message, and combinations thereof.
