# US 2026/0260735 A1 · Interactive communication management and information delivery systems and methods

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0260735 A1
- Document ID: US20260260735A1
- Status: Published application
- Kind: A1
- Application number: 19/656,861
- Filed: 2026-04-23
- Published: 2026-09-03
- Earliest claimed: 2021-09-13
- Assignees: OpticSurg Inc.
- Applicants: OpticSurg Inc.
- Inventors: Tran T. Huynh; Carl Tönsgård; Kyle P. Chadwick; Michael Rizkalla
- Web page: https://patentgrep.com/patent/US20260260735A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G16H 30/40: for processing medical images, e.g. editing
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 11/00: Two-dimensional [2D] image generation
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06V 20/20: in augmented reality scenes
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/63: for local operation
- G16H 40/67: for remote operation
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2210/41: Medical
- G06T 2219/004: Annotating, labelling
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G16Y 10/60: Healthcare; Welfare
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G16Y: INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]

## Abstract

A communication management and information delivery system includes a wearable system configured to display virtual content in an AR environment, which includes a sensor assembly having a sensor configured to capture medical multimedia data in connection with a medical session and a display device to display virtual content in an AR environment. One or more processors are configured to interact with non-transitory memory to perform operations including: facilitating a secure communication between a remote computing device and the wearable system, wherein the remote computing device is configured to display the captured medical multimedia data on a display; generating feedback data associated with at least one of the captured medical multimedia data and electronic content displayed on the display, the feedback data generated based on feedback captured using one or more user input devices associated with the remote computing device; and, processing the feedback data with an annotation application.

## Claims

### Claim 1

A wearable system configured to display virtual content in an AR environment, the wearable system comprising:
a sensor assembly having at least one sensor configured to capture medical multimedia data in connection with a medical session;
a first display configured to present virtual content in an AR environment; and
one or more processors configured to interact with non-transitory memory to perform operations comprising:
automatically detecting a current type of use or a current scene of a wearer of the wearable system
providing, at a second display of a remote client computing device, an annotation menu including a plurality of options for creating an annotation, the plurality of options forming the annotation menu being based on the automatically detected current type of use or current scene of the wearer of the wearable system;
receiving feedback data associated with the captured medical multimedia data presented at the second display of a remote client computing device, and the feedback data is based on user input provided by the remote client computing device via the annotation menu; and
presenting at the first display, a visual indication of the feedback data superimposed over a real-world view of at least one of the medical multimedia data.

### Claim 2 (depends on 1)

The wearable system of claim 1, wherein the operations include facilitating a secure communication between the remote client computing device and the wearable system.

### Claim 3 (depends on 2)

The wearable system of claim 2, wherein the remote client computing device is configured to display captured medical multimedia data on the second display.

### Claim 4 (depends on 1)

The wearable system of claim 1, wherein the feedback data is associated with previously generated electronic content, corresponding to the captured medical multimedia data, presented at the second display of the remote client computing device.

### Claim 5 (depends on 1)

The wearable system of claim 1, wherein the visual indication of the feedback data is presented at the first display for a predetermined time before fading or disappearing.

### Claim 6 (depends on 1)

The wearable system of claim 1, wherein the visual indication of the feedback data is presented at the first display until a continuous user input, provided by at least one of a user finger or a pointer device, is released.

### Claim 7 (depends on 1)

The wearable system of claim 1, further comprising an object type annotation module executed by the one or more processors, the object type annotation module is operable to determine an annotation type based on an object detected by the sensor assembly.

### Claim 8 (depends on 7)

The wearable system of claim 7, wherein the object type annotation module generates a first annotation type if object is a human and a second annotation type if the object is a button on a machine.

### Claim 9 (depends on 1)

The wearable system of claim 1, wherein the plurality of options for forming the annotation menu are further based on a user input selecting the current type of use or the current scene.

### Claim 10 (depends on 1)

The wearable system of claim 1, wherein:
the current type of use is surgery; and
the plurality of options forming the annotation menu are based on the current type of use being surgery.

### Claim 11 (depends on 1)

The wearable system of claim 1, wherein:
the current type of use is training; and
the plurality of options forming the annotation menu are based on the current type of use being training.

### Claim 12 (depends on 1)

The wearable system of claim 1, wherein the operations further include determining a type of device or a device capability associated with the wearable system, and whether the annotation menu generates 2D annotations or 3D annotations is based at least in part on the type of device or the device capability.

### Claim 13

A wearable system configured to display virtual content in an AR environment, the wearable system comprising:
a sensor assembly having at least one sensor configured to capture medical multimedia data in connection with a medical session;
a first display configured to present virtual content in an AR environment; and
one or more processors configured to interact with non-transitory memory to perform operations comprising:
automatically detecting a current type of use or a current scene of a wearer of the wearable system
sending the captured medical multimedia data to a remote client computing device, the remote client computing device being configured to present an annotation menu including a plurality of options for creating an annotation, the plurality of options forming the annotation menu being based on the automatically detected current type of use or current scene of the wearer of the wearable system;
receive feedback data associated with the captured medical multimedia data presented at the remote client computing device, and the feedback data is based on user input provided by the remote client computing device via the annotation menu; and
displaying on the first display of the wearable system, a visual indication of the feedback data superimposed over a real-world view of at least one of the medical multimedia data, electronic content, or virtual content.

### Claim 14 (depends on 13)

The wearable system of claim 13, wherein the visual indication of the feedback data is displayed in a color assigned to a remote user participant associated with the remote client computing device.

### Claim 15 (depends on 13)

The wearable system of claim 13, wherein the visual indication of the feedback data is displayed in a creator-specific color together with identifying information of a remote user that created the feedback data.

### Claim 16 (depends on 13)

The wearable system of claim 13, wherein the visual indication of the feedback data begins fading upon being displayed at the first display.

### Claim 17 (depends on 13)

The wearable system of claim 13, wherein the visual indication of the feedback data comprises a directional annotation configured to prompt the wearer to look in a selected direction.

### Claim 18 (depends on 13)

The wearable system of claim 13, wherein the operations further comprise processing one or more depth estimation signals captured by the sensor assembly to map the feedback data to a depth of an object viewed by the wearer.

### Claim 19 (depends on 13)

The wearable system of claim 13, wherein the visual indication of the feedback data remains visible until removal in response to an audio command provided by the wearer.

### Claim 20

A wearable system configured to display virtual content in an AR environment, the wearable system comprising:
a first display; and
one or more processors configured to interact with non-transitory memory to perform operations comprising:
receiving medical multimedia data from a wearable device that includes a sensor assembly having at least one sensor configured to capture the medical multimedia data in connection with a medical session;
presenting, at the first display, an annotation menu including a plurality of options for creating an annotation, the plurality of options forming the annotation menu being based on an automatically detected current use or scene of a wearer of the wearable device;
generating feedback data associated with the captured medical multimedia data presented at the first display based on user input via the annotation menu; and
sending the feedback data to the wearable device to cause a visual indication of the feedback data to be superimposed over a real-world view of at least one of the medical multimedia data presented at a second display of the wearable device.
