# US 2026/0094709 A1 · Integrated mixed reality visualization for diagnostic imaging and data mapping

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0094709 A1
- Document ID: US20260094709A1
- Status: Published application
- Kind: A1
- Application number: 18/900,604
- Filed: 2024-09-27
- Published: 2026-04-02
- Earliest claimed: 2024-09-27
- Inventors: Stephen McNutt
- Web page: https://patentgrep.com/patent/US20260094709A1

## CPC

- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 30/40: for processing medical images, e.g. editing
- G16H 50/50: for simulation or modelling of medical disorders
- G16H 50/70: for mining of medical data, e.g. analysing previous cases of other patients
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

Approaches are described for facilitating remote ophthalmic examinations using three-dimensional (3D) imaging and mixed reality technology. A system obtains real-time or stored 3D data of a patient's eye, capturing detailed anatomical structures. The system analyzes the 3D data to identify specific regions of the eye, such as the cornea or retina, and retrieves corresponding diagnostic data and patient-specific clinical information. The 3D data, diagnostic metrics, and clinical records are integrated to generate an interactive visualization, which is presented through a mixed reality interface. The system allows healthcare professionals to manipulate diagnostic overlays, investigate flagged abnormalities, and adjust the visualization using gesture-based inputs. Machine learning models may be applied to detect potential abnormalities in the eye, while the system also determines stages of the examination based on changes in the anatomical structure of the eye.

## Claims

### Claim 1

A computing system, comprising:
at least one computing processor; and
memory including instructions that, when executed by the at least one computing processor, enable the computing system to:
obtain three-dimensional (3D) data that includes a representation of an eye, the 3D data being captured in real-time and representing anatomical structures of the eye;
analyze the 3D data to identify at least one anatomical structure of the eye;
retrieve diagnostic data and patient-specific clinical information associated with the at least one anatomical structure of the eye;
integrate the 3D data with the diagnostic data and the patient-specific clinical information to generate an interactive visualization; and
present the interactive visualization via a mixed reality device, wherein the interactive visualization includes overlaid diagnostic information and user-controllable elements to manipulate diagnostic overlays.

### Claim 2 (depends on 1)

The computing system of claim 1, wherein the 3D data is captured by a vision intake system comprising stereoscopic cameras.

### Claim 3 (depends on 1)

The computing system of claim 1, wherein the computing system further determines a stage of an eye examination based on an anatomical structure of the eye identified in the 3D data.

### Claim 4 (depends on 3)

The computing system of claim 3, wherein determining the stage of the eye examination further comprises applying computer vision algorithms to analyze the 3D data and detect specific examination phases by comparing changes in the anatomical structure of the eye to predefined stage models.

### Claim 5 (depends on 1)

The computing system of claim 1, wherein the computing system applies machine learning models to the 3D data to detect potential abnormalities in the anatomical structures of the eye.

### Claim 6 (depends on 1)

The computing system of claim 1, wherein a display system spatially organizes the diagnostic data within a mixed reality environment, wherein spatially organizing comprises overlaying relevant clinical information directly onto anatomical structures displayed in the 3D data.

### Claim 7 (depends on 1)

The computing system of claim 1, further comprising a gesture-based input interface, wherein the gesture-based input interface allows a user to adjust the visualization.

### Claim 8 (depends on 1)

The computing system of claim 1, wherein integration of the 3D data, diagnostic data, and patient-specific clinical information comprises automatically mapping diagnostic metrics and clinical records to identified anatomical structures in the 3D data using region-based tagging techniques.

### Claim 9 (depends on 8)

The computing system of claim 8, wherein mapping is performed using landmark detection or region-based tagging techniques to associate diagnostic measurements, patient history, or clinical observations with corresponding regions of the 3D data.

### Claim 10 (depends on 1)

The computing system of claim 1, wherein the interactive visualization includes dynamically generated overlays highlighting areas of the eye based on the diagnostic data.

### Claim 11

A computer-implemented method, comprising:
obtaining three-dimensional (3D) data that includes a representation of an eye, the 3D data being captured in real-time and representing anatomical structures of the eye;
analyzing the 3D data to identify at least one anatomical structure of the eye;
retrieving diagnostic data and patient-specific clinical information associated with the at least one anatomical structure of the eye;
integrating the 3D data with the diagnostic data and the patient-specific clinical information to generate an interactive visualization; and
presenting the interactive visualization via a mixed reality device, wherein the interactive visualization includes overlaid diagnostic information and user-controllable elements to manipulate diagnostic overlays.

### Claim 12 (depends on 11)

The computer-implemented method of claim 11, further comprising:
determining a stage of an eye examination based on an anatomical structure of the eye identified in the 3D data.

### Claim 13 (depends on 12)

The computer-implemented method of claim 12, wherein determining the stage of the eye examination further comprises applying computer vision algorithms to analyze the 3D data and detect specific examination phases by comparing changes in the anatomical structure of the eye to predefined stage models.

### Claim 14 (depends on 11)

The computer-implemented method of claim 11, further comprising:
applying machine learning models to the 3D data to detect potential abnormalities in the anatomical structures of the eye.

### Claim 15 (depends on 11)

The computer-implemented method of claim 11, further comprising:
integrating the 3D data, diagnostic data, and patient-specific clinical information by automatically mapping diagnostic metrics and clinical records to identified anatomical structures in the 3D data using region-based tagging techniques.

### Claim 16 (depends on 11)

The computer-implemented method of claim 11, further comprising:
spatially organizing the diagnostic data within a mixed reality environment, wherein spatially organizing comprises overlaying relevant clinical information directly onto anatomical structures displayed in the 3D data.

### Claim 17

A non-transitory computer readable storage medium storing instructions that, when executed by at least one processor of a computing system, causes the computing system to:
obtain three-dimensional (3D) data that includes a representation of a an eye, the 3D data being captured in real-time and representing anatomical structures of the eye;
analyze the 3D data to identify at least one anatomical structure of the eye;
retrieve diagnostic data and patient-specific clinical information associated with the at least one anatomical structure of the eye;
integrate the 3D data with the diagnostic data and the patient-specific clinical information to generate an interactive visualization; and
present the interactive visualization via a mixed reality device, wherein the interactive visualization includes overlaid diagnostic information and user-controllable elements to manipulate diagnostic overlays.

### Claim 18 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the instructions, when executed by the at least one processor, further enables the computing system to:
determining a stage of an eye examination based on an anatomical structure of the eye identified in the 3D data.

### Claim 19 (depends on 18)

The non-transitory computer readable storage medium of claim 18, wherein the instructions, when executed by the at least one processor, further enables the computing system to:
apply computer vision algorithms to analyze the 3D data and detect specific examination phases by comparing changes in the anatomical structure of the eye to predefined stage models.

### Claim 20 (depends on 17)

The non-transitory computer readable storage medium of claim 17, wherein the instructions, when executed by the at least one processor, further enables the computing system to:
apply machine learning models to the 3D data to detect potential abnormalities in the anatomical structures of the eye.
