# US 2026/0073665 A1 · Medical image analysis using machine learning and an anatomical vector

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073665 A1
- Document ID: US20260073665A1
- Status: Published application
- Kind: A1
- Application number: 19/392,790
- Filed: 2025-11-18
- Published: 2026-03-12
- Earliest claimed: 2019-12-19
- Assignees: Brainlab AG
- Applicants: Brainlab SE
- Inventors: Stefan Vilsmeier; Jens Schmaler
- Web page: https://patentgrep.com/patent/US20260073665A1

## CPC

- G06V 10/764: using classification, e.g. of video objects
- G06T 7/0014: {using an image reference approach}
- G06T 7/136: involving thresholding
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G06V 10/82: using neural networks
- G06V 20/695: {Preprocessing, e.g. image segmentation}
- G06V 20/698: {Matching; Classification}
- G06V 20/70: Labelling scene content, e.g. deriving syntactic or semantic representations
- G06T 2207/10056: Microscopic image
- G06T 2207/10061: from scanning electron microscope
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30004: Biomedical image processing
- G06V 2201/03: Recognition of patterns in medical or anatomical images
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Disclosed is a computer-implemented method which encompasses registering a tracked imaging device such as a microscope having a known viewing direction and an atlas to a patient space so that a transformation can be established between the atlas space and the reference system for defining positions in images of an anatomical structure of the patient. Labels are associated with certain constituents of the images and are input into a learning algorithm such as a machine learning algorithm, for example a convolutional neural network, together with the medical images and an anatomical vector and for example also the atlas to train the learning algorithm for automatic segmentation of patient images generated with the tracked imaging device. The trained learning algorithm then allows for efficient segmentation and/or labelling of patient images without having to register the patient images to the atlas each time, thereby saving on computational effort.

## Claims

### Claim 1

A computer-implemented method of training a learning algorithm for determining a relation between a label for indicating a position or type of an anatomical structure in a medical image and the position or type of the anatomical structure in the medical image comprising:
acquiring patient training image data which describes digital medical images of an anatomical structure of a plurality of patients;
acquiring atlas data which describes an anatomical model of the anatomical body part including the anatomical structure;
acquiring viewing direction data which describes the viewing direction of an imaging device towards the anatomical structure at the point in time when the imaging device was used to generate the medical image;
determining anatomical vector data based on the viewing direction data and the atlas data, wherein the anatomical vector data describes an anatomical vector which is a result of transforming the viewing direction into a reference system in which positions in the anatomical model are defined;
assigning a ground truth label as label data which describes a label describing the position or type of the anatomical structure in the anatomical model; and
training a machine learning model by providing to the machine learning model a training instance of the patient training image data and the anatomical vector data paired with the assigned ground truth label.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the medical image is a two-dimensional image, and wherein the imaging device is one of a microscope, an endoscope equipped with a digital camera, or an x-ray device that is configured to produce two-dimensional projection images.

### Claim 3 (depends on 1)

The method according to claim 1,
wherein the machine learning model is trained by additionally inputting a subset of the atlas data.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising
acquiring additional data which is a function of the anatomical vector; and
training the machine learning model by inputting the additional data into the machine learning model as a part of the training instance.

### Claim 5

A computer-implemented method of determining a relation between a ground truth label for indicating a position or type of an anatomical structure in a medical image and the position or type of the anatomical structure in the medical image, the method comprising:
acquiring individual patient image data which describes a digital individual medical image of an anatomical structure of an individual patient; and
determining machine learning model which describes a relation between the ground truth label and the anatomical structure in the individual medical image;
wherein the machine learning model is trained by inputting the individual patient image data into a function which establishes the relation between the anatomical structure described by the individual medical image and the ground truth label.

### Claim 6

A computer-implemented method of determining a relation between a label for indicating a position or type of an anatomical structure in a medical image and the position or type of the anatomical structure in the medical image, the method comprising:
acquiring individual patient image data which describes a digital individual medical image of an anatomical structure of an individual patient;
acquiring atlas data which describes an anatomical model of the anatomical body part including the anatomical structure; and
acquiring individual viewing direction data which describes a viewing direction of an imaging device towards the anatomical structure at the point in time when the imaging device was used to generate the individual medical image;
determining individual anatomical vector data based on the individual viewing direction data and the atlas data, wherein the anatomical vector data describes an anatomical vector which is a result of transforming the viewing direction into a reference system in which positions in the anatomical model are defined;
acquiring additional data which is a function of the individual anatomical vector; and
determining a relation between a label and the anatomical structure by providing, to a trained machine learning model, the individual patient image data and the additional data.

### Claim 7 (depends on 6)

The method according to the claim 6, wherein the machine learning model is determined additionally based on the atlas data.

### Claim 8 (depends on 6)

The method according to claim 6, wherein the individual patient image is a two-dimensional image and wherein the imaging device is a microscope.

### Claim 9 (depends on 6)

The method according to claim 6, wherein a relative position between the imaging device is a microscope, used for generating the individual patient image data and the individual anatomical vector data is predetermined.

### Claim 10 (depends on 6)

The method according to claim 6, wherein the trained machine learning model comprises a convolutional neural network.
