# US 2026/0073301 A1 · Machine learning model input monitor

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073301 A1
- Document ID: US20260073301A1
- Status: Published application
- Kind: A1
- Application number: 19/314,159
- Filed: 2025-08-29
- Published: 2026-03-12
- Earliest claimed: 2024-09-03
- Applicants: AUMOVIO Autonomous Mobility Germany GmbH
- Inventors: Mert Keser; Erwin Kraft
- Web page: https://patentgrep.com/patent/US20260073301A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A trained vision foundation model and a training data set used for training of the machine learning model are provided. For each training image of the training data set, a training data feature vector is determined using the vision foundation model. A distribution of the training data feature vectors is determined, An image depicting a scene is received. An image feature vector is determined for the image using the vision foundation model. A log likelihood is computed for the image feature vector to the distribution of the training data feature vectors. An alert is produced if the image differs from the distribution of the training data feature vectors based on an analysis of the log likelihood.

## Claims

### Claim 1

A method, in particular a computer-implemented method, for monitoring the performance of a trained machine learning model, the method comprising:
providing a trained vision foundation model;
providing a training data set used for training of the machine learning model;
for each training image of the training data set determining a training data feature vector using the vision foundation model,
determining a distribution of the training data feature vectors;
receiving an image depicting a scene;
determining an image feature vector for the image using the vision foundation model;
computing a log likelihood for the image feature vector to the distribution of the training data feature vectors;
providing an alert if the image differs from the distribution of the training data feature vectors based on an analysis of the log likelihood.

### Claim 2 (depends on 1)

The method according to claim 1,
wherein the distribution is determined by a distribution determination model, by using a mixture model, a gaussian mixture model, or by applying a Mises-Fisher distribution.

### Claim 3 (depends on 2)

The method according to claim 2,
wherein determining the distribution further comprises applying an expectation-maximation algorithm.

### Claim 4 (depends on 2)

The method according to claim 2,
wherein determining the distribution further comprises applying an Akaike information criterion, applying a Bayesian information criterion, or providing a validation data set and computing a log-likelihood of validation data feature vectors to the distribution of the training data feature vectors.

### Claim 5 (depends on 1)

The method according to claim 1,
wherein the vision foundation model is a CLIP model, a DINO model, a DINOv2 model, a Grounding DINO model, a GLIP model, an Eva-CLIP model, a SAM model, or a SAMv2 model.

### Claim 6 (depends on 1)

The method according to claim 1,
wherein the log likelihood of the image feature vector is transformed into a normalized confidence score.

### Claim 7 (depends on 6)

The method according to claim 6,
wherein the transformation is carried out by a shifting and scaling of the log likelihood.

### Claim 8 (depends on 6)

The method according to claim 6,
wherein the analysis of the log likelihood of the image feature vector comprises a comparison of the corresponding normalized confidence score with a predetermined threshold.

### Claim 9 (depends on 8)

The method according to claim 8,
wherein the alert is provided if the normalized confidence score is smaller than the threshold.

### Claim 10 (depends on 1)

The method according to claim 1, wherein the trained machine learning model is used in an ADAS system or for an autonomous vehicle.

### Claim 11 (depends on 1)

A monitoring system for monitoring a performance of a trained machine learning model comprising at least one environmental sensor and a memory storing executable instructions for execution by one or more processors, the executable instructions comprising instructions for performing a method according to claim 1.

### Claim 12 (depends on 1)

A computer program comprising instructions, which, when the program is executed by a computer, cause the computer to carry out the method of claim 1.

### Claim 13 (depends on 1)

A computer-readable medium comprising instructions executable by at least one processor to perform the method of claim 1.