# US 2025/0378357 A1 · Methods and apparatus for multi-modal anomaly detection

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0378357 A1
- Document ID: US20250378357A1
- Status: Published application
- Kind: A1
- Application number: 19/304,014
- Filed: 2025-08-19
- Published: 2025-12-11
- Earliest claimed: 2025-08-19
- Assignees: Intel Corporation
- Applicants: Intel Corporation
- Inventors: Anthony Rhodes
- Web page: https://patentgrep.com/patent/US20250378357A1

## CPC

- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An example apparatus includes interface circuitry, machine-readable instructions, and at least one processor circuit to be programmed by the machine-readable instructions to generate a probability distribution based on latent embeddings extracted from a dataset, the probability distribution representing interactions between a plurality of data modalities, and determine an anomaly detection score based on the probability distribution, the anomaly detection score corresponding to at least one of (1) an anomaly of a single data modality or (2) an anomaly of two or more data modalities.

## Claims

### Claim 1

An apparatus, comprising:
interface circuitry;
machine-readable instructions; and
at least one processor circuit to be programmed by the machine-readable instructions to:
generate a probability distribution based on latent embeddings extracted from a dataset, the probability distribution representing interactions between a plurality of data modalities in the dataset; and
determine an anomaly detection score based on the probability distribution and an importance score, the anomaly detection score corresponding to at least one of (1) an anomaly of a single data modality or (2) an anomaly of two or more data modalities.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein one or more of the at least one processor circuit is to estimate the importance score based on pooling and normalization of input feature gradients of the single data modality.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein one or more of the at least one processor circuit is to adjust a predictive analytical workflow based on the anomaly detection score.

### Claim 4 (depends on 1)

The apparatus of claim 1, wherein one or more of the at least one processor circuit is to perform deepfake detection based on the anomaly detection score.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the data modalities include at least one of a text, an image, an audio, or a video.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the probability distribution is generated based on a Gaussian Mixture Model (GMM), one or more of the at least one processor circuit is to identify the anomaly detection score based on a linear combination of GMM-based Mahalanobis distances.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein one or more of the at least one processor circuit is to identify the anomaly detection score based on a summation over joint distributions, the joint distributions generated during GMM-based fitting across combinations of the data modalities.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the latent embeddings are penultimate layer activations extracted by passing the dataset through a trained classifier of a multi-modal neural network.

### Claim 9

At least one non-transitory machine-readable medium comprising machine-readable instructions to cause at least one processor circuit to at least:
generate a probability distribution based on latent embeddings extracted from a dataset, the probability distribution representing interactions between a plurality of data modalities in the dataset; and
determine an anomaly detection score based on the probability distribution and an importance score, the anomaly detection score corresponding to at least one of (1) an anomaly of a single data modality or (2) an anomaly of two or more data modalities.

### Claim 10 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to estimate the importance score based on pooling and normalization of input feature gradients of the single data modality.

### Claim 11 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to adjust a predictive analytical workflow based on the anomaly detection score.

### Claim 12 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to perform deepfake detection based on the anomaly detection score.

### Claim 13 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the data modalities include at least one of a text, an image, an audio, or a video.

### Claim 14 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the probability distribution is generated based on a Gaussian Mixture Model (GMM), the machine-readable instructions are to cause one or more of the at least one processor circuit to identify the anomaly detection score based on a linear combination of GMM-based Mahalanobis distances.

### Claim 15 (depends on 14)

The at least one non-transitory machine-readable medium of claim 14, wherein the machine-readable instructions are to cause one or more of the at least one processor circuit to identify the anomaly detection score based on a summation over joint distributions, the joint distributions generated during GMM-based fitting across combinations of the data modalities.

### Claim 16 (depends on 9)

The at least one non-transitory machine-readable medium of claim 9, wherein the latent embeddings are penultimate layer activations extracted by passing the dataset through a trained classifier of a multi-modal neural network.

### Claim 17

An apparatus, comprising:
means for generating a probability distribution based on latent embeddings extracted from a dataset, the probability distribution representing interactions between a plurality of data modalities in the dataset; and
means for determining an anomaly detection score based on the probability distribution and an importance score, the anomaly detection score corresponding to at least one of (1) an anomaly of a single data modality or (2) an anomaly of two or more data modalities.

### Claim 18 (depends on 17)

The apparatus of claim 17, wherein the means for determining is to estimate the importance score based on pooling and normalization of input feature gradients of the single data modality.

### Claim 19 (depends on 17)

The apparatus of claim 17, wherein the data modalities include at least one of a text, an image, an audio, or a video.

### Claim 20 (depends on 17)

The apparatus of claim 17, wherein the latent embeddings are penultimate layer activations extracted by passing the dataset through a classifier of a multi-modal neural network.
