# US 2026/0065673 A1 · Systems and methods for generating trajectories from broadcast footage implementing diffusion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0065673 A1
- Document ID: US20260065673A1
- Status: Published application
- Kind: A1
- Application number: 19/309,109
- Filed: 2025-08-25
- Published: 2026-03-05
- Earliest claimed: 2024-08-28
- Assignees: Stats LLC
- Applicants: Stats LLC
- Inventors: Harry HUGHES; Michael John HORTON; Felix WEI; Patrick Joseph LUCEY
- Web page: https://patentgrep.com/patent/US20260065673A1

## CPC

- G06V 20/42: {of sport video content}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06V 20/44: {Event detection}
- G06T 2207/30241: Trajectory
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Systems and methods for generating trajectories for one or more players during an event include receiving broadcast footage of a sporting event, determining tracking data of one or more players in the sporting event from the broadcast footage, the tracking data including one or more vectors, receiving event data of the sporting event, and inputting the one or more vectors and event data into a multimodal model including an event encoder and a tracking decoder. A linear layer of the multimodal model may be applied to the vectors and event data to tokenize the event data and vectors. A tensor representing a sequence of the event data and tracking data may be determined. Perturbed tracking data of the sporting event and the tensor may be input into a diffusion model. The diffusion model may generate one or more trajectories for the one or more players in the sporting event.

## Claims

### Claim 1

A method for generating trajectories for one or more players during a sporting event, the method comprising:
receiving, as an input, broadcast footage of a sporting event;
determining tracking data of one or more players in the sporting event from the broadcast footage, the tracking data including one or more vectors;
receiving event data of the sporting event;
inputting the one or more vectors and event data into a multimodal model, the multimodal model including:
an event encoder; and
an tracking decoder;
applying a linear layer of the multimodal model to the one or more vectors and event data to tokenize the event data and one or more vectors;
determining, by the multimodal model, a tensor, the tensor representing a representation of sequence of the event data and tracking data;
receiving perturbed tracking data of the sporting event;
inputting the perturbed tracking data and tensor into a diffusion model, wherein the diffusion model includes a decoder; and
generating, by the diffusion model, one or more trajectories for the one or more players in the sporting event.

### Claim 2 (depends on 1)

The method of claim 1, wherein one or more vectors includes at least one of an agent's two dimensional coordinates on a sporting event's field, an agent position, an agent team, an indicator indicating the agent is a ball, or player visibility information.

### Claim 3 (depends on 1)

The method of claim 1, wherein the event data was derived from the broadcast footage.

### Claim 4 (depends on 1)

The method of claim 1, wherein the event data includes a sequential stream of one or more major events throughout a sport event, the major events including at least one of a pass, shot, tackle, foul, turnover, penalty, goal, score, or substitution from the sporting event.

### Claim 5 (depends on 1)

The method of claim 1, wherein the event encoder does not include a temporal attention layer wherein the event encoder is a non-temporal encoder that processes input events without modeling temporal dependencies through attention mechanisms.

### Claim 6 (depends on 1)

The method of claim 1, wherein determining, by the multimodal model, a tensor further comprises:
adding a first set of sinusoidal positioning embeddings to the event data; and
processing the event data by applying a transformer encoder in the event encoder to produce event embeddings.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining, by the multimodal model, a tensor further comprises:
adding a second set of sinusoidal positioning embeddings to tokenized versions of the one or more vectors;
encoding the tokenized version of the one or more vectors by an attention based module in the tracking decoder;
applying cross attention of the event embeddings to the encoded tokenized versions of the one or more vectors;
applying a normalization layer to the encoded tokenized versions of the one or more vectors; and
applying a feedforward layer to the encoded tokenized versions of the one or more vectors.

### Claim 8 (depends on 1)

The method of claim 1, wherein the generating, by the diffusion model, one or more trajectories for the one or more players in the sporting event further comprises:
applying a linear layer to the perturbed tracking data;
applying sinusoidal positional encoding to the perturbed tracking data;
applying, by the diffusion model, spatiotemporal axial attention to the perturbed tracking data; and
applying cross-attention to the perturbed tracking data with the tensor.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more trajectories include a predicted sequence of movements for the one or more players for a next approximately sixty seconds of the sporting event.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
generating future trajectories of the one or more players by analyzing the one or more trajectories.

### Claim 11

A system for generating trajectories for one or more players during a sporting event, the system comprising:
a memory configured to store processor-readable instructions; and
a processor operatively connected to the memory, and configured to execute the instructions to perform operations comprising:
receiving, as an input, broadcast footage of a sporting event;
determining tracking data of one or more players in the sporting event from the broadcast footage, the tracking data including one or more vectors;
receiving event data of the sporting event;
inputting the one or more vectors and event data into a multimodal model, the multimodal model including:
an event encoder; and
an tracking decoder;
applying a linear layer of the multimodal model to the one or more vectors and event data to tokenize the event data and one or more vectors;
determining, by the multimodal model, a tensor, the tensor representing a representation of sequence of the event data and tracking data;
receiving perturbed tracking data of the sporting event;
inputting the perturbed tracking data and tensor into a diffusion model, wherein the diffusion model includes a decoder; and
generating, by the diffusion model, one or more trajectories for the one or more players in the sporting event.

### Claim 12 (depends on 11)

The system of claim 11, wherein one or more vectors includes at least one of an agent's two dimensional coordinates on a sporting event's field, an agent position, an agent team, an indicator indicating the agent is a ball, or player visibility information.

### Claim 13 (depends on 11)

The system of claim 11, wherein the event data was derived from the broadcast footage.

### Claim 14 (depends on 11)

The system of claim 11, wherein the event data includes a sequential stream of one or more major events throughout a sport event, the major events including at least one of a pass, shot, tackle, foul, turnover, penalty, goal, score, or substitution from the sporting event.

### Claim 15 (depends on 11)

The system of claim 11, wherein the event encoder does not include a temporal attention layer wherein the event encoder is a non-temporal encoder that processes input events without modeling temporal dependencies through attention mechanisms.

### Claim 16 (depends on 11)

The system of claim 11, wherein determining, by the multimodal model, a tensor further comprises:
adding a first set of sinusoidal positioning embeddings to the event data; and
processing the event data by applying a transformer encoder in the event encoder to produce event embeddings.

### Claim 17 (depends on 16)

The system of claim 16, wherein determining, by the multimodal model, a tensor further comprises:
adding a second set of sinusoidal positioning embeddings to tokenized versions of the one or more vectors;
encoding the tokenized version of the one or more vectors by an attention based module in the tracking decoder;
applying cross attention of the event embeddings to the encoded tokenized versions of the one or more vectors;
applying a normalization layer to the encoded tokenized versions of the one or more vectors; and
applying a feedforward layer to the encoded tokenized versions of the one or more vectors.

### Claim 18

A non-transitory computer readable medium configured to store processor-readable instructions, wherein when executed by a processor, the instructions perform operations comprising:
receiving, as an input, broadcast footage of a sporting event;
determining tracking data of one or more players in the sporting event from the broadcast footage, the tracking data including one or more vectors;
receiving event data of the sporting event;
inputting the one or more vectors and event data into a multimodal model, the multimodal model including:
an event encoder; and
an tracking decoder;
applying a linear layer of the multimodal model to the one or more vectors and event data to tokenize the event data and one or more vectors;
determining, by the multimodal model, a tensor, the tensor representing a representation of sequence of the event data and tracking data;
receiving perturbed tracking data of the sporting event;
inputting the perturbed tracking data and tensor into a diffusion model, wherein the diffusion model includes a decoder; and
generating, by the diffusion model, one or more trajectories for the one or more players in the sporting event.

### Claim 19 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein one or more vectors includes at least one of an agent two dimensional coordinates on a sporting event's field, an agent position, an agent team, an indicator indicating the agent is a ball, or player visibility information.

### Claim 20 (depends on 18)

The non-transitory computer readable medium of claim 18, wherein the event data was derived from the broadcast footage.
