# US 2023/0267353 A1 · Computer-Implemented Method and System for Predicting Future Developments of a Traffic Scene

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0267353 A1
- Document ID: US20230267353A1
- Status: Published application
- Kind: A1
- Application number: 18/171,080
- Filed: 2023-02-17
- Published: 2023-08-24
- Earliest claimed: 2022-02-21
- Assignees: Robert Bosch GmbH
- Applicants: Robert Bosch GmbH
- Inventors: Faris Janjos; Maxim Dolgov
- Web page: https://patentgrep.com/patent/US20230267353A1

## CPC

- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 3/0455: Auto-encoder networks; Encoder-decoder networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06Q 50/40: Business processes related to the transportation industry (shipping G06Q10/083)
- G06N 3/08: Learning methods
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR

## Abstract

A computer-implemented method for predicting future developments of a traffic scene includes aggregating scene-specific information about a traffic scene, and using a pre-trained encoder network to transform the aggregated scene-specific information into parameters of a multivariate probability distribution of latent features. The method further includes selecting samples of the multivariate probability distribution of latent features determined by the parameters, and using a pre-trained decoder network to transform each of the selected samples into an output set. The samples are selected deterministically, such that each selected sample represents a separate region of the multivariate probability distribution of the latent features, and the multivariate probability distribution of latent features is sampled in a raster-like manner via the totality of the selected samples.

## Claims

### Claim 1

A computer-implemented method for predicting future developments of a traffic scene, comprising:
aggregating scene-specific information about a traffic scene;
using a pre-trained encoder network to transform the aggregated scene-specific information into parameters of a multivariate probability distribution of latent features;
selecting samples of the multivariate probability distribution of latent features determined by the parameters; and
using a pre-trained decoder network to transform each of the selected samples into an output set of a plurality of output sets,
wherein the samples are selected deterministically, such that each selected sample represents a separate region of the multivariate probability distribution of the latent features, and
wherein the multivariate probability distribution of the latent features is sampled in a raster-like manner via a totality of the selected samples to form a raster.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising:
adapting the raster formed by the selected samples to the multivariate probability distribution of the latent features using raster distances between the selected samples being selected based on a weight of individual selected samples in the multivariate probability distribution of the latent features.

### Claim 3 (depends on 2)

The method according to claim 2, wherein:
at least a portion of the selected samples include noise, and
the raster distances between the selected samples is maintained.

### Claim 4 (depends on 1)

The method according to claim 1, wherein a predetermined number of the samples are selected.

### Claim 5 (depends on 1)

The method according to claim 1, wherein a determination of a number of the samples to be selected and/or the selection of the samples is based on:
a time available for generating the plurality of output sets;
a comparison of a totality of the generated plurality of output sets to a probability distribution of the plurality of output sets;
a similarity of the selected samples to training data of the pre-trained encoder network and the pre-trained decoder network; and/or
if the totality of the generated plurality of output set provides a plurality of different, predetermined results.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the scene-specific information is transformed into an expected value vector and a covariance matrix of a multivariate normal distribution of the latent features.

### Claim 7 (depends on 1)

The method according to claim 1, wherein at least one of the following methods is used for selecting the samples:
unscented Kalman filter sampling;
Gauss-Hermite quadrature Kalman filter sampling;
cubature Kalman filter sampling;
randomized unscented Kalman filter sampling; and
asymmetric or symmetric localized cumulative distribution sampling.

### Claim 8 (depends on 1)

The method according to claim 1, further comprising:
generating a possible future trajectory for at least one participant in the traffic scene as one of the output sets of the generated plurality of output sets, and
identifying different modes for a future development of the traffic scene based on a totality of the generated plurality of output sets.

### Claim 9 (depends on 8)

The method according to claim 8, further comprising:
generating probabilities for a prespecified number of the different modes for the future developments of the traffic scene as one of the output sets of the generated plurality of output sets,
wherein the totality of the generated plurality of output sets is taken as a basis for a further prediction step and/or planning step.

### Claim 10

A computer-implemented system for predicting future developments of a traffic scene comprising:
a perception plane configured to aggregate scene-specific information about a traffic scene;
a pre-trained encoder network configured to transform the aggregated scene-specific information into parameters of a multivariate probability distribution of latent features;
a sampler configured to select individual samples of the multivariate probability distribution of latent features determined by the parameters; and
a pre-trained decoder network configured to transform each of the selected samples into an output set,
wherein the sampler is configured to select the samples deterministically, such that each selected sample represents a separate region of the multivariate probability distribution of the latent features, and
wherein the multivariate probability distribution of latent features is sampled in a raster-like manner via a totality of the selected samples.

### Claim 11 (depends on 10)

The system according to claim 10, wherein the encoder network and the decoder network are components of a variational autoencoder architecture or a conditional variational autoencoder architecture.
