# US 2025/0319898 A1 · Action contamination attack system for autonomous driving model and action contamination attack method of the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0319898 A1
- Document ID: US20250319898A1
- Status: Published application
- Kind: A1
- Application number: 19/250,845
- Filed: 2025-06-26
- Published: 2025-10-16
- Earliest claimed: 2023-11-14
- Assignees: Foundation of Soongsil University-Industry Cooperation
- Applicants: Foundation of Soongsil University-Industry Cooperation
- Inventors: Daeseon CHOI; Yoonsoo AN
- Web page: https://patentgrep.com/patent/US20250319898A1

## CPC

- B60W 60/0011: {involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles}
- G06N 20/00: Machine learning
- B60W 40/04: Traffic conditions
- B60W 50/06: Improving the dynamic response of the control system, e.g. improving the speed of regulation or avoiding hunting or overshoot
- B60W 60/00188: {related to detected security violation of control systems, e.g. hacking of moving vehicle}
- G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO]
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/08: Learning methods
- G06N 3/092: Reinforcement learning
- G06N 5/043: Distributed expert systems; Blackboards
- B60W 60/00: Drive control systems specially adapted for autonomous road vehicles
- B60W 2520/00: Input parameters relating to overall vehicle dynamics
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

An action poisoning attack system for an autonomous driving model trained based on an action of each agent determining a movement of each of the agents driving virtually in a virtual space may include a target agent determination unit configured to determine a target agent that is an attack target intended to perform virtual driving by manipulated action information instead of action information output by the autonomous driving model among a plurality of the agents, based on position information of the agents in the virtual space, and a target action determination unit configured to interfere with training of the autonomous driving model by generating target action information by manipulating the action information output by the autonomous driving model for the target agent and causing the target agent to perform a target action that is an action by the target action information.

## Claims

### Claim 1

An action poisoning attack system for an autonomous driving model trained based on an action of each agent determining a movement of each of the agents driving virtually in a virtual space, the action poisoning attack system comprising:
a target agent determination unit configured to determine a target agent that is an attack target intended to perform virtual driving by manipulated action information instead of action information output by the autonomous driving model among a plurality of agents, based on position information of the agents in the virtual space; and
a target action determination unit configured to interfere with training of the autonomous driving model by generating target action information by manipulating the action information output by the autonomous driving model for the target agent and causing the target agent to perform a target action that is an action by the target action information,
wherein the autonomous driving model is
a machine learning model trained through a machine learning method based on the actions of the agents while determining the action information of each agent based on positions and actions of the other agents in the virtual space.

### Claim 2 (depends on 1)

The action poisoning attack system of claim 1,
wherein the autonomous driving model is
configured to generate an action vector including a steering component related to steering of each of the agents and an acceleration component related to acceleration/deceleration of each of the agents as the action information for each of the agents, and
the target action determination unit is
configured to generate a target action vector including a manipulation steering component and a manipulation acceleration component by changing at least one of the steering component and the acceleration component of the action vector output by the autonomous driving model.

### Claim 3 (depends on 2)

The action poisoning attack system of claim 2,
wherein the target action determination unit is configured to:
generate the target action vector including the manipulation steering component with an intention of driving virtually in a direction completely opposite to a direction in which the target agent has steered based on an action by the action vector output by the autonomous driving model; and
generate the target action vector including the manipulation acceleration component with an intention of driving virtually in the direction completely opposite to the direction at speed at which the target agent has accelerated/decelerated based on the action by the action vector output by the autonomous driving model.

### Claim 4 (depends on 2)

The action poisoning attack system of claim 2,
wherein the target agent determination unit is configured to:
determine a number of proximity agents that are other agents positioned within a preset reference distance for each of the agents based on each of the agents; and
determine an agent of which the number of the proximity agents is greater than or equal to a preset number as the target agent among the plurality of agents.

### Claim 5 (depends on 4)

The action poisoning attack system of claim 4,
wherein the target action determination unit is configured to:
determine an average value of the steering components of the action vector output by the autonomous driving model for the proximity agents as an average steering component;
determine an average value of the acceleration components of the action vector output by the autonomous driving model for the proximity agents as an average acceleration component;
generate the target action vector including the manipulation steering component with an intention of driving virtually in a direction completely opposite to a direction in which the target agent has steered based on an action of the action vector including the average steering component; and
generate the target action vector including the manipulation acceleration component with an intention of driving virtually in the direction completely opposite to the direction at speed at which the target agent has accelerated/decelerated based on an action of the action vector including the average acceleration component.

### Claim 6 (depends on 4)

The action poisoning attack system of claim 4,
wherein the target action determination unit is configured to:
determine a weighted average value of speeds of the proximity agents driving virtually based on the action by the action vector output by the autonomous driving model as a weighted average speed;
determine a similarity between a speed of the target agent driving virtually based on the action by the action vector output by the autonomous driving model and the weighted average speed; and
determine the manipulation acceleration component based on the similarity between the speed of the target agent and the weighted average speed.

### Claim 7 (depends on 6)

The action poisoning attack system of claim 6,
wherein the target action determination unit is configured to
determine the manipulation acceleration component with an intention of driving virtually while accelerating more significantly as the similarity between the speed of the target agent and the weighted average speed is lower.

### Claim 8 (depends on 7)

The action poisoning attack system of claim 7,
wherein the target action determination unit is configured to
determine the manipulation steering component with an intention of driving virtually while changing a direction of the virtual driving more significantly as the similarity between the speed of the target agent and the weighted average speed is higher.

### Claim 9 (depends on 4)

The action poisoning attack system of claim 4,
wherein the target action determination unit is configured to:
determine one real number randomly selected from preset real numbers as the manipulation steering component; and
determine one real number randomly selected from the preset real numbers as the manipulation steering component.

### Claim 10

As a method of operating an action poisoning attack system for an autonomous driving model trained based on an action of each agent determining a movement of each of the agents driving virtually in a virtual space, a method of controlling the action poisoning attack system comprising:
determining, by a target agent determination unit, a target agent that is an attack target intended to perform virtual driving by manipulated action information instead of action information output by the autonomous driving model among a plurality of agents, based on position information of the agents in the virtual space;
generating, by a target action determination unit, target action information by manipulating the action information output by the autonomous driving model for the target agent; and
interfering, by the target action determination unit, with training of the autonomous driving model by causing the target agent to perform a target action that is an action by the target action information,
wherein the autonomous driving model is a machine learning model configured to be trained through a machine learning method based on the actions of the agents while determining the action information of each agent based on positions and actions of the other agents in the virtual space, and
generate an action vector including a steering component related to steering of each of the agents and an acceleration component related to acceleration/deceleration of each of the agents as the action information for each of the agents,
the determining of the target agent includes:
determining a number of proximity agents that are other agents positioned within a preset reference distance for each of the agents based on each of the agents by the target agent determination unit; and
determining an agent of which the number of the proximity agents is greater than or equal to a preset number as the target agent among the plurality of the agents by the target agent determination unit, and
the generating of the target action information includes
generating a target action vector including a manipulation steering component and a manipulation acceleration component as target action information for the target agent by changing at least one of the steering component and the acceleration component of the action vector output by the autonomous driving model by the target action determination unit.

### Claim 11 (depends on 10)

A non-transitory recording medium in which a computer-readable computer program is stored to execute the method of controlling the action poisoning attack system of claim 10.
