# US 2026/0073281 A1 · Method And System For Generating Pedestrian-Vehicle Interaction Data For Training An Autonomous Vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0073281 A1
- Document ID: US20260073281A1
- Status: Published application
- Kind: A1
- Application number: 18/829,746
- Filed: 2024-09-10
- Published: 2026-03-12
- Earliest claimed: 2024-09-10
- Assignees: DENSO International America, Inc.; Carnegie Mellon University
- Applicants: DENSO International America, Inc.; Carnegie Mellon University
- Inventors: Shawn HUNT; Rohan CHOUDHURY; Kris KITANI; Kenta Mukoya; Erica Weng
- Web page: https://patentgrep.com/patent/US20260073281A1

## CPC

- G06N 20/00: Machine learning
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

A method and system for generating virtual pedestrian-vehicle interaction data includes generating a virtual reality environment in virtual reality device, generating a scenario in the virtual reality environment, the scenario comprising virtual vehicle movements, displaying the scenario in a virtual reality device, storing virtual reality movements relative to the scenario, the virtual reality movements comprising at least a yaw movement, communicating the virtual vehicle movements to a simulator controller, communicating the virtual vehicle movements to the simulator controller, associating the virtual reality movements, the virtual vehicle movements and the scenario to form pedestrian-vehicle data, and training an autonomous vehicle system using the pedestrian-vehicle data.

## Claims

### Claim 1

A method comprising:
generating a virtual reality environment in virtual reality device;
generating a scenario in the virtual reality environment, the scenario comprising virtual vehicle movements;
displaying the scenario in a virtual reality device;
storing virtual reality movements relative to the scenario, the virtual reality movements comprising at least a yaw movement;
communicating the virtual vehicle movements to a simulator controller;
communicating the virtual vehicle movements to the simulator controller;
associating the virtual reality movements, the virtual vehicle movements and the scenario to form pedestrian-vehicle data; and
training an autonomous vehicle system using the pedestrian-vehicle data.

### Claim 2 (depends on 1)

The method of claim 1 wherein the virtual reality movements comprise a pedestrian movement based on virtual reality device movements.

### Claim 3 (depends on 1)

The method of claim 1 wherein the virtual reality movements comprise virtual reality movements within a data collection environment.

### Claim 4 (depends on 1)

The method of claim 1 wherein the virtual reality movements comprise virtual reality movement relative to a data collection environment.

### Claim 5 (depends on 1)

The method of claim 1 wherein the virtual reality movements comprise position, rotation and velocity.

### Claim 6 (depends on 1)

The method of claim 1 wherein position is determined from a plurality of base stations in a data collection environment.

### Claim 7 (depends on 1)

The method of claim 1 wherein the virtual reality movements comprise position, rotation, velocity and acceleration.

### Claim 8 (depends on 1)

The method of claim 1 wherein the virtual vehicle movements comprise position, rotation and velocity and object shape data.

### Claim 9 (depends on 8)

The method of claim 8 wherein the object shape data comprises length, width and height.

### Claim 10 (depends on 1)

The method of claim 1 wherein the virtual vehicle movements comprise position, rotation, velocity, three-dimensional rotation, location and rotation angle.

### Claim 11 (depends on 1)

The method of claim 1 wherein prior to communicating the virtual vehicle movement, controlling virtual vehicle movements with an artificial intelligence operator.

### Claim 12 (depends on 1)

The method of claim 1 wherein prior to communicating the virtual vehicle movement, controlling virtual vehicle movements based on signals from a steering wheel user interface.

### Claim 13

A system comprising:
a virtual reality device programmed to display a virtual reality environment and a scenario in the virtual reality environment, the scenario comprising virtual vehicle movements, the virtual reality device sensing movements and communicating virtual reality movements;
a simulator controller receiving the virtual reality movements and storing virtual reality movements relative to the scenario, said virtual reality movements comprising at least a yaw movement, the simulator controller receiving the virtual vehicle movements, associating the virtual reality movements, the virtual vehicle movements and the scenario to form pedestrian-vehicle data; and
an autonomous vehicle training system training an autonomous vehicle system using the pedestrian-vehicle data.

### Claim 14 (depends on 13)

The system of claim 13 wherein the virtual reality movements comprise a pedestrian movement based on the virtual reality device movements.

### Claim 15 (depends on 13)

The system of claim 13 wherein the virtual reality movements comprise virtual reality movements within a data collection environment.

### Claim 16 (depends on 13)

The system of claim 13 wherein the virtual reality movements comprise position, rotation and velocity.

### Claim 17 (depends on 13)

The system of claim 13 wherein the virtual reality movements comprise position, rotation, velocity and acceleration.

### Claim 18 (depends on 13)

The system of claim 13 wherein the virtual vehicle movements comprise position, rotation and velocity and object shape data.

### Claim 19 (depends on 13)

The system of claim 13 wherein the virtual vehicle movements comprise position, rotation, velocity, three-dimensional rotation, location and rotation angle.

### Claim 20 (depends on 13)

The system of claim 13 further comprising an artificial intelligence operator controlling the virtual vehicle movements.
