# US 2021/0233406 A1 · Pedestrian navigation based on vehicular collaborative computing

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0233406 A1
- Document ID: US20210233406A1
- Status: Published application
- Kind: A1
- Application number: 16/776,443
- Filed: 2020-01-29
- Published: 2021-07-29
- Earliest claimed: 2020-01-29
- Assignees: Toyota Motor Engineering & Manufacturing North America, Inc.
- Applicants: Toyota Motor Engineering & Manufacturing North America, Inc.
- Inventors: Hongsheng Lu; Rui Guo
- Web page: https://patentgrep.com/patent/US20210233406A1

## CPC

- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G05D 1/0214: {in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13)}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G08G 1/005: including pedestrian guidance indicator
- G08G 1/0112: {from the vehicle, e.g. floating car data [FCD]}
- G08G 1/161: {Decentralised systems, e.g. inter-vehicle communication}
- G08G 1/22: {Platooning, i.e. convoy of communicating vehicles}
- B60W 2050/0064: {using a remote, e.g. cordless, transmitter or receiver unit, e.g. remote keypad or mobile phone}
- B60W 2050/143: {Alarm means}
- B60W 2554/4029: Pedestrians
- B60W 2556/65: Data transmitted between vehicles
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The disclosure includes embodiments for pedestrian navigation by a group of connected vehicles executing a collaborative computing process. In some embodiments, a method includes analyzing pedestrian data generated by a pedestrian device and sensor data generated by the group of connected vehicles to determine digital twin data from a set that correlates with a scenario described by the pedestrian data and the sensor data. The digital twin data is an output of a historical digital twin simulation. The method includes predicting, based on the digital twin data, that the pedestrian is at risk of a collision. The method includes determining modified path data describing a modified walking path for the pedestrian. The method includes transmitting the modified path data to the pedestrian device so that the pedestrian is informed about the modified walking path and the risk is modified.

## Claims

### Claim 1

A method for collaborative computing executed by a set of onboard computers for a group of connected vehicles, the method comprising:
analyzing, by the set of onboard computers, pedestrian data generated by a pedestrian device and sensor data generated by the group of connected vehicles to determine digital twin data from a set that correlates with a scenario described by the pedestrian data and the sensor data, wherein the digital twin data is an output of a historical digital twin simulation;
predicting, based on the digital twin data, that the pedestrian is at risk of a collision;
determining modified path data describing a modified walking path for the pedestrian; and
transmitting the modified path data to the pedestrian device so that the pedestrian is informed about the modified walking path and the risk is modified.

### Claim 2 (depends on 1)

The method of claim 1 further comprising an assigning step including assigning different tasks included in the method to different members of the group of connected vehicles.

### Claim 3 (depends on 2)

The method of claim 2, wherein the assigning step is executed by a hub vehicle of a vehicular micro cloud.

### Claim 4 (depends on 2)

The method of claim 2, wherein the assigning is based on technological abilities of a set of technological equipment included in the connected vehicles.

### Claim 5 (depends on 2)

The method of claim 2, wherein the assigning is based on a future driving path of the connected vehicles and how long each task takes to complete.

### Claim 6 (depends on 1)

The method of claim 1, wherein the modified path data is determined by analysis of the digital twin data.

### Claim 7 (depends on 1)

The method of claim 1 further comprising a feedback loop that includes determining whether a risk of collision was reduced by the modified walking path and updating the digital twin data based on whether the determination of whether a risk of collision was reduced.

### Claim 8 (depends on 1)

The method of claim 1, wherein the group of connected vehicles is not a vehicular micro cloud.

### Claim 9

A computer program product included in a set of onboard vehicle computers included in a group of connected vehicles, the computer program product comprising computer code that is operable, when executed by the set of onboard vehicle computers, to cause the set of onboard vehicle computers to provide collaborative computing by executing steps including:
analyzing, by the set of onboard computers, pedestrian data generated by a head-mounted pedestrian device and sensor data generated by the group of connected vehicles to determine digital twin data from a set that correlates with a scenario described by the pedestrian data and the sensor data, wherein the digital twin data is an output of a historical digital twin simulation;
predicting, based on the digital twin data, that the pedestrian is at risk of a collision;
determining modified path data describing a modified walking path for the pedestrian; and
transmitting the modified path data to the pedestrian device so that the pedestrian is informed about the modified walking path and the risk is reduced.

### Claim 10 (depends on 9)

The computer program product of claim 9 further comprising an assigning step including assigning different steps to different members of the group of connected vehicles.

### Claim 11 (depends on 10)

The computer program product of claim 10, wherein the assigning step is executed by a hub vehicle of a vehicular micro cloud.

### Claim 12 (depends on 10)

The computer program product of claim 10, wherein the assigning is based on technological abilities of a set of technological equipment included in the connected vehicles.

### Claim 13 (depends on 10)

The computer program product of claim 10, wherein the assigning is based on a future driving path of the connected vehicles and how long each task takes to complete.

### Claim 14

A system comprising:
a group of connected vehicles each including a communication unit that is communicatively coupled to an onboard vehicle computer so that the group includes a set of onboard vehicle computers, wherein the set of onboard vehicle computers are executing computer-executable code that is operable, when executed by the set of onboard vehicle computers, to cause the set of onboard vehicle computers to provide collaborative computing by executing tasks including:
analyzing, by the set of onboard computers, pedestrian data generated by a pedestrian device and sensor data generated by the group of connected vehicles to determine digital twin data from a set that correlates with a scenario described by the pedestrian data and the sensor data, wherein the digital twin data is an output of a historical digital twin simulation;
predicting, based on the digital twin data, that the pedestrian is at risk of a collision;
determining modified path data describing a modified walking path for the pedestrian; and
transmitting the modified path data to the pedestrian device so that the pedestrian is informed about the modified walking path and the risk is modified.

### Claim 15 (depends on 14)

The system of claim 14, wherein an onboard vehicle computer of a hub vehicle included in the group of connected vehicles is further operable to execute an assigning operation that includes assigning different tasks to different members of the group of connected vehicles so that the different tasks are executed by the onboard vehicle computer of the member to which it is assigned.

### Claim 16 (depends on 15)

The system of claim 15, wherein the assigning is based on technological abilities of a set of technological equipment included in each of the group of connected vehicles so that more difficult tasks are assigned to connected vehicles having the more technological abilities and less difficult tasks are assigned to connected vehicles having less technological abilities.

### Claim 17 (depends on 15)

The system of claim 15, wherein the assigning is based on a future driving path of the connected vehicles and how long each task takes to complete.

### Claim 18 (depends on 14)

The system of claim 14, wherein the modified path data is determined by analysis of the digital twin data.

### Claim 19 (depends on 14)

The system of claim 14 wherein the tasks further comprise executing a feedback loop that includes determining whether a risk of collision was reduced by the modified walking path.

### Claim 20 (depends on 19)

The system of claim 19, wherein the feedback loop further includes updating the digital twin data based on whether the determination of whether the risk of collision was reduced.
