# US 12,179,782 B2 · Package delivery guidance and assistance system using vehicle sensor data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,179,782 B2
- Document ID: US12179782B2
- Status: Granted
- Kind: B2
- Application number: 17/747,716
- Filed: 2022-05-18
- Published: 2024-03-21
- Granted: 2024-12-31
- Earliest claimed: 2022-05-18
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Ching Pin Chang; Cassandra Goodby; Francesco Sacchi; Morgan Rose Goldstein; Paul Barclay; Tirthankar Sengupta
- Web page: https://patentgrep.com/patent/US12179782B2

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06Q 10/083: Shipping
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/26: using acoustic output
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/90: Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
- G01C 21/3647: {Guidance involving output of stored or live camera images or video streams}
- G01C 21/365: {Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself}
- G01C 21/3697: {Output of additional, non-guidance related information, e.g. low fuel level (G01C21/3679 takes precedence)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/0833: Tracking
- H04W 4/021: Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
- H04W 4/48: for in-vehicle communication
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
- B60K 35/81: for controlling displays
- B60K 35/85: Arrangements for transferring vehicle- or driver-related data
- B60K 2360/11: Instrument graphical user interfaces or menu aspects
- B60K 2360/161: Explanation of functions, e.g. instructions
- B60K 2360/166: Navigation
- B60K 2360/184: Displaying the same information on different displays
- B60K 2360/1868: according to driving situations
- B60K 2360/1876: according to vehicle situations
- B60K 2360/577: Mirror link with mobile devices
- B60K 2360/589: Wireless data transfers
- B60W 2050/146: {Display means}
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- G06Q 10/0843: {using forecasting or optimisation}
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Systems, devices, and methods are provided for package delivery guidance and assistance. A vehicle may comprise one or more sensors. A processing unit of the vehicle may determine, based on vehicle data obtained from the one or more sensors, that the vehicle is in a first state, determine that the first state corresponds to a first sub-task of the plurality of sub-tasks, determine a first graphical interface for performance of the first sub-task, present the first graphical interface on a first display screen of the at vehicle, responsive to additional vehicle data obtained from the one or more sensors indicating that the vehicle is in a second state: determine that the second state corresponds to a second sub-task of the plurality of sub-tasks, and update the first display screen with a second graphical interface that is for performance of the second sub-task.

## Claims

### Claim 1

A method, comprising:
obtaining, at a mobile device, vehicle identification information for a delivery vehicle of a fleet of delivery vehicles, wherein the delivery vehicle comprises a plurality of sensors;
performing a handshake process between the mobile device and the delivery vehicle, wherein the handshake process comprises using the mobile device to scan a code that is unique to the delivery vehicle;
synchronizing delivery information from the mobile device with the delivery vehicle;
determining, from the delivery information, a delivery route comprising at least a first delivery;
determining, based on first vehicle sensor data obtained from the plurality of sensors, that the delivery vehicle is in a pre-driving state;
selecting, based on the determination of the pre-driving state, a first graphical user interface for presentation of the delivery route;
presenting, on at least one display of the delivery vehicle, the first graphical user interface on one or more screens of the delivery vehicle;
collecting second vehicle sensor data from the plurality of sensors;
determining, based on the second vehicle sensor data, that the delivery vehicle is in a driving state;
selecting, based on the determination of the driving state, a second graphical user interface for navigation of the delivery vehicle to a first geolocation for the first delivery;
replacing the first graphical user interface with the second graphical user interface;
collecting third vehicle sensor data from the plurality of sensors;
determining, based on the third vehicle sensor data, that the delivery vehicle is in an arriving state;
selecting, based on the determination of the arriving state, a third graphical user interface for facilitating the first delivery at the first geolocation;
replacing the second graphical user interface with the third graphical user interface;
collecting fourth vehicle sensor data from the plurality of sensors;
determining, based on the fourth vehicle sensor data, that the delivery vehicle is in a delivery state;
selecting, based on the determination of the delivery state, a fourth graphical user interface for identification of a first package to be delivered at the first geolocation; and
replacing the third graphical user interface with the fourth graphical user interface.

### Claim 2 (depends on 1)

The method of claim 1, wherein:
the first vehicle sensor data comprises first data indicating that the delivery vehicle is shifted in a park position;
the second vehicle sensor data comprises second data indicating that the delivery vehicle is shifted in a drive position;
the third vehicle sensor data comprises third data, obtained from a global positioning system (GPS) of the delivery vehicle, indicating that the delivery vehicle is within a first geofence associated with the first geolocation; and
the fourth vehicle sensor data comprises fourth data indicating that the delivery vehicle is shifted in the park position and within the first geofence.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
collecting fifth vehicle sensor data from the plurality of sensors indicating that the first package is being delivered; and
de-activating the at least one display in response to a timeout.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
synchronizing second delivery information from the mobile device with the delivery vehicle, the second delivery information associated with a first delivery status of the first package;
updating the delivery route based on the second delivery information;
collecting sixth vehicle sensor data from the plurality of sensors indicating that the delivery vehicle is in a pre-driving state; and
in response to the sixth vehicle sensor data, re-activating the at least one display with the first graphical user interface.

### Claim 5

A vehicle, comprising:
one or more processors; and
memory storing executable instructions that, when executed by the one or more processors, cause the one or more processors to:
determine a plurality of sub-tasks for a delivery;
determine, based on first vehicle data obtained from one or more sensors associated with the vehicle, that the vehicle is in a first state;
determine that the first state corresponds to a first sub-task of the plurality of sub-tasks;
determine a first graphical interface for performance of the first sub-task;
present the first graphical interface on a first display screen of the vehicle;
responsive to second vehicle data obtained from the one or more sensors indicating that the vehicle is in a second state:
determine that the second state corresponds to a second sub-task of the plurality of sub-tasks; and
update the first display screen with a second graphical interface that is for performance of the second sub-task; and
responsive to third vehicle data obtained from the one or more sensors indicating that the vehicle is in a third state:
determine that the third state corresponds to a third sub-task of the plurality of sub-tasks; and
update the first display screen with a third graphical interface that is for performance of the third sub-task,
wherein the first state, second state and third state are respectively one of a pre-driving state, arrival state, delivery planning state, or delivery state.

### Claim 6 (depends on 5)

The vehicle of claim 5, wherein the first graphical interface is presented across two or more display screens.

### Claim 7 (depends on 6)

The vehicle of claim 6, wherein:
a first portion of the first graphical interface with navigation-related information is presented on the first display screen located on an instrument cluster of the vehicle; and
a second portion of the first graphical interface with delivery-related information is presented on a second display screen located on an information display of the vehicle.

### Claim 8 (depends on 6)

The vehicle of claim 6, wherein at least one of the two or more display screens is a transparent heads-up display (HUD).

### Claim 9 (depends on 5)

The vehicle of claim 5, wherein the executable instructions, when executed by the one or more processors, cause the one or more processors to:
present a quick response (QR) code that encodes vehicle identification information; and
establish, based on the QR code, a wireless connection with a mobile device; and
receive route information for the delivery from the mobile device.

### Claim 10 (depends on 5)

The vehicle of claim 5, wherein the executable instructions, when executed by the one or more processors, cause the one or more processors to:
receive data indicative of third-party delivery information associated with the delivery; and
present the third-party delivery information in a widget of the first graphical interface.

### Claim 11 (depends on 5)

The vehicle of claim 5, wherein the executable instructions, when executed by the one or more processors, cause the one or more processors to:
detect that the vehicle is approaching a destination for the delivery; and
present delivery information on the first display screen.

### Claim 12 (depends on 11)

The vehicle of claim 11, wherein the delivery information comprises at least one of graphical information depicting a drop-off location for the delivery or text-based delivery instructions.

### Claim 13

A non-transitory computer-readable storage medium storing executable instructions that, as a result of being executed by one or more processors of a system, cause the system to at least:
determine a plurality of sub-tasks for a delivery;
determine, based on vehicle data obtained from one or more sensors of a vehicle, that the vehicle is in a first state;
determine that the first state corresponds to a first sub-task of the plurality of sub-tasks;
determine a first graphical interface for performance of the first sub-task;
present the first graphical interface on a first display screen of the vehicle;
responsive to additional vehicle data obtained from the one or more sensors indicating that the vehicle is in a second state:
determine that the second state corresponds to a second sub-task of the plurality of sub-tasks; and
update the first display screen with a second graphical interface that is for performance of the second sub-task; and
responsive to third vehicle data obtained from the one or more sensors indicating that the vehicle is in a third state:
determine that the third state corresponds to a third sub-task of the plurality of sub-tasks; and
update the first display screen with a third graphical interface that is for performance of the third sub-task,
wherein the first state, second state and third state are respectively one of a pre-driving state, an arrival state, a delivery planning state, or a delivery state.

### Claim 14 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the first graphical interface is presented across two or more display screens of the vehicle.

### Claim 15 (depends on 14)

The non-transitory computer-readable storage medium of claim 14, wherein:
a first portion of the first graphical interface with navigation-related information is presented on the first display screen located on an instrument cluster of the vehicle; and
a second portion of the first graphical interface with delivery-related information is presented on a second display screen located on an information display of the vehicle.

### Claim 16 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the first graphical interface has a first content density that is greater than a second content density of the second graphical interface.

### Claim 17 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions, as a result of being executed by the one or more processors of the system, further cause the system to:
present a quick response (QR) code that encodes vehicle identification information; and
establish, based on the QR code, a wireless connection with a mobile device; and
receive route information for the delivery from the mobile device.

### Claim 18 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions, as a result of being executed by the one or more processors of the system, further cause the system to:
receive third-party delivery information associated with the delivery; and
present the third-party delivery information in a widget of the first graphical interface.

### Claim 19 (depends on 13)

The non-transitory computer-readable storage medium of claim 13, wherein the instructions, as a result of being executed by the one or more processors of the system, further cause the system to:
detect that the vehicle is approaching a destination for the delivery; and
present delivery information on the first display screen.

### Claim 20 (depends on 19)

The non-transitory computer-readable storage medium of claim 19, wherein the delivery information comprises at least one of graphical information depicting a drop-off location for the delivery or text-based delivery instructions.