# US 2021/0276488 A1 · Method and system for augmented alerting based on driver's state in hybrid driving

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276488 A1
- Document ID: US20210276488A1
- Status: Published application
- Kind: A1
- Application number: 17/329,308
- Filed: 2021-05-25
- Published: 2021-09-09
- Earliest claimed: 2017-12-19
- Assignees: PlusAI, Inc.
- Applicants: PlusAI Limited
- Inventors: Hao ZHENG; Timothy Patrick DALY, JR.; David Wanqian LIU
- Web page: https://patentgrep.com/patent/US20210276488A1

## CPC

- B60Q 9/00: Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 50/00: Details of control systems for road vehicle drive control not related to the control of a particular sub-unit {, e.g. process diagnostic or vehicle driver interfaces}
- B60W 50/082: {Selecting or switching between different modes of propelling}
- B60W 60/0057: {Estimation of the time available or required for the handover}
- B60W 60/0059: {Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity}
- B60W 2040/0872: {Driver physiology}
- B60W 2050/143: {Alarm means}
- B60W 2540/045: Occupant permissions
- B60W 2540/221: Physiology, e.g. weight, heartbeat, health or special needs
- B60W 2540/223: Posture, e.g. hand, foot, or seat position, turned or inclined
- B60W 2540/225: Direction of gaze
- B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT

## Abstract

The present teaching relates to method, system, and medium, for generating an augmented alert in a hybrid vehicle. First information indicating an upcoming switch in an operating mode of the vehicle is received, which specifies a set of tasks, arranged in an order, to be completed by a driver in the vehicle to achieve the upcoming switch, and a task duration for each of the set of tasks by which the task is to be completed. A current state of the driver is obtained and used to determine a set of warnings to alert the driver to perform the set of tasks. Each warning corresponds to a task in the set of tasks and is created based on the current state of the driver. A warning schedule is generated based on the set of warnings in the order of the set of tasks and transmitted so that warnings in the warning schedule are delivered to the driver.

## Claims

### Claim 1

A method, implemented on a machine having at least one processor, storage, and a communication platform for generating augmented alert in a hybrid vehicle, the method comprising:
obtaining first information indicating an upcoming switch in an operating mode of the hybrid vehicle, the first information specifying a set of tasks, arranged in an order, to be completed by a driver in the hybrid vehicle to achieve the upcoming switch and a task duration associated with each of the set of tasks by which the task is to be completed;
obtaining second information on a current state of the driver;
determining a set of warnings to alert the driver to perform the set of tasks, wherein each of the set of warnings is directed to a corresponding task in the set of tasks and is created based on the second information on the current state of the driver and information related to the vehicle and information related to a surrounding of the vehicle;
generating a warning schedule based on the set of warnings and in the order of the set of tasks; and
transmitting the warning schedule so that each warning of the set of warnings in the warning schedule is to be delivered to the driver.

### Claim 2 (depends on 1)

The method of claim 1, wherein the warning for the corresponding task of the set of tasks comprises warning content, at least one media used to deliver the warning content, and a manner by which the warning content is to be delivered to the driver.

### Claim 3 (depends on 2)

The method of claim 2, wherein the warning content is further determined based on a nature of the corresponding task to be performed by the driver.

### Claim 4 (depends on 2)

The method of claim 2, wherein the at least one media used to deliver the warning is determined further based on a driver profile of the driver, wherein the driver profile characterizes relevant features of the driver; and the manner includes a warning intensity used to deliver the warning content in each of the at least one media, the warning intensity being determined based on the current state of the driver and the driver profile.

### Claim 5 (depends on 1)

The method of claim 1, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

### Claim 6 (depends on 1)

The method of claim 1, wherein the instruction specifies an order of executing the set of tasks, the order being determined based on a priority score assigned the task.

### Claim 7 (depends on 1)

The method of claim 1, wherein the information related to the vehicle and information related to a surrounding of the vehicle includes at least one of: a position of the vehicle, a model of the vehicle, service information of the vehicle, and a configuration of the vehicle.

### Claim 8

A non-transitory computer readable medium having information stored thereon for generating augmented alert in a hybrid vehicle, wherein the information, when read by the machine, causes the machine to perform the following:
obtaining first information indicating an upcoming switch in an operating mode of the hybrid vehicle, the first information specifying a set of tasks, arranged in an order, to be completed by a driver in the hybrid vehicle to achieve the upcoming switch and a task duration associated with each of the set of tasks by which the task is to be completed;
obtaining second information on a current state of the driver;
determining a set of warnings to alert the driver to perform the set of tasks, wherein each of the set of warnings is directed to a corresponding task in the set of tasks and is created based on the second information on the current state of the driver and information related to the vehicle and information related to a surrounding of the vehicle;
generating a warning schedule based on the set of warnings and in the order of the set of tasks; and
transmitting the warning schedule so that each warning of the set of warnings in the warning schedule is to be delivered to the driver.

### Claim 9 (depends on 8)

The medium of claim 8, wherein the warning for the corresponding task of the set of tasks comprises warning content, at least one media used to deliver the warning content, and a manner by which the warning content is to be delivered to the driver.

### Claim 10 (depends on 9)

The medium of claim 9, wherein the warning content is further determined based on a nature of the corresponding task to be performed by the driver.

### Claim 11 (depends on 9)

The medium of claim 9, wherein the at least one media used to deliver the warning is determined further based on a driver profile of the driver, wherein the driver profile characterizes relevant features of the driver; and the manner includes a warning intensity used to deliver the warning content in each of the at least one media, the warning intensity being determined based on the current state of the driver and the driver profile.

### Claim 12 (depends on 8)

The medium of claim 8, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

### Claim 13 (depends on 8)

The method of claim 8, wherein the instruction specifies an order of executing the set of tasks, the order being determined based on a priority score assigned the task.

### Claim 14 (depends on 8)

The method of claim 8, wherein the information related to the vehicle and information related to a surrounding of the vehicle includes at least one of: a position of the vehicle, a model of the vehicle, service information of the vehicle, and a configuration of the vehicle.

### Claim 15

A system for generating augmented alert in a hybrid vehicle, the system comprising:
a warning instruction analyzer configured for obtaining first information indicating an upcoming switch in an operating mode of the hybrid vehicle, the first information specifying a set of tasks, arranged in an order, to be completed by a driver in the hybrid vehicle to achieve the upcoming switch and a task duration associated with each of the set of tasks by which the task is to be completed;
a switch risk determiner configured for:
obtaining second information on a current state of the driver;
determining a set of warnings to alert the driver to perform the set of tasks, wherein each of the set of warnings is directed to a corresponding task in the set of tasks and is created based on the second information on the current state of the driver and information related to the vehicle and information related to a surrounding of the vehicle;
a multi-modal warning instruction generator configured for:
generating a warning schedule based on the set of warnings and in the order of the set of tasks; and
transmitting the warning schedule so that each warning of the set of warnings in the warning schedule is to be delivered to the driver.

### Claim 16 (depends on 15)

The system of claim 15, wherein the warning for the corresponding task of the set of tasks comprises warning content, at least one media used to deliver the warning content, and a manner by which the warning content is to be delivered to the driver.

### Claim 17 (depends on 16)

The method of claim 16, wherein the warning content is further determined based on a nature of the corresponding task to be performed by the driver.

### Claim 18 (depends on 16)

The method of claim 16, wherein the at least one media used to deliver the warning is determined further based on a driver profile of the driver, wherein the driver profile characterizes relevant features of the driver; and the manner includes a warning intensity used to deliver the warning content in each of the at least one media, the warning intensity being determined based on the current state of the driver and the driver profile.

### Claim 19 (depends on 15)

The method of claim 15, wherein the warning further includes a starting time and a duration, the duration of the warning being less than the task duration and being determined based on the current state of the driver.

### Claim 20 (depends on 15)

The method of claim 15, wherein the instruction specifies an order of executing the set of tasks, the order being determined based on a priority score assigned the task.
