# US 2024/0199034 A1 · Apparatuses, Systems and Methods for Determining Distracted Drivers Associated With Vehicle Driving Routes

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0199034 A1
- Document ID: US20240199034A1
- Status: Published application
- Kind: A1
- Application number: 18/405,015
- Filed: 2024-01-05
- Published: 2024-06-20
- Earliest claimed: 2017-01-19
- Assignees: State Farm Mutual Automobile Insurance Company
- Applicants: State Farm Mutual Automobile Insurance Company
- Inventors: Aaron Scott Chan; Kenneth J. Sanchez
- Web page: https://patentgrep.com/patent/US20240199034A1

## CPC

- B60W 40/09: Driving style or behaviour
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06V 10/34: Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60R 2300/302: combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
- B60W 2040/0872: {Driver physiology}
- B60W 2540/229: Attention level, e.g. attentive to driving, reading or sleeping
- B60W 2540/30: Driving style
- B60W 2556/45: External transmission of data to or from the vehicle
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)}
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE

## Abstract

Apparatuses, systems and methods are provided for determining vehicle driver distractions. More particularly, apparatuses, systems and methods are provided for receiving vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of at least one distraction of at least one vehicle occupant that is associated with a position of a body of the at least one vehicle occupant; generating vehicle driving route distraction data based on the vehicle interior data; and providing instructions to the at least one vehicle occupant to return to a normal driving position.

## Claims

### Claim 1

A computing device for determining distracted drivers associated with vehicle driving routes, the device comprising:
a vehicle interior data receiving module stored on a memory that, when executed by one or more processors, causes the one or more processors to receive vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of at least one distraction of at least one vehicle occupant that is associated with a position of a body of the at least one vehicle occupant;
a vehicle driving route distraction data generation module stored on the memory that, when executed by the one or more processors, causes the one or more processors to generate vehicle driving route distraction data based on the vehicle interior data; and
a driver instruction module stored on the memory that, when executed by the one or more processors, causes the one or more processors to provide instructions to the at least one vehicle occupant to return to a normal driving position.

### Claim 2 (depends on 1)

The computing device of claim 1, wherein the position of the body of the at least one vehicle occupant includes at least one of: (i) a body posture of at least one vehicle occupant, (ii) a facial expression of at least one vehicle occupant, or (iii) a position of a body part of at least one vehicle occupant.

### Claim 3 (depends on 1)

The computing device of claim 1, wherein at least one vehicle interior sensor is selected from: at least one digital image sensor, at least one ultra-sonic sensor, at least one radar-sensor, at least one infrared light sensor, or at least one laser light sensor.

### Claim 4 (depends on 1)

The computing device of claim 1, further comprising a position logging module stored on the memory that, when executed by the one or more processors, causes the one or more processors to log one or more rotated and scaled postures that are normalized for a range of different drivers.

### Claim 5 (depends on 1)

The computing device of claim 1, further comprising:
a previously classified vehicle interior data receiving module stored on the memory that, when executed by the one or more processors, causes the one or more processors to receive previously classified vehicle interior data, wherein the previously classified vehicle interior data is representative of circumstances associated with vehicle occupant distractions; and
a vehicle occupant distraction data generation module stored on the memory that, when executed by the one or more processors, causes the one or more processors to generate vehicle occupant distraction data based on a comparison of the vehicle interior data with the previously classified vehicle interior data, and wherein the vehicle driving route distraction data is further based on the vehicle occupant distraction data.

### Claim 6 (depends on 1)

The computing device of claim 1, further comprising a current image data receiving module stored on the memory that, when executed by the one or more processors, causes the one or more processors to receive current image data, wherein the current image data includes images and/or extracted image features that are representative of a vehicle occupant using a cellular telephone, a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, or a vehicle occupant looking at themselves in a mirror.

### Claim 7 (depends on 1)

The computing device of claim 1, further comprising a previously classified image data receiving module stored on the memory that, when executed by the one or more processors, causes the one or more processors to receive previously classified image data, wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of a vehicle occupant using a cellular telephone, a vehicle occupant looking out a vehicle side window, a vehicle occupant adjusting a vehicle radio, a vehicle occupant adjusting a vehicle heating, ventilation and air conditioning system, two vehicle occupants talking with one-another, a vehicle occupant reading a book or magazine, a vehicle occupant putting on makeup, or a vehicle occupant looking at themselves in a mirror.

### Claim 8

A computer-implemented method for determining distracted drivers associated with vehicle driving routes, the method comprising:
receiving, at one or more processors of a computing device, vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of at least one distraction of at least one vehicle occupant that is associated with a position of a body of the at least one vehicle occupant;
generating, using the one or more processors of the computing device, vehicle driving route distraction data based on the vehicle interior data; and
providing, using the one or more processors of the computing device, instructions to the at least one vehicle occupant to return to a normal driving position.

### Claim 9 (depends on 8)

The method of claim 8, wherein the position of the body of the at least one vehicle occupant includes at least one of: (i) a body posture of at least one vehicle occupant, (ii) a facial expression of at least one vehicle occupant, or (iii) a position of a body part of at least one vehicle occupant.

### Claim 10 (depends on 8)

The method of claim 8, further comprising logging one or more rotated and scaled postures that are normalized for a range of different drivers.

### Claim 11 (depends on 8)

The method of claim 8, wherein the vehicle interior data is representative of a three-dimensional representation of at least one vehicle occupant.

### Claim 12 (depends on 8)

The method of claim 8, further comprising:
receiving, at the one or more processors of the computing device, previously classified vehicle interior data, wherein the previously classified vehicle interior data is representative of circumstances associated with vehicle occupant distractions; and
generating, using the one or more processors of the computing device, vehicle occupant distraction data based on a comparison of the vehicle interior data with the previously classified vehicle interior data, and wherein the vehicle driving route distraction data is further based on the vehicle occupant distraction data.

### Claim 13 (depends on 8)

The method of claim 8, further comprising receiving, at the one or more processors of the computing device, current image data, wherein the current image data includes images and/or extracted image features that are representative of vehicle occupant locations/orientations, cellular telephone locations/orientations, vehicle occupant eye locations/orientations, vehicle occupant head location/orientation, vehicle occupant hand location/orientation, a vehicle occupant torso location/orientation, a seat belt location, or a vehicle seat location/orientation.

### Claim 14 (depends on 8)

The method of claim 8, further comprising receiving, at the one or more processors of the computing device, previously classified image data, wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of known vehicle occupant locations/orientations, known cellular telephone locations/orientations, known vehicle occupant eye locations/orientations, known vehicle occupant head location/orientation, known vehicle occupant hand location/orientation, a known vehicle occupant torso location/orientation, a known seat belt location, or a known vehicle seat location/orientation.

### Claim 15

A non-transitory computer-readable medium storing instructions for determining distracted drivers associated with vehicle driving routes that, when executed, cause one or more processors of a computing device to:
receive vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of at least one distraction of at least one vehicle occupant that is associated with a position of a body of the at least one vehicle occupant;
generate vehicle driving route distraction data based on the vehicle interior data; and
provide instructions to the at least one vehicle occupant to return to a normal driving position.

### Claim 16 (depends on 15)

The non-transitory computer-readable medium of claim 15, wherein the position of the body of the at least one vehicle occupant includes at least one of: (i) a body posture of at least one vehicle occupant, (ii) a facial expression of at least one vehicle occupant, or (iii) a position of a body part of at least one vehicle occupant.

### Claim 17 (depends on 15)

The non-transitory computer-readable medium of claim 15, further storing instructions that, when executed, cause the one or more processors to:
log one or more rotated and scaled postures that are normalized for a range of different drivers.

### Claim 18 (depends on 15)

The non-transitory computer-readable medium of claim 15, further storing instructions that, when executed, cause the one or more processors to:
receive previously classified vehicle interior data, wherein the previously classified vehicle interior data is representative of circumstances associated with vehicle occupant distractions; and
generate vehicle occupant distraction data based on a comparison of the vehicle interior data with the previously classified vehicle interior data, and wherein the vehicle driving route distraction data is further based on the vehicle occupant distraction data.

### Claim 19 (depends on 15)

The non-transitory computer-readable medium of claim 15, further storing instructions that, when executed, cause the one or more processors to:
receive current image data, wherein the current image data includes images and/or extracted image features that are representative of vehicle occupant locations/orientations, cellular telephone locations/orientations, vehicle occupant eye locations/orientations, vehicle occupant head location/orientation, vehicle occupant hand location/orientation, a vehicle occupant torso location/orientation, a seat belt location, or a vehicle seat location/orientation.

### Claim 20 (depends on 15)

The non-transitory computer-readable medium of claim 15, further storing instructions that, when executed, cause the one or more processors to:
receive previously classified image data, wherein the previously classified image data includes images and/or extracted image features that have previously been classified as being representative of known vehicle occupant locations/orientations, known cellular telephone locations/orientations, known vehicle occupant eye locations/orientations, known vehicle occupant head location/orientation, known vehicle occupant hand location/orientation, a known vehicle occupant torso location/orientation, a known seat belt location, or a known vehicle seat location/orientation.
