# US 10,373,500 B1 · Technology for using image data to assess vehicular risks and communicate notifications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,373,500 B1 - Document ID: US10373500B1 - Status: Granted - Kind: B1 - Application number: 15/713,227 - Filed: 2017-09-22 - Granted: 2019-08-06 - Earliest claimed: 2017-09-22 - Assignees: State Farm Mutual Automobile Insurance Company - Applicants: State Farm Mutual Automobile Insurance Company - Inventors: Aaron Scott Chan; Kenneth J. Sanchez - Web page: https://patentgrep.com/patent/US10373500B1 ## CPC - G08G 1/163: {involving continuous checking} - B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - G08G 1/0965: responding to signals from another vehicle, e.g. emergency vehicle - G08G 1/162: {event-triggered} - H04W 84/00: Network topologies - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Systems and methods for generating and communicating notifications indicating risks associated with vehicular operation are provided. According to certain aspects, an electronic device may access and analyze image data that depicts a vehicle operator in a certain state. The electronic device may determine, based on the state of the vehicle operator, whether a risk exists as well as information that may be helpful to communicate to additional vehicle operators. The electronic device may generate a notification that indicates the information and transmit the notification to at least one additional vehicle and/or to an infrastructure component. ## Claims ### Claim 1 A computer-implemented method in an electronic device of managing notifications associated with vehicular transportation, the method comprising: accessing image data from at least one image sensor located within a vehicle being operated by a vehicle operator; analyzing, by a computer processor, the image data to determine a state of the vehicle operator as depicted in the image data; determining, based on the state of the vehicle operator, that a risk exists; identifying a current location of the vehicle; determining, based on the current location of the vehicle, a future location of the vehicle; determining, based on the future location of the vehicle, a component to which to transmit a notification that indicates the risk, wherein a location of the component is within a vicinity of the future location of the vehicle; determining, based on the risk, an action for an additional vehicle operator of an additional vehicle to undertake to mitigate the risk; generating the notification that indicates (i) the risk, and (ii) the action for the additional vehicle operator to undertake to mitigate the risk; and transmitting, via a network connection, the notification to the component. ### Claim 2 (depends on 1) The computer-implemented method claim 1, wherein determining the component comprises: determining one of: (i) the additional vehicle or (ii) an infrastructure component. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, wherein determining the component is further based on the current location of the vehicle. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, wherein analyzing the image data to determine the state of the vehicle operator as depicted in the image data comprises: analyzing the image data to determine at least one of: (i) a positioning of the vehicle operator as depicted in the image data, and (ii) a movement made by the vehicle operator as depicted in the image data. ### Claim 5 (depends on 1) The computer-implemented method of claim 1, further comprising: accessing a set of telematics data associated with operation of the vehicle; and transmitting, via the network connection, at least a portion of the set of telematics data to the component. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein determining, based on the state of the vehicle operator, that the risk exists comprises: estimating, based on the state of the vehicle operator, a future movement to be undertaken by the vehicle; and determining, based on the future movement, that the risk exists. ### Claim 7 (depends on 1) The computer-implemented method of claim 1, wherein determining the action comprises: determining, based on the risk and the future movement to be undertaken by the vehicle, the action for the additional vehicle operator of the additional vehicle to undertake to mitigate the risk. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein determining, based on the state of the vehicle operator, that the risk exists comprises: estimating, based on the state of the vehicle operator, a current operating state of the vehicle; estimating, based on the current operating state of the vehicle operator, a future movement to be undertaken by the vehicle; and determining, based on the future movement, that the risk exists. ### Claim 9 (depends on 1) The computer-implemented method of claim 1, wherein determining, based on the state of the vehicle operator, that the risk exists comprises: identifying the risk that corresponds to the state of the vehicle operator, the risk having a likelihood of occurrence; and determining that the likelihood of occurrence of the risk at least meets a threshold value. ### Claim 10 A system for managing notifications associated with vehicular transportation, comprising: a transceiver configured to communicate via a network connection; a memory configured to store non-transitory computer executable instructions; and a processor configured to interface with the memory, wherein the processor is configured to execute the non-transitory computer executable instructions to cause the processor to: access image data from at least one image sensor located within a vehicle being operated by a vehicle operator, analyze the image data to determine a state of the vehicle operator as depicted in the image data, determine, based on the state of the vehicle operator, that a risk exists, identify a current location of the vehicle, determine, based on the current location of the vehicle, a future location of the vehicle, determine, based on the future location of the vehicle, a component to which to transmit a notification that indicates the risk, wherein a location of the component is within a vicinity of the future location of the vehicle, determine, based on the risk, an action for an additional vehicle operator of an additional vehicle to undertake to mitigate the risk, generate the notification that indicates (i) the risk, and (ii) the action for the additional vehicle operator to undertake to mitigate the risk, and transmit, via the transceiver, the notification to the component. ### Claim 11 (depends on 10) The system of claim 10, wherein the component is one of: (i) the additional vehicle or (ii) an infrastructure component. ### Claim 12 (depends on 10) The system of claim 10, wherein the processor determines the component further based on the current location of the vehicle. ### Claim 13 (depends on 10) The system of claim 10, wherein to analyze the image data to determine the state of the vehicle operator as depicted in the image data, the processor is configured to: analyze the image data to determine at least one of: (i) a positioning of the vehicle operator as depicted in the image data, and (ii) a movement made by the vehicle operator as depicted in the image data. ### Claim 14 (depends on 10) The system of claim 10, wherein the processor is further configured to: access a set of telematics data associated with operation of the vehicle, and transmit, via the transceiver, at least a portion of the set of telematics data to the component. ### Claim 15 (depends on 10) The system of claim 10, wherein to determine, based on the state of the vehicle operator, that the risk exists, the processor is configured to: estimate, based on the state of the vehicle operator, a future movement to be undertaken by the vehicle, and determine, based on the future movement, that the risk exists. ### Claim 16 (depends on 15) The system of claim 15, wherein to determine the action, the processor is configured to: determine, based on the risk and the future movement to be undertaken by the vehicle, the action for the additional vehicle operator of the additional vehicle to undertake to mitigate the risk. ### Claim 17 (depends on 10) The system of claim 10, wherein to determine, based on the state of the vehicle operator, that the risk exists, the processor is configured to: estimate, based on the state of the vehicle operator, a current operating state of the vehicle, estimate, based on the current operating state of the vehicle operator, a future movement to be undertaken by the vehicle, and determine, based on the future movement, that the risk exists. ### Claim 18 (depends on 10) The system of claim 10, wherein to determine, based on the state of the vehicle operator, that the risk exists, the processor is configured to: identify the risk that corresponds to the state of the vehicle operator, the risk having a likelihood of occurrence, and determine that the likelihood of occurrence of the risk at least meets a threshold value.