# US 2019/0356552 A1 · System and method for generating a global state information for a vehicle based on vehicle operator information and other contextuals

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0356552 A1
- Document ID: US20190356552A1
- Status: Published application
- Kind: A1
- Application number: 16/290,884
- Filed: 2019-03-02
- Published: 2019-11-21
- Earliest claimed: 2011-11-16
- Assignees: AutoConnect Holdings LLC
- Applicants: AutoConnect Holdings LLC
- Inventors: Christopher Ricci
- Web page: https://patentgrep.com/patent/US20190356552A1

## CPC

- G06F 13/364: using independent requests or grants, e.g. using separated request and grant lines
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/26: using acoustic output
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60R 7/04: in driver or passenger space {, e.g. using racks (B60R7/005, B60R7/08 take precedence)}
- B60R 16/037: for occupant comfort {, e.g. for automatic adjustment of appliances according to personal settings, e.g. seats, mirrors, steering wheel}
- B60R 21/01512: {Passenger detection systems}
- B60W 40/04: Traffic conditions
- B60W 40/08: related to drivers or passengers
- B60W 40/09: Driving style or behaviour
- B60W 50/0098: {Details of control systems ensuring comfort, safety or stability not otherwise provided for}
- B60W 50/08: Interaction between the driver and the control system
- G01C 21/20: Instruments for performing navigational calculations (G01C21/24, G01C21/26 take precedence)
- G01C 21/26: specially adapted for navigation in a road network
- G01S 19/13: Receivers
- G02B 27/01: Head-up displays
- G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)}
- G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06F 3/0486: Drag-and-drop
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06F 8/61: Installation
- G06F 8/65: Updates (security arrangements therefor G06F21/57)
- G06F 9/44505: {Configuring for program initiating, e.g. using registry, configuration files}
- G06F 9/54: Interprogram communication
- G06F 9/542: {Event management; Broadcasting; Multicasting; Notifications}
- G06F 11/2023: {Failover techniques}
- G06F 11/3013: {where the computing system is an embedded system, i.e. a combination of hardware and software dedicated to perform a certain function in mobile devices, printers, automotive or aircraft systems (testing or monitoring of control systems or parts thereof G05B23/02)}
- G06F 11/3065: {Monitoring arrangements determined by the means or processing involved in reporting the monitored data (error or fault reporting or logging G06F11/0766)}
- G06F 11/328: {Computer systems status display (G06F11/327 takes precedence)}
- G06F 16/24: Querying
- G06F 16/29: Geographical information databases
- G06F 17/00: Digital computing or data processing equipment or methods, specially adapted for specific functions (information retrieval, database structures or file system structures therefor G06F16/00)
- G06F 21/121: {Restricting unauthorised execution of programs}
- G06F 21/335: {for accessing specific resources, e.g. using Kerberos tickets}
- G06F 21/629: {to features or functions of an application}
- G06N 5/02: Knowledge representation; Symbolic representation
- G06Q 30/0265: {Vehicular advertisement}
- G06Q 40/08: Insurance
- G06Q 50/26: Government or public services (business processes related to the transportation industry G06Q50/40)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)}
- G07C 5/006: {Indicating maintenance}
- G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)}
- G07C 5/0816: {Indicating performance data, e.g. occurrence of a malfunction}
- G07C 5/0825: {using optical means}
- G07C 5/0833: {using audio means}
- G08C 19/00: Electric signal transmission systems (G08C17/00 takes precedence)
- G08G 1/0112: {from the vehicle, e.g. floating car data [FCD]}
- G08G 1/0116: {from roadside infrastructure, e.g. beacons}
- G08G 1/0137: {for specific applications}
- G08G 1/017: identifying vehicles (G08G1/015, G08G1/054 take precedence)
- G08G 1/09: Arrangements for giving variable traffic instructions ({railroad crossing signals B61L; reflectors E01F, G08B}; indicating arrangements for variable information by selection or combination of individual elements G09F9/00)
- G08G 1/096791: {where the origin of the information is another vehicle}
- H04L 51/56: Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
- H04L 63/10: {for controlling access to devices or network resources}
- H04L 63/205: {involving negotiation or determination of the one or more network security mechanisms to be used, e.g. by negotiation between the client and the server or between peers or by selection according to the capabilities of the entities involved (negotiation of communication capabilities H04L69/24)}
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L 67/125: involving control of end-device applications over a network
- H04N 21/41422: {located in transportation means, e.g. personal vehicle (arrangements specially adapted for transportation systems in broadcast systems H04H20/62)}
- H04N 21/4331: {Caching operations, e.g. of an advertisement for later insertion during playback}
- H04N 21/482: End-user interface for programme selection
- H04W 4/40: for vehicles, e.g. vehicle-to-pedestrians [V2P]
- H04W 4/44: for communication between vehicles and infrastructures, e.g. vehicle-to-cloud [V2C] or vehicle-to-home [V2H]
- H04W 4/48: for in-vehicle communication
- H04W 4/50: Service provisioning or reconfiguring
- H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
- H04W 4/90: Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
- H04W 8/22: Processing or transfer of terminal data, e.g. status or physical capabilities
- H04W 12/088: using filters or firewalls
- H04W 84/005: {Moving wireless networks}
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/85: Arrangements for transferring vehicle- or driver-related data
- B60K 2360/11: Instrument graphical user interfaces or menu aspects
- B60K 2360/1438: Touch screens
- B60K 2360/146: Instrument input by gesture
- B60K 2360/1464: 3D-gesture
- B60K 2360/1472: Multi-touch gesture
- B60K 2360/1476: Handwriting
- B60K 2360/164: Infotainment
- B60K 2360/166: Navigation
- B60K 2360/178: Warnings
- B60K 2360/21: using cameras
- B60K 2360/566: Mobile devices displaying vehicle information
- B60K 2360/569: Vehicle controlling mobile device functions
- B60K 2360/589: Wireless data transfers
- B60K 2360/5894: SIM cards
- B60K 2360/5899: Internet
- B60K 2360/592: Data transfer involving external databases
- B60K 2360/691: Housings
- B60W 2040/0872: {Driver physiology}
- B60W 2040/0881: {Seat occupation; Driver or passenger presence}
- B60W 2050/0095: {Automatic control mode change}
- B60W 2540/043: Identity of occupants
- B60W 2540/22: Psychological state; Stress level or workload
- B60W 2540/26: Incapacity
- B60W 2555/60: Traffic rules, e.g. speed limits or right of way
- G06F 21/1062: {Editing}
- G06F 2203/011: Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
- G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
- G06N 5/048: Fuzzy inferencing
- G06V 40/15: {Biometric patterns based on physiological signals, e.g. heartbeat, blood flow}
- H04L 63/02: {for separating internal from external traffic, e.g. firewalls}
- H04W 4/029: Location-based management or tracking services
- H04W 84/12: WLAN [Wireless Local Area Networks]
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G)
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

A method and system for diagnosing and communicating events associated with one or more components of vehicle is described. In general, a vehicle may provide information regarding its recorded and/or monitored system and component states via a self-diagnostic and/or reporting capability.

## Claims

### Claim 1

A system for generating a global state information for a vehicle, said system comprising:
a diagnostic module;
a processor;
a non-transitory storage element coupled to the processor;
encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the system to:
receive data related to a specific vehicle condition;
receive contextual data related to at least one of a vehicle operator or vehicle;
the diagnostic module applying the specific vehicle condition (threshold-grade) and the contextual data to generate a global state information for the vehicle; and
delivering said information to at least one of a vehicle operator, vehicle occupant, or third-party by at least one of a tactile feedback, visual output, or audio output.

### Claim 2 (depends on 1)

The system of claim 1, wherein the global state information is delivered to at least one of the vehicle operator or vehicle occupant in a combination of a tactile feedback, followed by at least one of a visual output or audio output.

### Claim 3 (depends on 2)

The system of claim 2, wherein the tactile feedback is delivered via at least one of a pedal, floor, steering, gear shifter, seat, or belt.

### Claim 4 (depends on 3)

The system of claim 3, wherein at least one of the intensity, duration, or pattern of the tactile feedback varies depending on at least one of a severity or type of global state information generated.

### Claim 5 (depends on 2)

The system of claim 2, wherein at least one of the visual output or audio output following the tactile feedback is delivered to at least one of a console, dash display, speaker, or sound transducer.

### Claim 6 (depends on 1)

The system of claim 1, wherein the specific vehicle condition parameters are at least one of pre-defined or user-defined and the global state information is only generated upon a threshold-grade specific vehicle condition is reached.

### Claim 7 (depends on 1)

The system of claim 1, wherein the vehicle operator information is recorded at least one of prior, during, or after a specific vehicle condition trigger.

### Claim 8 (depends on 1)

The system of claim 1, wherein the vehicle operator information comprises at least one of speed, braking, G-force, pitch, yaw, location, orientation, origin, destination, miles driven, time driven, operator health, operator physical, or mental condition.

### Claim 9 (depends on 1)

The system of claim 1, vehicle operator information further comprises contextual data, wherein the contextual data further comprises at least one of a current weather, rolling weather, road condition, traffic, fuel price, calendar, operator health metrics, or operator social or work calendar.

### Claim 10

The system of claim wherein the global state information for the vehicle may comprise at least one of an alert, comment, suggestion, option, user input request, question, user compliance rating, or third-party engagement to at least one of a vehicle operator, vehicle occupant, or third-party.

### Claim 11

A system for generating a global state information for a vehicle, said system comprising:
a diagnostic module;
a processor;
a non-transitory storage element coupled to the processor;
encoded instructions stored in the non-transitory storage element, wherein the encoded instructions when implemented by the processor, configure the system to:
receive at a processor executable diagnostic module, a signal from one or more components of a vehicle, the signal representing one or more of a code, warning, and indication of a specific vehicle condition;
receive at a processor executable diagnostic module, a signal representing at least one of a vehicle operator information or contextual data;
interpret, by the processor executable diagnostic module, a meaning associated with the signals representing a global state information of the vehicle;
determine, by the processor executable diagnostic module, a conversational meaning based on one or more rules to represent the meaning associated with the global state information of the vehicle; and
provide the conversational meaning to at least one of an operator, occupant, or third-party via a conversational presentation device, wherein the conversational presentation device includes at least one of a tactile feedback, display, text, e-mail, SMS, voicemail, mobile phone, land phone, tablet, desktop, or a speaker.

### Claim 12 (depends on 11)

The system of claim 11, wherein the global state information is delivered to at least one of the vehicle operator or vehicle occupant in a combination of a tactile feedback, followed by at least one of a visual output or audio output.

### Claim 13 (depends on 12)

The system of claim 12, wherein the tactile feedback is delivered via at least one of a pedal, floor, steering, gear shifter, seat, or belt.

### Claim 14 (depends on 13)

The system of claim 13, wherein at least one of the intensity, duration, or pattern of the tactile feedback varies depending on at least one of a severity or type of global state information generated.

### Claim 15 (depends on 12)

The system of claim 12, wherein at least one of the visual output or audio output following the tactile feedback is delivered to at least one of a console, dash display, speaker, or sound transducer.

### Claim 16 (depends on 11)

The system of claim 11, wherein the specific vehicle condition parameters are at least one of pre-defined or user-defined and the global state information is only generated upon a threshold-grade specific vehicle condition is reached.

### Claim 17 (depends on 11)

The system of claim 11, wherein the vehicle operator information is recorded at least one of prior, during, or after a specific vehicle condition trigger.

### Claim 18 (depends on 11)

The system of claim 11, wherein the vehicle operator information comprises at least one of speed, braking, G-force, pitch, yaw, location, orientation, origin, destination, miles driven, time driven, operator health, operator physical, or mental condition.

### Claim 19 (depends on 11)

The system of claim 11, vehicle operator information further comprises contextual data, wherein the contextual data further comprises at least one of a current weather, rolling weather, road condition, traffic, fuel price, calendar, operator health metrics, or operator social or work calendar.

### Claim 20 (depends on 11)

The system of claim 11, wherein the global state information for the vehicle may comprise at least one of an alert, comment, suggestion, option, user input request, question, user compliance rating, or third-party engagement to at least one of a vehicle operator, vehicle occupant, or third-party.

### Claim 21

A method of providing conversational global state information of a vehicle to a receiving party, comprising:
receiving, at a microprocessor executable diagnostic module, a signal from one or more components of a vehicle, the signal representing one or more of a code, warning, and indication of a specific vehicle condition;
receiving at a microprocessor executable diagnostic module, a signal representing at least one of a vehicle operator information or contextual data;
interpreting, by the microprocessor executable diagnostic module, a meaning associated with the signals representing a global state information of the vehicle;
determining, by the microprocessor executable diagnostic module, a conversational meaning based on one or more rules to represent the meaning associated with the global state information of the vehicle;
providing the conversational meaning to an occupant of the vehicle via a conversational presentation device, wherein the conversational presentation device includes at least one of a tactile feedback, display, or a speaker;
querying, by the microprocessor executable diagnostic module, other components of the vehicle for operational state information relating to the other components in response to receiving the signal, the other components being different types of components than the one or more components from which a signal representing one or more of a code, warning, and indication was received; and
if it is determined that there are one or more relationships between at least one of the other components of the vehicle and the signal from the one or more components of the vehicle, then:
identifying, by the microprocessor executable diagnostic module, an actual or potential malfunction associated with at least one of the other components of the vehicle based on a result of the query and a relationship between the at least one of the other components of the vehicle and the one or more components of the vehicle providing the signal; and
providing, via the conversational presentation device, conversational advice to the occupant of the vehicle, wherein the conversational advice includes information configured to at least alert the occupant of the vehicle of the actual or potential malfunction associated with at least one of the other components of the vehicle;
wherein each of the receiving, interpreting, determining, querying, and identifying operations are performed locally within the vehicle.