# US 2025/0143645 A1 · Severity estimation system for occupants in a vehicle > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0143645 A1 - Document ID: US20250143645A1 - Status: Published application - Kind: A1 - Application number: 18/503,695 - Filed: 2023-11-07 - Published: 2025-05-08 - Earliest claimed: 2023-11-07 - Assignees: GM Global Technology Operations LLC - Applicants: GM Global Technology Operations LLC - Inventors: Ali Rafiei; Chin-Hsu Lin; Alaa M. Khamis; Alok Warey - Web page: https://patentgrep.com/patent/US20250143645A1 ## CPC - A61B 5/6893: {Cars} - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20) - A61B 5/05: Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves (measuring movement of the entire body or parts thereof A61B5/11; detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof A61B5/24) - B60R 21/0132: responsive to vehicle motion parameters {, e.g. to vehicle longitudinal or transversal deceleration or speed value} - B60R 21/01542: {detecting passenger motion} - E05B 77/02: for accident situations - E05F 15/72: responsive to emergency conditions, e.g. fire - G06V 10/803: {of input or preprocessed data} - G06V 20/59: inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions - G10L 25/51: for comparison or discrimination - E05Y 2400/851: Voice - E05Y 2800/252: the elements functioning only in case of emergency - E05Y 2900/55: Windows - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - E05B: LOCKS; ACCESSORIES THEREFOR; HANDCUFFS - E05F: DEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - E05Y: INDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF ## Abstract A severity estimation system for one or more occupants located in an interior cabin of a vehicle involved in a vehicle-related incident includes one or more microphones located within the interior cabin of the vehicle that capture audio-based inputs, an occupant monitoring system (OMS) that collects scene recognition inputs indicative of a status of the occupants, a restraint system that collects a plurality of restraint-based inputs indicative of one or more restraint-based mechanisms associated with an occupant of the vehicle being activated during the vehicle-related incident, a motion-based indicator system that collect the plurality of motion-based inputs indicative of the motion of the vehicle during the vehicle-related incident, and one or more controllers. The one or more controllers fuse together the audio-based indicator, the OMS indicator, the restraint-based indicator, and the motion-based indicator to determine an incident severity indicator corresponding to the one or more occupants. ## Claims ### Claim 1 A severity estimation system for one or more occupants located in an interior cabin of a vehicle involved in a vehicle-related incident, the severity estimation system comprising: one or more microphones located within the interior cabin of the vehicle that capture a plurality of audio-based inputs indicative of verbal and non-verbal sounds emitted by the one or more occupants of the vehicle; an occupant monitoring system (OMS) that collects a plurality of scene recognition inputs indicative of a status of the occupants; a restraint system that collects a plurality of restraint-based inputs indicative of one or more restraint-based mechanisms associated with an occupant of the vehicle being activated during the vehicle-related incident; a motion-based indicator system that collect a plurality of motion-based inputs indicative of the motion of the vehicle during the vehicle-related incident; and one or more controllers in electronic communication with the one or more microphones, the OMS, the restraint system, and the motion-based indicator system, the one or more controllers executing instructions to: combine the plurality of audio-based inputs based on at least a 2-value logic system to determine an audio-based indicator, the plurality of scene recognition inputs based on the at least 2-value logic system to determine an OMS indicator, and the plurality of restraint-based inputs based on the at least 2-value logic system to determine a restraint-based indicator; combine the plurality of motion-based inputs from the motion-based indicator system based on a weighted sum model to determine a motion-based indicator; and fuse together the audio-based indicator, the OMS indicator, the restraint-based indicator, and the motion-based indicator to determine an incident severity indicator corresponding to the one or more occupants, wherein the incident severity indicator is a numerical value representative of a level of severity of an effect the vehicle-related incident has upon the one or more occupants. ### Claim 2 (depends on 1) The severity estimation system of claim 1, wherein the one or more controllers execute instructions to fuse together the audio-based indicator, the OMS indicator, the restraint-based indicator, and the motion-based indicator based on a weighted formula to determine the incident severity indicator. ### Claim 3 (depends on 2) The severity estimation system of claim 2, wherein the weighted formula is expressed as: Y = W A ⁢ I audio + W M ⁢ I motion + W O ⁢ I OMS + W R ⁢ I Res wherein WA is a weight corresponding to the audio-based indicator Iaudio, WM is a weight corresponding to the motion-based indicator Imotion, WO is a weight corresponding to the OMS indicator IOMS, and WR is a weight corresponding to the restraint-based indicator IRes. ### Claim 4 (depends on 1) The severity estimation system of claim 1, wherein the one or more controllers execute instructions to select one or more remedial actions based on the incident severity indicator, an unconsciousness probability indicator, and a root cause probability indicator. ### Claim 5 (depends on 4) The severity estimation system of claim 4, wherein the one or more remedial actions include one or more of the following: contacting emergency personnel, unlocking doors of the vehicle, lowering windows of the vehicle, sending an SOS signal to one or more vehicles that are located within a predefined radius from the vehicle, and contacting non-emergency personnel. ### Claim 6 (depends on 1) The severity estimation system of claim 1, wherein the 2-value logic system is one of a binary logic system and a ternary logic system. ### Claim 7 (depends on 1) The severity estimation system of claim 1, wherein the audio-based inputs are combined based on ternary OR-based logic. ### Claim 8 (depends on 1) The severity estimation system of claim 1, wherein the OMS includes one or more cameras positioned within the interior cabin of the vehicle to capture image data indicative of the one or more occupants. ### Claim 9 (depends on 8) The severity estimation system of claim 8, wherein the one or more cameras include one or more of the following: a red, green, and blue (RGB) camera that captures visible light image data, an infrared camera that captures infrared image data, and a thermal camera that captures thermal image data. ### Claim 10 (depends on 1) The severity estimation system of claim 1, wherein the OMS includes one or more of the following: one or more biometric sensors and one or more radar sensors. ### Claim 11 (depends on 1) The severity estimation system of claim 1, wherein the plurality of scene recognition inputs includes one or more of the following: eye status inputs based on the eyes of the occupants, head status inputs based on the head of the occupants, vital status inputs, body velocity inputs, seat belt status inputs, seat belt speed inputs, contact inputs indicating contact between the occupants and an interior of the vehicle, and airbag inputs. ### Claim 12 (depends on 1) The severity estimation system of claim 1, wherein the plurality of motion-based inputs includes one or more of the following: an acceleration and deceleration input, an impact angle input, a roll-over input, and a velocity change input. ### Claim 13 (depends on 12) The severity estimation system of claim 12, wherein the weighted sum model is expressed as: I motion = ω M ⁢ 1 × M ⁢ 1 + ω M ⁢ 2 × M ⁢ 2 + ω M ⁢ 3 × M ⁢ 3 + ω M ⁢ 4 × M ⁢ 4 = 1 wherein ωM1 represents a first weighting factor corresponding to the acceleration and deceleration input M1, ωM2 represents a second weighting factor corresponding to the impact angle input M2, ωM3 represents a third weighting factor corresponding to the roll-over input M3, and ωM1 represents a fourth weighting factor corresponding to the velocity change input M4. ### Claim 14 (depends on 1) The severity estimation system of claim 1, wherein the plurality of restraint-based inputs from the restraint system include one or more of the following: an anchor pretensioner input, a load limiter input, a first stage deployment input, and a dual stage deployment input. ### Claim 15 (depends on 1) The severity estimation system of claim 1, wherein the motion-based indicator system includes one or more of the following: a sensing and diagnostic module (SDM) and an electronic data recorder (EDM). ### Claim 16 A severity estimation system for one or more occupants located in an interior cabin of a vehicle involved in a vehicle-related incident, the severity estimation system comprising: one or more microphones located within the interior cabin of the vehicle that capture a plurality of audio-based inputs indicative of verbal and non-verbal sounds emitted by the one or more occupants of the vehicle; an OMS that collects a plurality of scene recognition inputs indicative of a status of the occupants; a restraint system that collects a plurality of restraint-based inputs indicative of one or more restraint-based mechanisms associated with an occupant of the vehicle being activated during the vehicle-related incident; a motion-based indicator system that collect a plurality of motion-based inputs indicative of the motion of the vehicle during the vehicle-related incident; and one or more controllers in electronic communication with the one or more microphones, the OMS, the restraint system, and the motion-based indicator system, the one or more controllers executing instructions to: combine the plurality of audio-based inputs based on at least a 2-value logic system to determine an audio-based indicator, the plurality of scene recognition inputs based on the at least 2-value logic system to determine an OMS indicator, and the plurality of restraint-based inputs based on the at least 2-value logic system to determine a restraint-based indicator; combine the plurality of motion-based inputs from the motion-based indicator system based on a weighted sum model to determine a motion-based indicator; and fuse together the audio-based indicator, the OMS indicator, the restraint-based indicator, and the motion-based indicator based on a weighted formula to determine an incident severity indicator corresponding to the one or more occupants, wherein the incident severity indicator is a numerical value representative of a level of severity of an effect the vehicle-related incident has upon the one or more occupants. ### Claim 17 (depends on 16) The severity estimation system of claim 16, wherein the weighted formula is expressed as: Y = W A ⁢ I audio + W M ⁢ I motion + W O ⁢ I OMS + W R ⁢ I Res wherein WA is a weight corresponding to the audio-based indicator Iaudio, WM is a weight corresponding to the motion-based indicator Imotion, WO is a weight corresponding to the OMS indicator IOMS, and WR is a weight corresponding to the restraint-based indicator IRES. ### Claim 18 (depends on 16) The severity estimation system of claim 16, wherein the one or more controllers execute instructions to select one or more remedial actions based on the incident severity indicator, an unconsciousness probability indicator, and a root cause probability indicator. ### Claim 19 (depends on 18) The severity estimation system of claim 18, wherein the one or more remedial actions include one or more of the following: contacting emergency personnel, unlocking doors of the vehicle, lowering windows of the vehicle, sending an SOS signal to one or more vehicles that are located within a predefined radius from the vehicle, and contacting non-emergency personnel. ### Claim 20 A severity estimation system for one or more occupants located in an interior cabin of a vehicle involved in a vehicle-related incident, the severity estimation system comprising: one or more microphones located within the interior cabin of the vehicle that capture a plurality of audio-based inputs indicative of verbal and non-verbal sounds emitted by the one or more occupants of the vehicle; an OMS that collects a plurality of scene recognition inputs indicative of a status of the occupants; a restraint system that collects a plurality of restraint-based inputs indicative of one or more restraint-based mechanisms associated with an occupant of the vehicle being activated during the vehicle-related incident; a motion-based indicator system that collect a plurality of motion-based inputs indicative of the motion of the vehicle during the vehicle-related incident; and one or more controllers in electronic communication with the one or more microphones, the OMS, the restraint system, and the motion-based indicator system, the one or more controllers executing instructions to: combine the plurality of audio-based inputs based on at least a 2-value logic system to determine an audio-based indicator, the plurality of scene recognition inputs based on the at least 2-value logic system to determine an OMS indicator, and the plurality of restraint-based inputs based on the at least 2-value logic system to determine a restraint-based indicator; combine the plurality of motion-based inputs from the motion-based indicator system based on a weighted sum model to determine a motion-based indicator; fuse together the audio-based indicator, the OMS indicator, the restraint-based indicator, and the motion-based indicator based on a weighted formula to determine an incident severity indicator corresponding to the one or more occupants, wherein the incident severity indicator is a numerical value representative of a level of severity of an effect the vehicle-related incident has upon the one or more occupants; and select one or more remedial actions based on the incident severity indicator, an unconsciousness probability indicator, and a root cause probability indicator.