# US 2025/0095387 A1 · Vehicle cabin monitoring system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2025/0095387 A1 - Document ID: US20250095387A1 - Status: Published application - Kind: A1 - Application number: 18/964,782 - Filed: 2024-12-02 - Published: 2025-03-20 - Earliest claimed: 2018-12-19 - Assignees: Magna Electronics Inc. - Applicants: Magna Electronics Inc. - Inventors: Sylvie Wacquant - Web page: https://patentgrep.com/patent/US20250095387A1 ## CPC - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - B60R 11/0247: {for microphones or earphones} - B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle - G05B 13/0265: {the criterion being a learning criterion} - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G06V 40/174: {Facial expression recognition} - G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) - B60R 2011/0003: {inside the vehicle} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) ## Abstract A vehicular cabin monitoring system includes at least one interior-viewing camera viewing at least a driver and a passenger of a vehicle. Image data captured by the at least one interior-viewing camera is transferred to an electronic control unit (ECU) and is processed at the ECU. Based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the vehicular cabin monitoring system monitors the driver of the vehicle. Based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the system monitors the passenger of the vehicle. Based at least in part on monitoring of the driver, the system classifies the driver as being at least one selected from the group consisting of overloaded, attentive and distracted. ## Claims ### Claim 1 A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising: at least one interior-viewing camera disposed at a vehicle equipped with the vehicular cabin monitoring system, the at least one interior-viewing camera viewing at least a driver of the vehicle and a passenger of the vehicle, wherein the at least one interior-viewing camera is operable to capture image data; wherein each camera of the at least one interior-viewing camera comprises an imaging array having at least one million photosensor elements arranged in rows and columns; an electronic control unit (ECU), the ECU comprising electronic circuitry and associated software, wherein the electronic circuitry comprises a data processor; wherein image data captured by each camera of the at least one interior-viewing camera is transferred to the ECU and is processed at the ECU; wherein, based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the vehicular cabin monitoring system monitors the driver of the vehicle; wherein, based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the vehicular cabin monitoring system monitors the passenger of the vehicle; and wherein, based at least in part on monitoring of the driver, the vehicular cabin monitoring system classifies the driver as being at least one selected from the group consisting of (i) overloaded, (ii) attentive and (iii) distracted. ### Claim 2 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein the vehicular cabin monitoring system classifies the driver based in part on monitoring of the passenger. ### Claim 3 (depends on 2) The vehicular cabin monitoring system of claim 2, wherein, based on monitoring of the passenger, the vehicular cabin monitoring system determines activity of the passenger, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined activity of the passenger. ### Claim 4 (depends on 3) The vehicular cabin monitoring system of claim 3, wherein the determined activity of the passenger comprises the passenger adjusting a radio of the vehicle. ### Claim 5 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein the at least one interior-viewing camera comprises (i) a driver-viewing camera that views at least the driver of the vehicle and (ii) a passenger-viewing camera that views at least the passenger of the vehicle. ### Claim 6 (depends on 5) The vehicular cabin monitoring system of claim 5, wherein the vehicular cabin monitoring system monitors the driver of the vehicle based at least in part on processing at the ECU of image data captured by the driver-viewing camera, and wherein the vehicular cabin monitoring system monitors the passenger of the vehicle based at least in part on processing at the ECU of image data captured by the passenger-viewing camera. ### Claim 7 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein the at least one interior-viewing camera comprises (i) a first camera that views at least the driver of the vehicle and a passenger of the vehicle and (ii) a second camera that views at least a passenger of the vehicle. ### Claim 8 (depends on 7) The vehicular cabin monitoring system of claim 7, wherein the passenger viewed by the first camera and the passenger viewed by the second camera are the same person. ### Claim 9 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein the driver is classified based in part on an estimated current driving workload of the driver of the vehicle. ### Claim 10 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload of the driver of the vehicle is based at least in part on a current driving condition of the vehicle. ### Claim 11 (depends on 10) The vehicular cabin monitoring system of claim 10, wherein the current driving condition comprises a current road condition. ### Claim 12 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload is updated during operation of the vehicle. ### Claim 13 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload is updated responsive to tendencies extracted from data collected from other vehicles. ### Claim 14 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload is updated based at least in part on monitoring of the passenger of the vehicle. ### Claim 15 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload is estimated based at least in part on at least one selected from the group consisting of (i) a driving condition, (ii) a traffic condition and (iii) a driver reaction capacity. ### Claim 16 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the vehicular cabin monitoring system estimates a maximum driving workload of the driver based at least in part on a driving condition of the vehicle. ### Claim 17 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the estimated current driving workload is estimated based at least in part on a driving condition of the vehicle, and wherein the driving condition is estimated based on at least one selected from the group consisting of (i) traffic, (ii) infrastructure, (iii) weather and (iv) visibility. ### Claim 18 (depends on 9) The vehicular cabin monitoring system of claim 9, wherein the vehicular cabin monitoring system determines, at least in part via processing at the ECU of driver information pertaining to the driver of the vehicle, a maximum driving workload attributable to the driver. ### Claim 19 (depends on 18) The vehicular cabin monitoring system of claim 18, wherein the driver information comprises at least one selected from the group consisting of (i) braking behavior, (ii) acceleration behavior, (iii) lane keeping behavior, (iv) entertainment console usage, (v) climate control usage and (vi) audio data captured by an interior microphone of the vehicle. ### Claim 20 (depends on 18) The vehicular cabin monitoring system of claim 18, wherein the driver information comprises at least one selected from the group consisting of (i) driver position, (ii) driver identification, (iii) driver style, (iv) driver attention and (v) driver health. ### Claim 21 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein monitoring of the driver of the vehicle is based at least in part on at least one selected from the group consisting of (i) vehicle entertainment information, (ii) driver condition information and (iii) visual distraction information. ### Claim 22 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein the vehicular cabin monitoring system determines a maximum driving workload attributable to the driver based at least in part on one selected from the group consisting of (i) information pertaining to the driver of the vehicle and (ii) a driving condition of the vehicle, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined maximum driving workload. ### Claim 23 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein, based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the vehicular cabin monitoring system identifies the driver of the vehicle. ### Claim 24 (depends on 1) The vehicular cabin monitoring system of claim 1, wherein a camera of the at least one interior-viewing camera is disposed at an interior rearview mirror assembly of the vehicle. ### Claim 25 A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising: a first interior-viewing camera disposed at a vehicle equipped with the vehicular cabin monitoring system, the first interior-viewing camera viewing at least a driver of the vehicle and a passenger of the vehicle, wherein the first interior-viewing camera is operable to capture image data; a second interior-viewing camera disposed at the vehicle, the second interior-viewing camera viewing at least a passenger of the vehicle, wherein the second interior-viewing camera is operable to capture image data; wherein the first interior-viewing camera comprises an imaging array having at least one million photosensor elements arranged in rows and columns; wherein the second interior-viewing camera comprises an imaging array having at least one million photosensor elements arranged in rows and columns; an electronic control unit (ECU), the ECU comprising electronic circuitry and associated software, wherein the electronic circuitry comprises a data processor; wherein image data captured by the first interior-viewing camera is transferred to the ECU and is processed at the ECU; wherein image data captured by the second interior-viewing camera is transferred to the ECU and is processed at the ECU; wherein, based at least in part on processing at the ECU of image data captured by the first interior-viewing camera, the vehicular cabin monitoring system monitors the driver of the vehicle; wherein monitoring of the driver of the vehicle is based at least in part on at least one selected from the group consisting of (i) vehicle entertainment information, (ii) driver condition information and (iii) visual distraction information; wherein, based at least in part on processing at the ECU of image data captured by the second interior-viewing camera, the vehicular cabin monitoring system monitors the passenger of the vehicle that is viewed by the second interior-viewing camera; and wherein, based at least in part on monitoring of the driver, the vehicular cabin monitoring system classifies the driver as being at least one selected from the group consisting of (i) overloaded, (ii) attentive and (iii) distracted. ### Claim 26 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein the passenger viewed by the first interior-viewing camera and the passenger viewed by the second interior-viewing camera are the same person. ### Claim 27 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein the vehicular cabin monitoring system monitors the passenger of the vehicle that is viewed by the first interior-viewing camera based in part on processing at the ECU of image data captured by the first interior-viewing camera. ### Claim 28 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein the vehicular cabin monitoring system classifies the driver based in part on monitoring of the passenger. ### Claim 29 (depends on 28) The vehicular cabin monitoring system of claim 28, wherein, based on monitoring of the passenger, the vehicular cabin monitoring system determines activity of the passenger that is viewed by the second interior-viewing camera, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined activity of the passenger that is viewed by the second interior-viewing camera. ### Claim 30 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein the driver is classified based in part on an estimated current driving workload of the driver of the vehicle. ### Claim 31 (depends on 30) The vehicular cabin monitoring system of claim 30, wherein the estimated current driving workload of the driver of the vehicle is based at least in part on a current driving condition of the vehicle. ### Claim 32 (depends on 30) The vehicular cabin monitoring system of claim 30, wherein the estimated current driving workload is estimated based at least in part on at least one selected from the group consisting of (i) a driving condition, (ii) a traffic condition and (iii) a driver reaction capacity. ### Claim 33 (depends on 30) The vehicular cabin monitoring system of claim 30, wherein the vehicular cabin monitoring system estimates a maximum driving workload of the driver based at least in part on a driving condition of the vehicle. ### Claim 34 (depends on 30) The vehicular cabin monitoring system of claim 30, wherein the estimated current driving workload is estimated based at least in part on a driving condition of the vehicle, and wherein the driving condition is estimated based on at least one selected from the group consisting of (i) traffic, (ii) infrastructure, (iii) weather and (iv) visibility. ### Claim 35 (depends on 30) The vehicular cabin monitoring system of claim 30, wherein the vehicular cabin monitoring system determines, at least in part via processing at the ECU of driver information pertaining to the driver of the vehicle, a maximum driving workload attributable to the driver. ### Claim 36 (depends on 35) The vehicular cabin monitoring system of claim 35, wherein the driver information comprises at least one selected from the group consisting of (i) braking behavior, (ii) acceleration behavior, (iii) lane keeping behavior, (iv) entertainment console usage, (v) climate control usage, (vi) audio data captured by an interior microphone of the vehicle, (vii) driver position, (viii) driver identification, (ix) driver style, (x) driver attention and (xi) driver health. ### Claim 37 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein the vehicular cabin monitoring system determines a maximum driving workload attributable to the driver based at least in part on one selected from the group consisting of (i) information pertaining to the driver of the vehicle and (ii) a driving condition of the vehicle, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined maximum driving workload. ### Claim 38 (depends on 25) The vehicular cabin monitoring system of claim 25, wherein, based at least in part on processing at the ECU of image data captured by the first interior-viewing camera, the vehicular cabin monitoring system identifies the driver of the vehicle. ### Claim 39 A vehicular cabin monitoring system, the vehicular cabin monitoring system comprising: at least one interior-viewing camera disposed at a vehicle equipped with the vehicular cabin monitoring system, the at least one interior-viewing camera viewing at least a driver of the vehicle and a passenger of the vehicle, wherein the at least one interior-viewing camera is operable to capture image data; wherein each camera of the at least one interior-viewing camera comprises an imaging array having at least one million photosensor elements arranged in rows and columns; an electronic control unit (ECU), the ECU comprising electronic circuitry and associated software, wherein the electronic circuitry comprises a data processor; wherein image data captured by each camera of the at least one interior-viewing camera is transferred to the ECU and is processed at the ECU; wherein a driver-viewing camera of the at least one interior-viewing camera is disposed at an interior rearview mirror assembly of the vehicle; wherein, based at least in part on processing at the ECU of image data captured by the driver-viewing camera disposed at the interior rearview mirror assembly of the vehicle, the vehicular cabin monitoring system monitors the driver of the vehicle; wherein monitoring of the driver of the vehicle is based at least in part on at least one selected from the group consisting of (i) vehicle entertainment information, (ii) driver condition information and (iii) visual distraction information; wherein, based at least in part on processing at the ECU of image data captured by the at least one interior-viewing camera, the vehicular cabin monitoring system monitors the passenger of the vehicle; and wherein, based at least in part on monitoring of the driver, the vehicular cabin monitoring system classifies the driver as being at least one selected from the group consisting of (i) overloaded, (ii) attentive and (iii) distracted. ### Claim 40 (depends on 39) The vehicular cabin monitoring system of claim 39, wherein the vehicular cabin monitoring system classifies the driver based in part on monitoring of the passenger. ### Claim 41 (depends on 40) The vehicular cabin monitoring system of claim 40, wherein, based at least in part on monitoring of the passenger, the vehicular cabin monitoring system determines activity of the passenger, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined activity of the passenger. ### Claim 42 (depends on 39) The vehicular cabin monitoring system of claim 39, wherein the at least one interior-viewing camera comprises a passenger-viewing camera that views at least the passenger of the, and wherein the vehicular cabin monitoring system monitors the passenger of the vehicle based at least in part on processing at the ECU of image data captured by the passenger-viewing camera. ### Claim 43 (depends on 39) The vehicular cabin monitoring system of claim 39, wherein the driver is classified based in part on an estimated current driving workload of the driver of the vehicle. ### Claim 44 (depends on 43) The vehicular cabin monitoring system of claim 43, wherein the estimated current driving workload of the driver of the vehicle is based at least in part on a current driving condition of the vehicle. ### Claim 45 (depends on 43) The vehicular cabin monitoring system of claim 43, wherein the estimated current driving workload is estimated based at least in part on at least one selected from the group consisting of (i) a driving condition, (ii) a traffic condition and (iii) a driver reaction capacity. ### Claim 46 (depends on 43) The vehicular cabin monitoring system of claim 43, wherein the estimated current driving workload is estimated based at least in part on a driving condition of the vehicle, and wherein the driving condition is estimated based on at least one selected from the group consisting of (i) traffic, (ii) infrastructure, (iii) weather and (iv) visibility. ### Claim 47 (depends on 39) The vehicular cabin monitoring system of claim 39, wherein the vehicular cabin monitoring system determines a maximum driving workload attributable to the driver based at least in part on one selected from the group consisting of (i) driver information pertaining to the driver of the vehicle and (ii) a driving condition of the vehicle, and wherein the vehicular cabin monitoring system classifies the driver based in part on the determined maximum driving workload. ### Claim 48 (depends on 47) The vehicular cabin monitoring system of claim 47, wherein the driver information comprises at least one selected from the group consisting of (i) braking behavior, (ii) acceleration behavior, (iii) lane keeping behavior, (iv) entertainment console usage, (v) climate control usage, (vi) audio data captured by an interior microphone of the vehicle, (vii) driver position, (viii) driver identification, (ix) driver style, (x) driver attention and (xi) driver health. ### Claim 49 (depends on 39) The vehicular cabin monitoring system of claim 39, wherein, based at least in part on processing at the ECU of image data captured by the driver-viewing camera, the vehicular cabin monitoring system identifies the driver of the vehicle.