# US 12,217,149 B2 · Vehicular driving assist system with enhanced data processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,149 B2 - Document ID: US12217149B2 - Status: Granted - Kind: B2 - Application number: 18/779,248 - Filed: 2024-07-22 - Published: 2024-11-14 - Granted: 2025-02-04 - Earliest claimed: 2016-05-11 - Assignees: Magna Electronics Inc. - Applicants: Magna Electronics Inc. - Inventors: John Lu - Web page: https://patentgrep.com/patent/US12217149B2 ## CPC - G06N 3/043: based on fuzzy logic, fuzzy membership or fuzzy inference, e.g. adaptive neuro-fuzzy inference systems [ANFIS] - B60W 30/00: Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units - B60W 50/00: Details of control systems for road vehicle drive control not related to the control of a particular sub-unit {, e.g. process diagnostic or vehicle driver interfaces} - G05D 1/81: Handing over between on-board automatic and on-board manual control - G06F 9/5088: {involving task migration} - G06N 7/02: using fuzzy logic (computing arrangements based on biological models G06N3/00; computing arrangements using knowledge-based models G06N5/00) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A vehicular driving assistance system includes an exterior viewing camera disposed at a vehicle and viewing exterior of the vehicle. Image data captured by the camera is provided to and processed at an electronic control unit (ECU). The ECU performs processing tasks for multiple vehicle systems. The ECU prioritizes processing of a plurality of tasks including a higher priority task and a lower priority task. Responsive to prioritization by the ECU of the higher priority task, the system (i) processes captured image data at the ECU for the higher priority task and the (ii) uploads captured image data to the cloud for processing at a remote processor. Processing of uploaded captured image data at the remote processor comprises at least one selected from the group consisting of (i) data negotiation, (ii) data collection, (iii) load analysis, (iv) load distribution and (v) monitoring. ## Claims ### Claim 1 A vehicular driving assistance system, the vehicular driving assistance system comprising: an exterior viewing camera disposed at a vehicle equipped with the vehicular driving assistance system and viewing exterior of the vehicle; wherein the exterior viewing camera comprises an imager having at least one million photosensor elements; an electronic control unit (ECU) disposed at the vehicle; wherein image data captured by the exterior viewing camera is provided to and is processed at the ECU; wherein the ECU performs processing tasks for multiple vehicle systems; wherein the vehicular driving assistance system is operable to wirelessly upload captured image data to the cloud for processing at a remote processor; wherein the ECU, based at least in part on processing of captured image data, prioritizes processing of a plurality of tasks, and wherein the plurality of tasks comprises a higher priority task and a lower priority task, and wherein the lower priority task has a lower priority than the higher priority task; wherein, responsive to prioritization by the ECU of the higher priority task, the vehicular driving assistance system (i) processes captured image data at the ECU for the higher priority task and (ii) uploads captured image data to the cloud for processing at the remote processor; and wherein processing of uploaded captured image data at the remote processor comprises at least one selected from the group consisting of (i) data negotiation, (ii) data collection, (iii) load analysis, (iv) load distribution and (v) monitoring. ### Claim 2 (depends on 1) The vehicular driving assistance system of claim 1, wherein processing of uploaded captured image data at the remote processor comprises processing of uploaded captured image data at a fog server. ### Claim 3 (depends on 2) The vehicular driving assistance system of claim 2, wherein processing of uploaded captured image data at the fog server comprises processing at a decentralized infrastructure that places storage and processing components at the edge of the cloud. ### Claim 4 (depends on 2) The vehicular driving assistance system of claim 2, wherein the cloud and fog server have a common platform. ### Claim 5 (depends on 1) The vehicular driving assistance system of claim 1, wherein the ECU determines underutilized processors of the vehicle and causes at least one underutilized processor of the determined underutilized processors to process data for the lower priority task. ### Claim 6 (depends on 1) The vehicular driving assistance system of claim 1, wherein the vehicular driving assistance system receives and processes data from the remote processor. ### Claim 7 (depends on 6) The vehicular driving assistance system of claim 6, wherein the vehicular driving assistance system utilizes artificial intelligence for data analysis in real-time. ### Claim 8 (depends on 1) The vehicular driving assistance system of claim 1, wherein the exterior viewing camera comprises a forward-viewing camera viewing at least forward of the vehicle, and wherein image data captured by the forward-viewing camera is processed at the ECU. ### Claim 9 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU to detect an object present exterior of the vehicle in a path of travel of the vehicle. ### Claim 10 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU for a collision avoidance system of the vehicle. ### Claim 11 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU for a headlamp control system of the vehicle. ### Claim 12 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU for a lane departure warning system of the vehicle. ### Claim 13 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU for a traffic sign recognition system of the vehicle. ### Claim 14 (depends on 8) The vehicular driving assistance system of claim 8, wherein image data captured by the forward-viewing camera is processed at the ECU for (i) a collision avoidance system of the vehicle, (ii) a headlamp control system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle. ### Claim 15 (depends on 1) The vehicular driving assistance system of claim 1, wherein the exterior viewing camera comprises a rearward-viewing camera viewing at least rearward of the vehicle, and wherein image data captured by the rearward-viewing camera is processed at the ECU to detect an object rearward of the vehicle. ### Claim 16 (depends on 1) The vehicular driving assistance system of claim 1, wherein the ECU and other processors of the vehicle communicate with one another via a communication network of the vehicle. ### Claim 17 A vehicular driving assistance system, the vehicular driving assistance system comprising: an exterior viewing camera disposed at a vehicle equipped with the vehicular driving assistance system and viewing exterior of the vehicle; wherein the exterior viewing camera comprises a forward-viewing camera disposed at a windshield of the vehicle and viewing at least forward of the vehicle through the windshield of the vehicle; wherein the exterior viewing camera comprises an imager having at least one million photosensor elements; an electronic control unit (ECU) disposed at the vehicle; wherein image data captured by the exterior viewing camera is provided to and is processed at the ECU; wherein the ECU performs processing tasks for multiple vehicle systems; wherein the vehicular driving assistance system is operable to wirelessly upload captured image data to the cloud for processing at a remote processor; wherein the ECU, based at least in part on processing of captured image data, prioritizes processing of a plurality of tasks, and wherein the plurality of tasks comprises a higher priority task and a lower priority task, and wherein the lower priority task has a lower priority than the higher priority task; wherein, responsive to prioritization by the ECU of the higher priority task, the vehicular driving assistance system (i) processes captured image data at the ECU for the higher priority task and (ii) uploads captured image data to the cloud for processing at the remote processor; wherein processing of uploaded captured image data at the remote processor comprises at least one selected from the group consisting of (i) data negotiation, (ii) data collection, (iii) load analysis, (iv) load distribution and (v) monitoring; and wherein the ECU determines underutilized processors of the vehicle and causes at least one underutilized processor of the determined underutilized processors to process data for the lower priority task. ### Claim 18 (depends on 17) The vehicular driving assistance system of claim 17, wherein processing of uploaded captured image data at the remote processor comprises processing of uploaded captured image data at a fog server. ### Claim 19 (depends on 18) The vehicular driving assistance system of claim 18, wherein processing of uploaded captured image data at the fog server comprises processing at a decentralized infrastructure that places storage and processing components at the edge of the cloud. ### Claim 20 (depends on 18) The vehicular driving assistance system of claim 18, wherein the cloud and fog server have a common platform. ### Claim 21 (depends on 17) The vehicular driving assistance system of claim 17, wherein the vehicular driving assistance system receives and processes data from the remote processor. ### Claim 22 (depends on 21) The vehicular driving assistance system of claim 21, wherein the vehicular driving assistance system utilizes artificial intelligence for data analysis in real-time. ### Claim 23 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU to detect an object present exterior of the vehicle in a path of travel of the vehicle. ### Claim 24 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU for a collision avoidance system of the vehicle. ### Claim 25 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU for a headlamp control system of the vehicle. ### Claim 26 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU for a lane departure warning system of the vehicle. ### Claim 27 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU for a traffic sign recognition system of the vehicle. ### Claim 28 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by the exterior viewing camera is processed at the ECU for (i) a collision avoidance system of the vehicle, (ii) a headlamp control system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle. ### Claim 29 (depends on 17) The vehicular driving assistance system of claim 17, wherein image data captured by a rearward-viewing camera disposed at the vehicle is processed at the ECU to detect an object rearward of the vehicle. ### Claim 30 (depends on 17) The vehicular driving assistance system of claim 17, wherein the ECU and other processors of the vehicle communicate with one another via a communication network of the vehicle. ### Claim 31 A vehicular driving assistance system, the vehicular driving assistance system comprising: an exterior viewing camera disposed at a vehicle equipped with the vehicular driving assistance system and viewing exterior of the vehicle; wherein the exterior viewing camera comprises a forward-viewing camera disposed at a windshield of the vehicle and viewing at least forward of the vehicle through the windshield of the vehicle; wherein the exterior viewing camera comprises an imager having at least one million photosensor elements; an electronic control unit (ECU) disposed at the vehicle; wherein image data captured by the exterior viewing camera is provided to and is processed at the ECU; wherein the ECU performs processing tasks for multiple vehicle systems; wherein the vehicular driving assistance system is operable to wirelessly upload captured image data to the cloud for processing at a remote processor; wherein the ECU, based at least in part on processing of captured image data, prioritizes processing of a plurality of tasks, and wherein the plurality of tasks comprises a higher priority task and a lower priority task, and wherein the lower priority task has a lower priority than the higher priority task; wherein, responsive to prioritization by the ECU of the higher priority task, the vehicular driving assistance system (i) processes captured image data at the ECU for the higher priority task and (ii) uploads captured image data to the cloud for processing at the remote processor; wherein image data captured by the exterior viewing camera is processed at the ECU for a headlamp control system of the vehicle; and wherein processing of uploaded captured image data at the remote processor comprises at least one selected from the group consisting of (i) data negotiation, (ii) data collection, (iii) load analysis, (iv) load distribution and (v) monitoring. ### Claim 32 (depends on 31) The vehicular driving assistance system of claim 31, wherein processing of uploaded captured image data at the remote processor comprises processing of uploaded captured image data at a fog server. ### Claim 33 (depends on 32) The vehicular driving assistance system of claim 32, wherein processing of uploaded captured image data at the fog server comprises processing at a decentralized infrastructure that places storage and processing components at the edge of the cloud. ### Claim 34 (depends on 32) The vehicular driving assistance system of claim 32, wherein the cloud and fog server have a common platform. ### Claim 35 (depends on 31) The vehicular driving assistance system of claim 31, wherein the ECU determines underutilized processors of the vehicle and causes at least one underutilized processor of the determined underutilized processors to process data for the lower priority task. ### Claim 36 (depends on 31) The vehicular driving assistance system of claim 31, wherein the vehicular driving assistance system receives and processes data from the remote processor. ### Claim 37 (depends on 31) The vehicular driving assistance system of claim 31, wherein the vehicular driving assistance system utilizes artificial intelligence for data analysis in real-time. ### Claim 38 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by the exterior viewing camera is processed at the ECU to detect an object present exterior of the vehicle in a path of travel of the vehicle. ### Claim 39 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by the exterior viewing camera is processed at the ECU for a collision avoidance system of the vehicle. ### Claim 40 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by the exterior viewing camera is processed at the ECU for a lane departure warning system of the vehicle. ### Claim 41 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by the exterior viewing camera is processed at the ECU for a traffic sign recognition system of the vehicle. ### Claim 42 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by the exterior viewing camera is processed at the ECU for (i) a collision avoidance system of the vehicle, (ii) a headlamp control system of the vehicle, (iii) a lane departure warning system of the vehicle and (iv) a traffic sign recognition system of the vehicle. ### Claim 43 (depends on 31) The vehicular driving assistance system of claim 31, wherein image data captured by a rearward-viewing camera disposed at the vehicle is processed at the ECU to detect an object rearward of the vehicle. ### Claim 44 (depends on 31) The vehicular driving assistance system of claim 31, wherein the ECU and other processors of the vehicle communicate with one another via a communication network of the vehicle.