Smart travel companion

A system for providing intention-based infotainment within a vehicle, comprising:

• a system controller in communication with a plurality of onboard sensors within the vehicle and adapted to:
• collect data related to intentions of an occupant within the vehicle;
• develop a request based on the data related to the intentions of the occupant within the vehicle;
• collect data from the plurality of onboard sensors related to the request;
• receive, via a wireless communication module, data from remote sources related to the request;
• formulate, with a large language model (LLM) in communication with the system controller, via the wireless communication module, a response;
• and
• actuate systems within the vehicle to automatically:
• provide, via a human machine interface (HMI), infotainment content for the occupant within the vehicle;
• and
• control, via an automated driving assistance system (ADAS), operation of the vehicle.

A vehicle having a system for providing intention-based infotainment, the system comprising:

• a system controller in communication with a plurality of onboard sensors within the vehicle and adapted to:
• collect data related to intentions of an occupant within the vehicle, wherein the system controller is adapted to at least one of:
• collect, with an occupant monitoring system data related to what the occupant is looking at, gestures made by the occupant, and facial expressions of the occupant;
• collect, with the HMI, verbal expressions made by the occupant and manual data input from the occupant;
• and
• access, with a machine learning model, stored data within a database related to past occurrences of the occupant using the vehicle;
• develop a request based on the data related to the intentions of the occupant within the vehicle, wherein the system controller is adapted to:
• detect one of triggering language from the occupant, via the HMI, or a triggering event, via the plurality of onboard sensors;
• predict, with the machine learning model, intentions of the occupant based on the data stored within the database;
• analyze, with the LLM, the data related to the intentions of the occupant within the vehicle;
• identify, with the machine learning model and the LLM, key terms and qualifier terms;
• and
• quantify, using the LLM, the machine learning model, real time data collected by the plurality of onboard sensors and data received from remote sources, the key terms and qualifier terms;
• collect data from the plurality of onboard sensors related to the request and receive, via a wireless communication module, data from remote sources related to the request, wherein the system controller is adapted to:
• identify a geographic area within which relevant data related to the request will be collected;
• collect relevant data related to the request within the geographic area;
• identify, using the machine learning model, unspecified key terms and unspecified qualifier terms, related to the request and not included within the request;
• identify an extended geographic area within which relevant data related to the request, including unspecified key terms and unspecified qualifier terms, will be collected;
• collect relevant data related to the request within the extended geographic area;
• and
• filter the collected data based on the key terms, qualifier terms, unspecified key terms and unspecified qualifier terms;
• formulate, with the LLM in communication with the system controller, via the wireless communication module, a response;
• and
• actuate systems within the vehicle to automatically:
• provide, via the HMI, infotainment content for the occupant within the vehicle;
• and
• control, via an automated driving assistance system (ADAS), operation of the vehicle.