# US 10,764,536 B2 · System and method for a dynamic human machine interface for video conferencing in a vehicle > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,764,536 B2 - Document ID: US10764536B2 - Status: Granted - Kind: B2 - Application number: 16/233,253 - Filed: 2018-12-27 - Published: 2020-07-02 - Granted: 2020-09-01 - Earliest claimed: 2018-12-27 - Assignees: DENSO International America, Inc. - Applicants: DENSO International America, Inc. - Inventors: Yu Zhang; Bilal Alasry; Te-Ping Kang; Vikas Upmanue; Jordan Necovski; Sean Bleicher; Doua Vang; Eleanor Duke; Nicholaus Spunar - Web page: https://patentgrep.com/patent/US10764536B2 ## CPC - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/152: {Multipoint control units therefor} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60K 35/85: Arrangements for transferring vehicle- or driver-related data - G06V 20/593: {Recognising seat occupancy} - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - G06V 40/70: Multimodal biometrics, e.g. combining information from different biometric modalities - H04N 7/15: Conference systems - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 2360/164: Infotainment - B60K 2360/165: Videos and animations - B60K 2360/168: Target or limit values - B60K 2360/186: Displaying information according to relevancy - B60K 2360/334: Projection means - B60K 2360/589: Wireless data transfers - B60W 2540/22: Psychological state; Stress level or workload - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT ## Abstract A system in a vehicle comprising one or more sensors configured to obtain cognitive-load data indicating a cognitive load of an occupant of the vehicle, a controller in communication with the one or more sensors, wherein the controller is configured to determine a cognitive load of the occupant utilizing at least the cognitive-load data in response to an initiation of a video conference session, and output on a vehicle display a first user interface in connection with the video conference session when the cognitive load exceeds a threshold and a second user interface in connection with the video conference session when the cognitive load is below a threshold, wherein the second user interface includes video of the video conference session and the first user interface excludes video of the video conference session. ## Claims ### Claim 1 A system in a vehicle, comprising: one or more sensors configured to obtain cognitive-load data indicating a cognitive load and cognitive demand of an occupant of the vehicle; a wireless transceiver in communication with a mobile phone; a controller in communication with the one or more sensors and the wireless transceiver, wherein the controller is configured to: determine an initiation of a video conference session on the mobile phone; determine a cognitive load of the occupant utilizing at least the cognitive-load data in response to the video conference session initiation; and output on a vehicle display a first user interface in connection with the video conference session when the cognitive load exceeds a threshold and a second user interface in connection with the video conference session when the cognitive load is below the threshold, wherein the first and second user interface are different. ### Claim 2 (depends on 1) The system of claim 1, wherein the first user interface includes less textual information than the second user interface. ### Claim 3 (depends on 1) The system of claim 1, wherein the first user interface excludes video images of the video conference session and the second user interface includes video images of the video conference session. ### Claim 4 (depends on 1) The system of claim 1, wherein the controller is further configured to obtain user profile information from the mobile phone via the wireless transceiver and adjust the threshold in response to the user profile information. ### Claim 5 (depends on 1) The system of claim 1, wherein the one or more sensors includes an in-vehicle camera that is configured to monitor movement of the occupant and utilize information associated with the movement of the occupant to determine the cognitive load. ### Claim 6 (depends on 1) The system of claim 1, wherein the controller is further configured to obtain user profile information from a key-fob associated with an occupant of the vehicle and adjust the threshold in response to the user profile information. ### Claim 7 (depends on 1) The system of claim 1, wherein the system further includes a camera configured to capture images of the occupant of a vehicle; and utilize the images of the occupant in the video conference session. ### Claim 8 (depends on 7) The system of claim 7, wherein the images of the occupant in the video conference session are shown in the second user interface. ### Claim 9 (depends on 1) The system of claim 1, wherein the first user interface does not include video imagery from the video conference session and the second user interface includes video imagery from the video conference session. ### Claim 10 A system in a vehicle, comprising: one or more sensors configured to obtain cognitive-load data indicating a cognitive load and cognitive demand of an occupant of the vehicle; a controller in communication with the one or more sensors, wherein the controller is configured to: determine a cognitive load of the occupant utilizing at least the cognitive-load data in response to an initiation of a video conference session; and output on a vehicle display a first user interface in connection with the video conference session when the cognitive load exceeds a threshold and a second user interface in connection with the video conference session when the cognitive load is below a threshold, wherein the second user interface includes video of the video conference session and the first user interface excludes video of the video conference session. ### Claim 11 (depends on 10) The system of claim 10, wherein the controller is further configured to obtain user profile information from a key-fob associated with an occupant of the vehicle and adjust the threshold in response to the user profile information. ### Claim 12 (depends on 10) The system of claim 10, wherein the first user interface includes less textual information than the second user interface. ### Claim 13 (depends on 10) The system of claim 10, wherein the controller is further configured to obtain user profile information from a mobile phone via a wireless transceiver in communication with the controller and adjust the threshold in response to the user profile information. ### Claim 14 (depends on 10) The system of claim 10, wherein the one or more sensors includes an in-vehicle camera that is configured to monitor movement of the occupant and utilize information associated with the movement of the occupant to determine the cognitive load.