# US 2017/0286785 A1 · Interactive display based on interpreting driver actions > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0286785 A1 - Document ID: US20170286785A1 - Status: Published application - Kind: A1 - Application number: 15/091,340 - Filed: 2016-04-05 - Published: 2017-10-05 - Earliest claimed: 2016-04-05 - Assignees: Ford Global Technologies, LLC - Applicants: Ford Global Technologies, LLC - Inventors: Daniel Mark Schaffer; Kenneth James Miller; Filip Tomik - Web page: https://patentgrep.com/patent/US20170286785A1 ## CPC - G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - B60K 2360/146: Instrument input by gesture - B60K 2360/161: Explanation of functions, e.g. instructions - G06V 40/28: {Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113)} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Systems and methods for an interactive display based on interpreting driver actions are disclosed. An example disclosed vehicle includes a camera, a microphone, and a vehicle assist unit. The example vehicle assist unit is configured to in response to detecting a request for information regarding a subsystem of the vehicle via at least one of the camera or the microphone, display information about the subsystem at a first level of detail, and in response to detecting a request for more information regarding the subsystem, display information about the subsystem at second level of detail. ## Claims ### Claim 1 A vehicle comprising: a camera; a microphone; and a vehicle assist unit configured to: in response to detecting a request for information regarding a subsystem of the vehicle via at least one of the camera or the microphone, display information about the subsystem at a first level of detail; and in response to detecting a request for more information regarding the subsystem, display information about the subsystem at second level of detail. ### Claim 2 (depends on 1) The vehicle of claim 1, wherein to detect the request for information regarding the subsystem of the vehicle, the vehicle assist unit is configured to track, with the camera, a hand of a driver of the vehicle. ### Claim 3 (depends on 2) The vehicle of claim 2, wherein vehicle assist unit is configured to detect the request for information regarding the subsystem when the hand is proximate to a control of the subsystem for a threshold period of time. ### Claim 4 (depends on 2) The vehicle of claim 2, wherein vehicle assist unit is configured to detect the request for information regarding the subsystem when the hand approaches a control of the subsystem a threshold number of times in a period of time. ### Claim 5 (depends on 2) The vehicle of claim 2, wherein vehicle assist unit is configured to: receive, via the microphone, a prompt phrase spoken by an occupant of the vehicle; and detect the request for information regarding the subsystem when the hand is proximate a control of the subsystem and the vehicle assist unit receives the prompt phrase. ### Claim 6 (depends on 1) The vehicle of claim 1, wherein the information about the subsystem at the first level of detail includes is stored in memory of the vehicle assist unit. ### Claim 7 (depends on 6) The vehicle of claim 6, wherein the information about the subsystem at the first level of detail includes contents of a user's manual for the vehicle. ### Claim 8 (depends on 1) The vehicle of claim 1, wherein the information about the subsystem at the second level of detail includes is stored by a server remote from the vehicle. ### Claim 9 (depends on 8) The vehicle of claim 8, wherein the information about the subsystem at the second level of detail includes at least one of a video, real-time compiled information based on customer comments to call centers, a summary of dealer technical comments, and compiled online user comments. ### Claim 10 A method comprising: in response to detecting a request for information regarding a subsystem of a vehicle via at least one of a camera or a microphone, displaying, on a center console display of the vehicle, information about the subsystem at a first level of detail; and in response to detecting a request for more information regarding the subsystem, displaying, on the center console display of the vehicle, information about the subsystem at second level of detail. ### Claim 11 (depends on 10) The vehicle of claim 10, wherein to detect the request for information regarding the subsystem of the vehicle, tracking, with the camera, a hand of a driver of the vehicle. ### Claim 12 (depends on 11) The vehicle of claim 11, including detecting the request for information regarding the subsystem when the hand is proximate a control of the subsystem for a threshold period of time. ### Claim 13 (depends on 11) The vehicle of claim 11, including detecting the request for information regarding the subsystem when the hand approaches a control of the subsystem a threshold number of times in a period of time. ### Claim 14 (depends on 11) The vehicle of claim 11, including: receiving, via the microphone, a prompt phrase spoken by an occupant of the vehicle; and detecting the request for information regarding the subsystem when the hand is proximate a control of the subsystem and the vehicle assist unit receives the prompt phrase. ### Claim 15 (depends on 10) The vehicle of claim 10, wherein the information about the subsystem at the first level of detail includes is stored in memory of the vehicle assist unit. ### Claim 16 (depends on 15) The vehicle of claim 15, wherein the information about the subsystem at the first level of detail includes contents of a user's manual for the vehicle. ### Claim 17 (depends on 10) The vehicle of claim 10, wherein the information about the subsystem at the second level of detail includes is stored by a server remote from the vehicle. ### Claim 18 (depends on 17) The vehicle of claim 17, wherein the information about the subsystem at the second level of detail includes at least one of a video, real-time compiled information based on customer comments to call centers, a summary of dealer technical comments, and compiled online user comments. ### Claim 19 A tangible computer readable medium comprising instructions that, when executed, cause a vehicle to: in response to detecting a request for information regarding a subsystem of a vehicle via at least one of a camera or a microphone, display, on a center console display of the vehicle, information about the subsystem at a first level of detail; and in response to detecting a request for more information regarding the subsystem, display, on the center console display of the vehicle, information about the subsystem at second level of detail.