# US 2019/0172453 A1 · Seamless advisor engagement > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0172453 A1 - Document ID: US20190172453A1 - Status: Published application - Kind: A1 - Application number: 15/833,126 - Filed: 2017-12-06 - Published: 2019-06-06 - Earliest claimed: 2017-12-06 - Assignees: GM Global Technology Operations LLC - Applicants: GM Global Technology Operations LLC - Inventors: Xu Fang Zhao; Cody R. Hansen; Dustin H. Smith; Gaurav Talwar - Web page: https://patentgrep.com/patent/US20190172453A1 ## CPC - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G06F 16/24578: {using ranking} - G06F 16/955: using information identifiers, e.g. uniform resource locators [URL] - G10L 15/08: Speech classification or search - B60R 16/0373: {Voice control (in general G10L)} - G01C 21/3608: {using speech input, e.g. using speech recognition} - G10L 15/01: Assessment or evaluation of speech recognition systems - G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) - G10L 2015/223: {Execution procedure of a spoken command} - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) ## Abstract In various embodiments, methods, systems, and vehicles are provided. The system includes a microphone and a processor. The microphone is configured to obtain a request from a user. The processor is configured to at least facilitate automatically generating an interpretation of the request; automatically determining an automated processing recognition score for the request; and automatically engaging a human advisor to further process the request, based on the determined automated processing recognition score. ## Claims ### Claim 1 A method comprising: obtaining, via a microphone, a request from a user; automatically generating, via a processor, an interpretation of the request; automatically determining, via the processor, an automated processing recognition score for the request; and automatically engaging, via instructions provided by the processor, a human advisor to further process the request, based on the determined automated processing recognition score. ### Claim 2 (depends on 1) The method of claim 1, further comprising: automatically providing the request and the interpretation, via instructions provided by the processor, to the human advisor for further processing. ### Claim 3 (depends on 1) The method of claim 1, further comprising: automatically providing initial information pertaining to the interpretation to the user via instructions provided by the processor; and receiving feedback from the user regarding the initial information; wherein the step of automatically determining the automated processing recognition score comprises automatically determining the automated processing recognition score using the feedback. ### Claim 4 (depends on 3) The method of claim 3, further comprising: automatically determining that engagement of the human advisor is required if the feedback comprises the user repeating the request. ### Claim 5 (depends on 1) The method of claim 1, further comprising: automatically obtaining, via one or more additional sensors, sensor data pertaining to one or more surrounding conditions for the user; wherein the step of automatically determining the automated processing recognition score comprises automatically determining the automated processing recognition score based on the one or more surrounding conditions. ### Claim 6 (depends on 5) The method of claim 5, further comprising: automatically determining that engagement of the human advisor is required if the one or more surrounding conditions represent noise that is greater than a predetermined threshold. ### Claim 7 (depends on 1) The method of claim 1, further comprising: automatically retrieving, from a memory, a database of user information; wherein the step of automatically generating the interpretation comprises automatically generating the interpretation using the user information; and the method further comprises: obtaining a revised interpretation from the human advisor; and updating the database of user information based on the revised interpretation. ### Claim 8 (depends on 1) The method of claim 1, wherein the steps are implemented at least in part as part of a computer system for a vehicle in which the user is occupied. ### Claim 9 A system comprising: a microphone configured to obtain a request from a user; and a processor configured to at least facilitate: automatically generating an interpretation of the request; automatically determining an automated processing recognition score for the request; and automatically engaging a human advisor to further process the request, based on the determined automated processing recognition score. ### Claim 10 (depends on 9) The system of claim 9, wherein the processor is further configured to at least facilitate: automatically providing instructions to provide the request and the interpretation to the human advisor for further processing. ### Claim 11 (depends on 9) The system of claim 9, wherein: the processor is further configured to at least facilitate automatically providing instructions to providing initial information pertaining to the interpretation to the user; the microphone is further configured to receive feedback from the user regarding the initial information; and the processor is further configured to at least facilitate automatically determining the automated processing recognition score using the feedback. ### Claim 12 (depends on 11) The system of claim 11, wherein the processor is further configured to at least facilitate automatically determining that engagement of the human advisor is required if the feedback comprises the user repeating the request. ### Claim 13 (depends on 9) The system of claim 9, further comprising: one or more additional sensors configured to at least facilitate automatically obtaining sensor data pertaining to one or more surrounding conditions for the user; wherein the processor is further configured to at least facilitate automatically determining the automated processing recognition score based on the one or more surrounding conditions. ### Claim 14 (depends on 13) The system of claim 13, wherein the processor is further configured to at least facilitate automatically determining that engagement of the human advisor is required if the one or more surrounding conditions represent noise that is greater than a predetermined threshold. ### Claim 15 (depends on 9) The system of claim 9, further comprising: a memory configured to store a database of user information; wherein the processor is further configured to at least facilitate: automatically retrieving, from the memory, the database of user information; automatically generating the interpretation using the user information; obtaining a revised interpretation from the human advisor; and updating the database of user information based on the revised interpretation. ### Claim 16 (depends on 9) The system of claim 9, wherein the system at least in part is implemented as part of a computer system for a vehicle in which the user is occupied. ### Claim 17 A vehicle comprising: a passenger compartment for a user; a microphone configured to obtain a request from the user; and a processor configured to at least facilitate: automatically generating an interpretation of the request; automatically determining an automated processing recognition score for the request; and automatically engaging a human advisor to further process the request, based on the determined automated processing recognition score. ### Claim 18 (depends on 17) The vehicle of claim 17, wherein: the processor is further configured to at least facilitate automatically providing instructions to providing initial information pertaining to the interpretation to the user; the microphone is further configured to receive feedback from the user regarding the initial information; and the processor is further configured to at least facilitate: automatically determining the automated processing recognition score using the feedback; and automatically determining that engagement of the human advisor is required if the feedback comprises the user repeating the request. ### Claim 19 (depends on 17) The vehicle of claim 17, further comprising: one or more additional sensors configured to at least facilitate automatically obtaining sensor data pertaining to one or more surrounding conditions for the user; wherein the processor is further configured to at least facilitate: automatically determining the automated processing recognition score based on the one or more surrounding conditions; and automatically determining that engagement of the human advisor is required if the one or more surrounding conditions represent noise that is greater than a predetermined threshold. ### Claim 20 (depends on 17) The vehicle of claim 17, further comprising: a memory configured to store a database of user information; wherein the processor is further configured to at least facilitate: automatically retrieving, from the memory, the database of user information; automatically generating the interpretation using the user information; obtaining a revised interpretation from the human advisor; and updating the database of user information based on the revised interpretation.