# US 12,001,536 B1 · Input/output privacy tool > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,536 B1 - Document ID: US12001536B1 - Status: Granted - Kind: B1 - Application number: 17/806,389 - Filed: 2022-06-10 - Granted: 2024-06-04 - Earliest claimed: 2017-09-15 - Assignees: Wells Fargo Bank, N.A. - Applicants: Wells Fargo Bank, N.A. - Inventors: Tambra Nichols; Teresa Lynn Rench; Jonathan Austin Hartsell; John C. Brenner; Christopher James Williams - Web page: https://patentgrep.com/patent/US12001536B1 ## CPC - G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes} - G06F 21/84: output devices, e.g. displays or monitors - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 17/00: Speaker identification or verification techniques - G10L 17/06: Decision making techniques; Pattern matching strategies - G10L 17/22: Interactive procedures; Man-machine interfaces - H04L 63/083: {using passwords (cryptographic mechanisms or cryptographic arrangements for entity authentication using a predetermined code H04L9/3226)} - H04L 63/0861: {using biometrical features, e.g. fingerprint, retina-scan (cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231)} - H04L 63/105: {Multiple levels of security} - H04W 12/06: Authentication - H04W 12/08: Access security - H04W 12/30: Security of mobile devices; Security of mobile applications - H04W 12/63: Location-dependent; Proximity-dependent - G10L 2015/223: {Execution procedure of a spoken command} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Various examples described herein are directed to systems and methods for managing an interface between a user and a user computing device. The user computing device may determine that an audio sensor in communication with the user computing device indicates a first command in a user voice of the user, where the first command instructs the user computing device to perform a first task. The user computing device may determine that the audio sensor also indicates a first ambient voice different than the user voice and match the first ambient voice to a first known voice. The user computing device may determine that a second computing device associated with the first known voice is within a threshold distance of the user computing device and select a first privacy level for the first task based at least in part on the first known voice. ## Claims ### Claim 1 A user computing device programmed to interface with a user, the user computing device comprising at least one processor unit and a data storage device comprising instructions thereon that, when executed by the at least one processor unit, cause the user computing device to perform operations comprising: receiving a signal from an audio sensor in communication with the user computing device; determining that the signal indicates a first human voice, the first human voice being of a user associated with the user computing device; determining that the signal also indicates a second human voice, the second human voice being different than the first human voice; determining that the second human voice does not match any voice in a set of known human voices; determining that the second human voice has been detected more than a threshold number of times: responsive to determining that the second human voice has been detected more than the threshold number of times, prompting the user to provide a privacy level for the second human voice; determining that the audio sensor indicates a first command in the first human voice and also indicates the second human voice, the first command instructing the user computing device to perform a first task; executing the first task at the privacy level for the second human voice; determining that the audio sensor indicates a third human voice different than the first human voice and the second human voice; determining that the third human voice does not match any voice in the set of known human voices; and incrementing a record indicating a number of times that the third human voice is detected. ### Claim 2 (depends on 1) The user computing device of claim 1, further comprising, adding the second human voice to the set of known human voices. ### Claim 3 (depends on 1) The user computing device of claim 1, the determining that the second human voice has been detected more than the threshold number of times comprising determining that stored data describing ambient human voices that were not matched to one of the set of known human voices describes the second human voice more than the threshold number of times. ### Claim 4 (depends on 1) The user computing device of claim 1, the determining that the second human voice has been detected more than the threshold number of times comprising determining that the second human voice has been detected more than the threshold number of times in a first time period. ### Claim 5 (depends on 1) The user computing device of claim 1, the operations further comprising, before prompting the user to provide the privacy level for the second human voice, causing an audio output device of the user computing device to play a sample of the second human voice to the user. ### Claim 6 (depends on 1) The user computing device of claim 1, the operations further comprising: sending an indication of the second human voice to a provider system; receiving, from the provider system, identity data describing the second human voice; and before prompting the user to provide the privacy level for the second human voice, providing the identity data describing the second human voice to the user. ### Claim 7 (depends on 1) The user computing device of claim 1, the operations further comprising: determining that the audio sensor indicates a third human voice different than the first human voice; determining that the audio sensor indicates a second command in the first human voice, wherein the second command instructs the user computing device to perform a second task; determining that a second computing device associated with the third human voice is within a threshold distance of the user computing device; after determining that the second computing device associated with the third human voice is within the threshold distance of the user computing device, selecting a privacy level for the second task based at least in part on the second human voice; and executing the second task at the privacy level for the second task. ### Claim 8 (depends on 7) The user computing device of claim 7, the operations further comprising: determining that the audio sensor indicates a third command in the first human voice, wherein the third command instructs the user computing device to perform a third task; determining that the audio sensor also indicates the third human voice; determining that the second computing device is not detected within the threshold distance of the user computing device; and after determining that the second computing device is not detected within the threshold distance of the user computing device, executing the third task at a privacy level for the third task that is less private than the privacy level for the second task. ### Claim 9 (depends on 1) The user computing device of claim 1, the operations further comprising: determining that a personal audio device is connected to the user computing device; and before executing the first task at the privacy level for the second human voice, modifying the privacy level for the second human voice based at least in part on the determining that the personal audio device is connected to the user computing device. ### Claim 10 A computer-implemented method for interfacing a user computing device with a user, the computer-implemented method comprising: receiving, by a user computing device, a signal from an audio sensor in communication with the user computing device; determining that the signal indicates a first human voice, the first human voice being of a user associated with the user computing device; determining that the signal also indicates a second human voice, the second human voice being different than the first human voice; determining, by the user computing device, that the second human voice does not match any voice in a set of known human voices; determining, by the user computing device, that the second human voice has been detected more than a threshold number of times; responsive to determining that the second human voice has been detected more than the threshold number of times, prompting, by the user computing device, the user to provide a privacy level for the second human voice; determining, by the user computing device, that the audio sensor indicates a first command in the first human voice and also indicates the second human voice, the first command instructing the user computing device to perform a first task; executing the first task, by the user computing device, at the privacy level for the second human voice; determining, by the user computing device, that the audio sensor indicates a third human voice different than the first human voice and the second human voice; determining, by the user computing device, that the third human voice does not match any voice in the set of known human voices; and incrementing, by the user computing device, a record indicating a number of times that the third human voice is detected. ### Claim 11 (depends on 10) The computer-implemented method of claim 10, further comprising, adding, by the user computing device, the second human voice to the set of known human voices. ### Claim 12 (depends on 10) The computer-implemented method of claim 10, the determining that the second human voice has been detected more than the threshold number of times comprising determining that stored data describing ambient human voices that were not matched to one of the set of known human voices describes the second human voice more than the threshold number of times. ### Claim 13 (depends on 10) The computer-implemented method of claim 10, the determining that the second human voice has been detected more than the threshold number of times comprising determining that the second human voice has been detected more than the threshold number of times in a first time period. ### Claim 14 (depends on 10) The computer-implemented method of claim 10, further comprising, before prompting the user to provide the privacy level for the second human voice, causing an audio output device of the user computing device to play a sample of the second human voice to the user. ### Claim 15 (depends on 10) The computer-implemented method of claim 10, further comprising: sending, by the user computing device, an indication of the second human voice to a provider system; receiving, from the provider system, identity data describing the second human voice; and before prompting the user to provide the privacy level for the second human voice, providing the identity data describing the second human voice by the user computing device to the user. ### Claim 16 (depends on 10) The computer-implemented method of claim 10, further comprising: determining, by the user computing device, that the audio sensor indicates a third human voice different than the first human voice; determining, by the user computing device, that the audio sensor indicates a second command in the first human voice, wherein the second command instructs the user computing device to perform a second task; determining, by the user computing device, that a second computing device associated with the third human voice is within a threshold distance of the user computing device; after determining that the second computing device associated with the third human voice is within the threshold distance of the user computing device, selecting, by the user computing device, a second privacy level for the second task based at least in part on the second human voice; and executing the second task at the second privacy level. ### Claim 17 (depends on 16) The computer-implemented method of claim 16, further comprising: determining, by the user computing device, that the audio sensor indicates a third command in the first human voice, wherein the third command instructs the user computing device to perform a third task; determining, by the user computing device, that the audio sensor also indicates the third human voice; determining, by the user computing device, that the second computing device is not detected within the threshold distance of the user computing device; and after determining that the second computing device is not detected within the threshold distance of the user computing device, executing the third task, by the user computing device, at a privacy level for the third task that is less private than the privacy level for the second task. ### Claim 18 A non-transitory computer-readable medium comprising instructions thereon that, when executed by at least one processor, causes the at least one processor to perform operations comprising: receiving a signal from an audio sensor in communication with the at least one processor; determining that the signal indicates a first human voice, the first human voice being of a user associated with the at least one processor; determining that the signal also indicates a second human voice, the second human voice being different than the first human voice; determining that the second human voice does not match any human voice in a set of known human voices; determining that the second human voice has been detected more than a threshold number of times; responsive to determining that the second human voice has been detected more than the threshold number of times, prompting the user to provide a privacy level for the second human voice; determining that the audio sensor indicates a first command in the first human voice and also indicates the second human voice, the first command instructing the at least one processor to perform a first task; executing the first task at the privacy level for the second human voice; determining that the audio sensor indicates a third human voice different than the first human voice and the second human voice; determining that the third human voice does not match any voice in the set of known human voices; and incrementing a record indicating a number of times that the third human voice is detected.