# US 11,114,089 B2 · Customizing a voice-based interface using surrounding factors

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,114,089 B2
- Document ID: US11114089B2
- Status: Granted
- Kind: B2
- Application number: 16/194,613
- Filed: 2018-11-19
- Published: 2020-05-21
- Granted: 2021-09-07
- Earliest claimed: 2018-11-19
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Matthew Chapman; Chengxuan Xing; Andrew J. Daniel; Ashley Harrison
- Web page: https://patentgrep.com/patent/US11114089B2

## CPC

- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G10L 15/07: to the speaker
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence)
- G10L 25/48: specially adapted for particular use
- G10L 2015/228: {of application context}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A method, system, and computer program product for applying a profile to an assistive device based on a multitude of cues includes: gathering audio inputs surrounding an assistive device; analyzing, by the assistive device, the audio inputs; determining, based on the analyzing, scenario cues; classifying a current environment surrounding the assistive device from the scenario cues; comparing the current environment to device profiles of the assistive device; determining, based on the comparing, a matching profile; and, in response to determining the matching profile, executing the matching profile on the assistive device.

## Claims

### Claim 1

A computer-implemented method comprising:
gathering audio inputs surrounding an assistive device;
analyzing, by the assistive device, the audio inputs;
determining, based on the analyzing, scenario cues, wherein determining the scenario cues comprises:
determining whether the audio inputs include known voices and unknown voices;
assigning weights to each scenario cue to indicate their importance;
classifying a current environment surrounding the assistive device from the scenario cues and the assigned weights;
comparing the current environment to device profiles of the assistive device;
determining, based on the comparing, a matching profile, the matching profile including privacy settings, wherein the matching profile is determined based on whether the audio inputs include the known voices or the unknown voices and based on the assigned weights of each scenario cue; and
in response to determining the matching profile, executing the matching profile on the assistive device.

### Claim 2 (depends on 1)

The method of claim 1, wherein determining the matching profile includes selecting a device profile from the device profiles that is most similar to the current environment.

### Claim 3 (depends on 2)

The method of claim 2, wherein the matching profile is a current profile.

### Claim 4 (depends on 2)

The method of claim 2, wherein the matching profile is a device profile different from a current profile.

### Claim 5 (depends on 1)

The method of claim 1, wherein scenario cues include at least known or unknown voices.

### Claim 6 (depends on 5)

The method of claim 5, wherein classifying the current environment includes determining that there are scenario cues of unknown voices.

### Claim 7 (depends on 6)

The method of claim 6, wherein the matching profile is a profile that withholds personal information.

### Claim 8 (depends on 1)

The method of claim 1, wherein the device profiles are set up by a user of the assistive device.

### Claim 9 (depends on 1)

The method of claim 1, further comprising:
in response to executing the matching profile, receiving a request from a user to change a factor of the matching profile; and
executing a different device profile that includes the changed factor.

### Claim 10 (depends on 1)

The method of claim 1, further comprising:
in response to executing the matching profile, receiving a request from a user to change a factor of the matching profile; and
creating a new device profile using the matching profile and the changed factor.

### Claim 11 (depends on 1)

The method of claim 1, wherein scenario cues include at least one of utensil sounds and appliance noises.

### Claim 12

A system having one or more computer processors, the system configured to:
gather audio inputs surrounding an assistive device;
analyze, by the assistive device, the audio inputs;
determine, based on the analyzing, scenario cues, wherein determining the scenario cues comprises:
determining whether the audio inputs include known voices and unknown voices;
assign weights to each scenario cue to indicate their importance;
classify a current environment surrounding the assistive device from the scenario cues and the assigned weights;
compare the current environment to device profiles of the assistive device;
determine, based on the comparing, a matching profile, the matching profile including privacy settings, wherein the matching profile is determined based on whether the audio inputs include the known voices or the unknown voices and based on the assigned weights of each scenario cue; and
in response to determining the matching profile, execute the matching profile on the assistive device.

### Claim 13 (depends on 12)

The system of claim 12, wherein determining the matching profile includes selecting a device profile from the device profiles that is most similar to the current environment.

### Claim 14 (depends on 13)

The system of claim 13, wherein the matching profile is a current profile.

### Claim 15 (depends on 13)

The system of claim 13, wherein the matching profile is a device profile different from a current profile.

### Claim 16 (depends on 12)

The system of claim 12, further comprising:
in response to executing the matching profile, receive a request from a user to change a factor of the matching profile; and
execute a different device profile that includes the changed factor.

### Claim 17 (depends on 12)

The system of claim 12, further comprising:
in response to executing the matching profile, receive a request from a user to change a factor of the matching profile; and
create a new device profile using the matching profile and the changed factor.

### Claim 18

A computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a server to cause the server to perform a method, the method comprising:
gathering audio inputs surrounding an assistive device;
analyzing, by the assistive device, the audio inputs;
determining, based on the analyzing, scenario cues, wherein determining the scenario cues comprises:
determining whether the audio inputs include known voices and unknown voices;
assigning weights to each scenario cue to indicate their importance;
classifying a current environment surrounding the assistive device from the scenario cues and the assigned weights;
comparing the current environment to device profiles of the assistive device;
determining, based on the comparing, a matching profile, the matching profile including privacy settings, wherein the matching profile is determined based on whether the audio inputs include the known voices or the unknown voices and based on the assigned weights of each scenario cue; and
in response to determining the matching profile, executing the matching profile on the assistive device.

### Claim 19 (depends on 18)

The computer program product of claim 18, wherein determining the matching profile includes selecting a device profile from the device profiles that is most similar to the current environment.

### Claim 20 (depends on 18)

The computer program product of claim 18, further comprising:
in response to executing the matching profile, receiving a request from a user to change a factor of the matching profile; and
executing a different device profile that includes the changed factor.