# US 2019/0172468 A1 · Conversational challenge-response system for enhanced security in voice only devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0172468 A1
- Document ID: US20190172468A1
- Status: Published application
- Kind: A1
- Application number: 15/832,162
- Filed: 2017-12-05
- Published: 2019-06-06
- Earliest claimed: 2017-12-05
- Assignees: International Business Machines Corporation
- Applicants: International Business Machines Corporation
- Inventors: Mohit Jain; Pratyush Kumar
- Web page: https://patentgrep.com/patent/US20190172468A1

## CPC

- G10L 17/24: the user being prompted to utter a password or a predefined phrase
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

One embodiment provides a method, including: receiving user voice input comprising a user command to perform an action; determining whether the user command comprises a high risk command or a low risk command; providing a first audible query and a second audible query, wherein the first audible query and the second audible query are related to a verification request for verifying that the user voice input is provided by a user and wherein an answer corresponding to one of the first audible query and the second audible query is stored in a system; receiving a first voice answer input responsive to the first audible query and a second voice answer input responsive to the second audible query; and performing, responsive to determining that at least one of the first voice answer input and the second voice answer input matches the answer stored in the system, the action.

## Claims

### Claim 1

A method, comprising:
utilizing at least one processor to execute computer code that performs the steps of:
receiving, at a voice-enabled information handling device, voice input from a user, the voice input comprising a user command for the information handling device to perform an action;
determining whether the user command corresponds to a high risk command or a low risk command;
providing, responsive to determining that the user input corresponds to a high risk command, a first audible query and a second audible query, one of the queries corresponding to a verification request and the other of the queries corresponding to training a verification system for verification of at least one user;
receiving a first voice answer input responsive to the first audible query and a second voice answer input responsive to the second audible query; and
performing, responsive to determining that at least one of the first voice answer input and the second voice answer input matches an answer that (i) is stored in the verification system and (ii) corresponds to the verification request, the action of the user command.

### Claim 2 (depends on 1)

The method of claim 1, wherein the information handling device is a voice-only information handling device without a display.

### Claim 3 (depends on 1)

The method of claim 1, wherein the determining comprises (i) comparing the user command to a list of high-risk commands stored in a database and (ii) determining whether the user command matches at least one high-risk command in the list.

### Claim 4 (depends on 1)

The method of claim 1, wherein one of the first audible query and the second audible query is associated with a Must Answer Question (MAQ), and the other of the first audible query and the second audible query is associated with a Good To Answer Question (GTAQ).

### Claim 5 (depends on 4)

The method of claim 4, wherein the MAQ comprises the query corresponding to the verification request, wherein the verification request has a corresponding answer stored in the system.

### Claim 6 (depends on 5)

The method of claim 5, responsive to determining that the voice answer input corresponding to the MAQ matches the answer stored in the system, storing the received answer input associated with the GTAQ in a database, wherein the database comprises answer inputs provided by other users to the GTAQ.

### Claim 7 (depends on 6)

The method of claim 6, further comprising adding the GTAQ into a MAQ bank responsive to receiving a predetermined number of answer inputs associated with the GTAQ.

### Claim 8 (depends on 1)

The method of claim 1,wherein the determining that the at least one of the first voice answer input and the second voice answer input matches the answer comprises using, for the determination, an automatic dialog feature analyzer (ADFA) capable of being dynamically updated responsive to the voice answer inputs.

### Claim 9 (depends on 1)

The method of claim 1, wherein at least one of the first audible query and the second audible query comprise a request to recite a statement in a particular tone.

### Claim 10 (depends on 1)

The method of claim 1, wherein the providing comprises providing a statement prior to provision of the first audible query and the second audible query, and wherein at least one of the first audible query and the second audible query relate to the provided statement.

### Claim 11

An apparatus, comprising:
at least one processor; and
a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising:
computer readable program code that receives at, a voice-enabled information handling device, voice input from a user, the voice input comprising a user command for the information handling device to perform an action;
computer readable program code that determines whether the user command corresponds to a high risk command or a low risk command;
computer readable program code that provides, responsive to determining that the user input corresponds to a high risk command, a first audible query and a second audible query, one of the queries corresponding to a verification request and the other of the queries corresponding to training a verification system for verification of at least one user;
computer readable program code that receives a first voice answer input responsive to the first audible query and a second voice answer input responsive to the second audible query; and
computer readable program code that performs, responsive to determining that at least one of the first voice answer input and the second voice answer input matches an answer that (i) is stored in the verification system and (ii) corresponds to the verification request, the action of the user command.

### Claim 12

A computer program product, comprising:
a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising:
computer readable program code that receives at, a voice-enabled information handling device, voice input from a user, the voice input comprising a user command for the information handling device to perform an action;
computer readable program code that determines whether the user command corresponds to a high risk command or a low risk command;
computer readable program code that provides, responsive to determining that the user input corresponds to a high risk command, a first audible query and a second audible query, one of the queries corresponding to a verification request and the other of the queries corresponding to training a verification system for verification of at least one user;
computer readable program code that receives a first voice answer input responsive to the first audible query and a second voice answer input responsive to the second audible query; and
computer readable program code that performs, responsive to determining that at least one of the first voice answer input and the second voice answer input matches an answer that (i) is stored in the verification system and (ii) corresponds to the verification request, the action of the user command.

### Claim 13 (depends on 12)

The computer program product of claim 12, wherein the information handling device is a voice-only information handling device without a display.

### Claim 14 (depends on 12)

The computer program product of claim 12, wherein the determining comprises (i) comparing the user command to a list of high-risk commands stored in a database and (ii) determining whether the user command matches at least one high-risk command in the list.

### Claim 15 (depends on 12)

The computer program product of claim 12, wherein one of the first audible query and the second audible query is associated with a Must Answer Question (MAQ), and the other of the first audible query and the second audible query is associated with a Good To Answer Question (GTAQ).

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein the MAQ comprises the query corresponding to the verification request, wherein the verification request has a corresponding answer stored in the system.

### Claim 17 (depends on 16)

The computer program product of claim 16, responsive to determining that the voice answer input corresponding to the MAQ matches the answer stored in the system, storing the received answer input associated with the GTAQ in a database, wherein the database comprises answer inputs provided by other users to the GTAQ.

### Claim 18 (depends on 17)

The computer program product of claim 17, further comprising adding the GTAQ into a MAQ bank responsive to receiving a predetermined number of answer inputs associated with the GTAQ.

### Claim 19 (depends on 12)

The computer program product of claim 12, wherein the providing comprises providing a statement prior to provision of the first audible query and the second audible query, and wherein at least one of the first audible query and the second audible query relate to the provided statement.

### Claim 20

A method, comprising:
utilizing at least one processor to execute computer code that performs the steps of:
receiving user command input initiating a multi-turn interactive challenge session with a digital assistant, wherein the multi-turn interactive challenge session comprises provision of at least one audible output query and receipt of at least one audible answer input corresponding to the at least one audible output query; and
performing an action corresponding to the user command input responsive to determining that the at least one audible answer input matches an answer corresponding to the at least on audible output query.
