# US 2022/0044681 A1 · Systems, methods, and storage media for performing actions based on utterance of a command

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0044681 A1
- Document ID: US20220044681A1
- Status: Published application
- Kind: A1
- Application number: 17/506,473
- Filed: 2021-10-20
- Published: 2022-02-10
- Earliest claimed: 2019-07-30
- Assignees: Suki Al, Inc.
- Applicants: Suki Al, Inc.
- Inventors: Sanket Agarwal
- Web page: https://patentgrep.com/patent/US20220044681A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 15/08: Speech classification or search
- G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30)
- G10L 15/1822: {Parsing for meaning understanding}
- G10L 2015/088: {Word spotting}
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Systems and methods for recognizing and executing spoken commands using speech recognition. Exemplary implementations may: store actionable phrases; obtain audio information representing sound captured by a mobile client computing platform associated with a user; detect any spoken instances of a predetermined keyword present in the sound represented by the audio information; perform speech recognition on the sound represented by the audio information; identify an utterance of an individual actionable phrase in speech temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information; perform natural language processing to identify an individual command uttered temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information; and effectuate performance of instructions corresponding to the command.

## Claims

### Claim 1

A system configured to recognize and execute spoken commands using speech recognition, the system comprising:
electronic storage media configured to store actionable phrases, individual actionable phrases correlating to individual commands, wherein the commands are used during documentation;
one or more processors configured by machine-readable instructions to:
obtain audio information representing sound captured by a mobile client computing platform associated with a user;
detect any spoken instances of a predetermined keyword present in the sound represented by the audio information;
perform speech recognition on the sound represented by the audio information;
responsive to detection of a spoken instance of the predetermined keyword present in the sound represented by the audio information, identify one or more utterances of actionable phrases in speech temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information;
responsive to detection of the spoken instance of the predetermined keyword present in the sound represented by the audio information and responsive to not identifying the one or more utterances of the actionable phrases in speech temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information, perform natural language processing to identify individual commands uttered temporally adjacent to the spoken instance of the predetermined keyword that is present in the sounds represented by the audio information; and
effectuate performance of instructions corresponding to the individual commands.

### Claim 2 (depends on 1)

The system of claim 1, wherein the one or more processors are further configured by machine-readable instructions to:
transmit the instructions to the mobile client computing device to cause the mobile client computing device to execute the individual commands.

### Claim 3 (depends on 1)

The system of claim 1, wherein the mobile client computing device includes one or more of a microphone, an audio encoder, a speaker, and/or a processor.

### Claim 4 (depends on 3)

The system of claim 3, wherein the one or more processors of the mobile client computing device are configured by machine-readable instructions to:
convert the sound represented by the audio information to digital signals, wherein the digital signals include noise;
filter the digital signals of the noise; and
effectuate the audio encoder to encode the digital signals to an audio file according to an audio file format.

### Claim 5 (depends on 1)

The system of claim 1, wherein the commands include taking a note, opening a file, reciting information, setting a calendar date, sending information, and/or sending requests.

### Claim 6

A method configured to recognize and execute spoken commands using speech recognition, the method comprising:
storing actionable phrases, individual actionable phrases correlating to individual commands, wherein the commands are used during documentation;
obtaining audio information representing sound captured by a mobile client computing platform associated with a user;
detecting any spoken instances of a predetermined keyword present in the sound represented by the audio information;
performing speech recognition on the sound represented by the audio information;
responsive to detection of a spoken instance of the predetermined keyword present in the sound represented by the audio information, identifying one or more utterances of actionable phrases in speech temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information;
responsive to detection of the spoken instance of the predetermined keyword present in the sound represented by the audio information and responsive to not identifying the one or more utterances of the actionable phrases in speech temporally adjacent to the spoken instance of the predetermined keyword that is present in the sound represented by the audio information, performing natural language processing to identify individual commands uttered temporally adjacent to the spoken instance of the predetermined keyword that is present in the sounds represented by the audio information; and
effectuating performance of instructions corresponding to the individual commands.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
transmitting the instructions to the mobile client computing device to cause the mobile client computing device to execute the individual commands.

### Claim 8 (depends on 6)

The method of claim 6, wherein the mobile client computing device includes one or more of a microphone, an audio encoder, a speaker, and/or a processor.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
converting the sound represented by the audio information to digital signals, wherein the digital signals include noise;
filtering the digital signals of the noise; and
effectuating the audio encoder to encode the digital signals to an audio file according to an audio file format.

### Claim 10 (depends on 6)

The method of claim 6, wherein the commands include taking a note, opening a file, reciting information, setting a calendar date, sending information, and/or sending requests.
