Back to results
US 11,908,475 B1Granted
Systems, methods and non-transitory computer readable media for human interface device accessibility
AssigneeCephable Inc.
InventorAlexander Dunn
Life of this patent
Estimating the term…
Abstract
A method, system, and non-transitory computer readable media for converting input from a user into a human interface device (HID) output to cause a corresponding action at an mapped device includes receiving one or more user input from a user at an input device, analyzing the user input selecting a command from a command profile that maps at least one of the received user inputs to one or more mapped tasks, executing the one or more mapped tasks associated with the selected command, and causing one or more corresponding actions at one or more mapped devices associated with the one or more mapped tasks.
Claims16
A method comprising:
- receiving, by a computing device, audio data, wherein the audio data comprises speech of a user and other audio;
- isolating, by the computing device, speech of the user from the audio data;
- identifying, by the computing device, at least one of a one or more vowel sound and a diphthong in the isolated speech of the user;
- analyzing, by the computing device, the isolated speech of the user and generating a plurality of predictions, wherein each prediction of the plurality of predictions comprises at least one of a word and a phrase in the isolated speech of the user;
- performing, by the computing device, a post processing on the plurality of predictions and generating a plurality of processed predictions based on the plurality of predictions, wherein performing the post processing on the plurality of predictions and generating a plurality of processed predictions based on the plurality of predictions comprises:
- comparing, by the computing device, at least one word and phrase of the plurality of predictions to one or more relative words and phrases in a word-phrase graph;
- calculating, by the computing device, a correction score for at least one prediction of the plurality of predictions and at least one relative word and phrase of the one or more relative words and phrases;
- determining, by the computing device, whether the correction score exceeds a threshold correction score;
- and
- generating, by the computing device, a processed prediction,
- wherein the processed prediction comprises the at least one relative word and phrase used to calculate the correction score if the correction score exceeds the threshold correction score, and
- wherein the processed prediction comprises the at least one prediction used to calculate the correction score if the correction score does not exceed the threshold correction score;
- selecting, by the computing device, a first command in a command profile, the first command defining a user input comprising at least one of the vowel sound and the diphthong identified in the isolated speech of the user and the one or more processed predictions of the plurality of processed predictions, wherein a command comprises at least one user input mapped to at least one mapped task associated with a mapped device and to be executed by the computing device;
- executing, by the computing device, the at least one mapped task of the first command;
- and
- causing, by the computing device, at least one corresponding action at the mapped device associated with the one or more mapped tasks of the first command
- wherein a correction score is calculated according to:
- R
-
- W
- -
- D
- L
-
- W
- -
- D
- +
- T
- F
- ≥
- H
- wherein RW represents a weight of the relative word or phrase,
- LW represents a weight of the word or phrase of the at least one prediction,
- D represents a phonetic distance between the relative word and the word or phrase of the at least one prediction,
- F represents a total number of times the word or phrase of the at least one prediction has been detected in previous iterations of post processing,
- T represents a number of transitions made from the word or phrase of the at least one prediction to the relative word or phrase, and
- H represents the threshold correction value.
35 more elements
One or more non-transitory computer readable media comprising instructions that, when executed by a computing system, cause the computing system to:
- receive audio data, wherein the audio data comprises speech of a user and other audio;
- isolate the speech of the user from the audio data;
- identify at least one of one or more vowel sounds and a diphthong in the isolated speech of the user;
- analyze the isolated speech of the user and generate a plurality of predictions, wherein each prediction of the plurality of predictions comprises at least one of a word and a phrase in the isolated speech of the user;
- perform a post processing on the plurality of predictions and generate a plurality of processed predictions based on the plurality of predictions, wherein the instructions that, when executed by the computing system, cause the computing system to perform the post processing on the plurality of predictions and generate the processed prediction comprise instructions that cause the computing system to:
- compare the at least one word and phrase of the plurality of predictions to one or more relative words and phrases in a word-phrase graph;
- calculate a correction score for at least one prediction of the plurality of predictions and at least one relative word and phrase of the one or more relative words and phrases;
- determine whether the correction score exceeds a threshold correction score;
- and
- generating a processed prediction,
- wherein the processed prediction comprises the at least one relative word and phrase used to calculate the correction score if the correction score exceeds the threshold correction score, and
- wherein the processed prediction comprises the at least one at least one prediction used to calculate the correction score if the correction score does not exceed the threshold correction score;
- select a first command in a command profile, the first command defining a user input comprising at least one of the one or more vowel sounds and the diphthong identified in the isolated speech of the user and the one or more processed predictions of the plurality of processed predictions, wherein a command comprises a user input mapped to at least one mapped task associated with a mapped device;
- execute the at least one mapped task of the first command;
- and
- cause at least one corresponding action at the mapped device associated with the at least one mapped tasks of the first command,
- wherein the word-phrase graph comprises:
- a plurality of word-phrase nodes corresponding to each relative word or phrase of the one or more relative words or phrases, wherein each word-phrase node comprises:
- a phonetic representation of the corresponding relative word or phrase;
- one or more phonetic components of the corresponding relative word or phrase;
- a syllable count of the corresponding relative word or phrase;
- a weighting value;
- a session frequency reflecting a number of times the corresponding relative word or phrase has been detected in a particular session;
- a total frequency reflecting a number of times the corresponding relative word or phrase has been detected in previous interactions of the post processing;
- and
- an average frequency reflecting an average number of times the corresponding relative word or phrase is detected in the particular session;
- and
- a plurality of edges connecting pairs of word-phrase nodes of the plurality of word-phrase nodes, wherein each edge of the plurality of edges comprises:
- a number of phonetic parts shared by a pair of each word-phrase node of the pair of word-phrase nodes connected by each edge, and a number of transitions.
26 more elements
A system comprising:
- one or more processors;
- and
- at least one memory operatively coupled to the processor and storing instructions that, when executed by at least one processor of the one or more processors, cause the system to:
- receive audio data, wherein the audio data comprises speech of a user and other audio;
- isolate the speech of the user from the audio data;
- identify at least one of one or more vowel sounds and a diphthong in the isolated speech of the user;
- analyze the isolated speech of the user and generate a plurality of predictions, wherein each prediction of the plurality of predictions comprises at least one of a word and a phrase in the isolated speech of the user;
- perform a post processing on the plurality of predictions and generate a plurality of processed predictions based on the plurality of predictions;
- calculate a correction score for at least one prediction of the plurality of predictions and at least one relative word and phrase of the one or more relative words and phrases;
- select a first command in a command profile, the first command defining a user input comprising at least one of the one or more vowel sounds and the diphthong identified in the isolated speech of the user and the one or more processed predictions of the plurality of processed predictions, wherein a command comprises a user input mapped to at least one mapped task associated with a mapped device;
- execute the at least one mapped task of the first command;
- and
- cause at least one corresponding action at the mapped device associated with the at least one mapped tasks of the first command,
- wherein the correction score is calculated according to:
- R
-
- W
- -
- D
- L
-
- W
- -
- D
- +
- T
- F
- ≥
- H
- wherein RW represents a weight of the relative word or phrase,
- LW represents a weight of the word or phrase of the at least one prediction,
- D represents a phonetic distance between the relative word and the word or phrase of the at least one prediction,
- F represents a total number of times the word or phrase of the at least one prediction has been detected in previous iterations of the post processing,
- T represents a number of transitions made from the word or phrase of the at least one prediction to the relative word or phrase, and
- H represents the threshold correction score.
32 more elements
Dependencies are inferred from the claim text.