# US 12,223,034 B2 · Secure voice interface in a streaming media device to avoid vulnerability attacks > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,034 B2 - Document ID: US12223034B2 - Status: Granted - Kind: B2 - Application number: 17/476,622 - Filed: 2021-09-16 - Published: 2022-04-28 - Granted: 2025-02-11 - Earliest claimed: 2020-10-27 - Assignees: ARRIS Enterprises LLC - Applicants: ARRIS Enterprises LLC - Inventors: Vinod Jatti; Remesh Kousalya Sugunan - Web page: https://patentgrep.com/patent/US12223034B2 ## CPC - G06F 21/53: by executing in a restricted environment, e.g. sandbox or secure virtual machine - G06F 21/602: {Providing cryptographic facilities or services} - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/30: Distributed recognition, e.g. in client-server systems, for mobile phones or network applications - G10L 2015/223: {Execution procedure of a spoken command} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract An apparatus, method, and computer-readable recording medium receives secure voice commands by an application executing within a smart media device while attached to the Internet. A controller of a smart media device activates an application within the smart media device, determines whether or not the application uses secure voice commands, and when the smart media device determines that the application uses secure voice commands, performs the following: enables the trusted execution environment to receive and decrypt the encrypted audio data and generate application commands corresponding to processing decrypted voice commands, receives, by the application, application commands corresponding to processing decrypted voice commands, and performs the application commands. ## Claims ### Claim 1 A smart media device for secure voice commands to an application executing within the smart media device while attached to the Internet, the Internet communicatively interconnects the smart media device with a remote voice-speech server and one or more content servers, the smart media device comprising: a secure microphone input for accepting audio data containing voice commands and providing encrypted audio data using a pre-stored encryption key; a trusted execution environment configured to decrypt the encrypted audio data from the secure microphone input; a memory having instructions stored thereon; and a processor configured to execute one or more instructions on the memory to cause the smart media device to: based on a determination that the application uses secure voice commands and the remote voice-speech server, perform the following: within the trusted execution environment: receive and decrypt the encrypted audio data; send the decrypted audio data to the remote voice-speech server for processing so as to cause the remote voice-speech server to generate one or more application commands; receive, by the application, the one or more application commands; and perform, by the application, the one or more application commands; and based on a determination that the secure voice commands are not to be processed by the remote voice-speech server, perform the following: receive the encrypted audio data in the trusted execution environment; receive and decrypt, within the trusted execution environment, the encrypted audio data; generate, within the trusted environment, one or more other application commands corresponding to processing decrypted voice commands; receive, by the application, the one or more other application commands; and perform, by the application, the one or more other application commands. ### Claim 2 (depends on 1) The smart media device according to claim 1, wherein the smart media device utilizes a user-controlled setting to enable use of the secure voice commands. ### Claim 3 (depends on 1) The smart media device according to claim 1, wherein the secure microphone input and the trusted execution environment use the pre-stored encryption key pre-stored into the smart media device at time of manufacture. ### Claim 4 (depends on 1) The smart media device according to claim 1, wherein the processor is further configured to execute additional instructions to: based on determining that the application does not use secure voice commands, perform the following instructions: enable the secure microphone input to transmit voice data to a voice service environment, the voice service environment configured to execute the instructions on the memory by the processor to: receive voice data from the secure microphone input; generate the one or more other application commands from the voice data; and send the one or more other application commands to the application. ### Claim 5 (depends on 1) The smart media device according to claim 1, wherein the processor is further configured to execute additional instructions to: based on a determining that the application does not use secure voice commands, perform the following instructions: enable the secure microphone input to transmit voice data; and send the voice data to the application. ### Claim 6 A method for receiving secure voice commands by an application executing within a smart media device while attached to the Internet, the Internet communicatively interconnecting the smart media device with a remote voice-speech server and one or more content servers, the smart media device having a secure microphone input for accepting audio data containing voice commands and providing encrypted audio data using a pre-stored encryption key and a trusted execution environment for decrypting the encrypted audio data from the secure microphone input, the method comprising: based on determining that the application uses secure voice commands and the remote voice-speech server, performing the following: enabling the trusted execution environment to receive and decrypt the encrypted audio data; sending the decrypted audio data to the remote voice-speech server for processing so as to cause the remote voice-speech server to generate one or more application commands; receiving, by the application, the one or more application commands; and performing, by the application, the one or more application commands; and based on determining that the secure voice commands are not to be processed by the remote voice-speech server, perform the following: receiving the encrypted audio data in the trusted execution environment; receiving and decrypt, within the trusted execution environment, the encrypted audio data; generating, within the trusted environment, one or more other application commands corresponding to processing decrypted voice commands; receiving, by the application, the one or more other application commands; and performing, by the application, the one or more other application commands. ### Claim 7 (depends on 6) The method according to claim 6, wherein the smart media device utilizes a user-controlled setting to enable use of the secure voice commands. ### Claim 8 (depends on 6) The method according to claim 6, wherein the secure microphone input and the trusted execution environment use the pre-stored encryption key pre-stored into the smart media device at time of manufacture. ### Claim 9 (depends on 6) The method according to claim 6, wherein the method further comprises: based on determining that the application does not use secure voice commands, performing the following: enabling the secure microphone input to transmit voice data to a voice service environment, the voice service environment performing the following: receiving voice data from the secure microphone input; generating the one or more other application commands from the voice data; and sending the one or more other application commands to the application. ### Claim 10 (depends on 6) The method according to claim 6, wherein the method further comprises: based on determining that the application does not use secure voice commands, performing the following instructions: enabling the secure microphone input to transmit voice data; and sending the voice data to the application. ### Claim 11 A non-transitory computer-readable recording medium in a smart media for receiving secure voice commands by an application executing within the smart media device while attached to the Internet, the Internet communicatively interconnects the smart media device with a remote voice-speech server and one or more content servers, the smart media device having a secure microphone input for accepting audio data containing voice commands and providing encrypted audio data using a pre-stored encryption key and a trusted execution environment for decrypting the encrypted audio data from the secure microphone input, the non-transitory computer-readable recording medium storing one or more programs which when executed by a controller of the smart media device performs a method comprising: based on determining that the application uses secure voice commands and the remote voice-speech server, performing the following: enabling the trusted execution environment to receive and decrypt the encrypted audio data; sending the decrypted audio data to the remote voice-speech server for processing so as to cause the remote voice-speech server to generate one or more application commands; receiving, by the application, the one or more application commands; and performing, by the application, the one or more application commands; and in response to determining that the secure voice commands are not to be processed by the remote voice-speech server, performing the following: enabling the trusted execution environment to receive the encrypted audio data; receiving and decrypting, by the trusted execution environment, the encrypted audio data; generating the one or more other application commands corresponding to processing decrypted voice commands, by the trusted execution environment; receiving, by the application, the one or more other application commands; and performing, by the application, the one or more other application commands. ### Claim 12 (depends on 11) The computer-readable recording medium according to claim 11, wherein: the smart media device utilizes a user-controlled setting to enable use of the secure voice commands; and the secure microphone input and the trusted execution environment use the pre-stored encryption key pre-stored into the smart media device at time of manufacture. ### Claim 13 (depends on 11) The computer-readable recording medium according to claim 11, wherein the method further comprises: based on determining that the application does not use secure voice commands, performing the following instructions: enabling the secure microphone input to transmit a clear voice data to a voice service environment, the voice service environment performing the following: receiving the clear voice data from the secure microphone input; generating the one or more other application commands from the clear voice data; and sending the application commands to the application. ### Claim 14 (depends on 11) The computer-readable recording medium according to claim 11, wherein the method comprises: based on determining that the application does not use secure voice commands, performing the following instructions: enabling the secure microphone input to transmit voice data; and sending the voice data to the application.