# US 10,871,942 B2 · Audio command interface for a multimedia device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,871,942 B2 - Document ID: US10871942B2 - Status: Granted - Kind: B2 - Application number: 16/103,487 - Filed: 2018-08-14 - Published: 2019-05-02 - Granted: 2020-12-22 - Earliest claimed: 2015-08-31 - Assignees: Roku, Inc. - Applicants: Roku, Inc. - Inventors: Frank Llewellyn Maker, III - Web page: https://patentgrep.com/patent/US10871942B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/42222: {Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application} - H04N 21/64322: {IP} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract System, method, and computer product embodiments for processing audio commands are described. A multimedia device receives a digitized audio sequence from a control device. The digitized audio sequence is associated with a display command for controlling a display device. Then, the digitized audio sequence is converted into an audio signature that corresponds to the digitized audio sequence. The multimedia device sends the audio signature to a platform server configured to use the audio signature to process the display command. After, the multimedia device receives content information from the platform server resulting from processing the display command. Then, the multimedia device causes the display device to provide media content related to the content information. ## Claims ### Claim 1 A method, comprising: downloading, by a mobile device, an audio command application; enabling, by the audio command application, an identifier to be accessible as an audio command; receiving, by the mobile device, a confirmation message; converting, responsive to receiving the confirmation message, the identifier into a digitized audio sequence, wherein converting the identifier comprises determining, using an association table, a mapping between information in the identifier to the digitized audio sequence; activating, responsive to receiving the confirmation message, an audio sensor of the mobile device; issuing, by a speaker of the mobile device, the digitized audio sequence; detecting, by the audio sensor, the digitized audio sequence; and extracting, by the audio sensor, the audio command from the digitized audio sequence. ### Claim 2 (depends on 1) The method of claim 1, wherein the audio command application is a plug-in for a content-accessing application stored on the mobile device. ### Claim 3 (depends on 2) The method of claim 2, wherein the content-accessing application includes a messaging application or a browser application. ### Claim 4 (depends on 1) The method of claim 1, further comprising: queuing, by the audio command application, the audio command for later transmission. ### Claim 5 (depends on 1) The method of claim 1, further comprising: forwarding, by the mobile device, the audio command to a multimedia device. ### Claim 6 (depends on 1) The method of claim 1, wherein the mapping is between at least one ASCII character in the identifier and a sub-sequence of the digitized audio sequence. ### Claim 7 (depends on 1) The method of claim 1, further comprising: storing, after the extracting, the audio command in a playlist of audio commands; and transmitting the playlist of audio commands to a multimedia device. ### Claim 8 A system, comprising: a mobile device including a memory, a wireless network interface, and a processor configured to: download, by the mobile device, an audio command application; enable, by the audio command application, an identifier to be accessible as an audio command; receive, by the mobile device, a confirmation message; convert, responsive to receiving the confirmation message, the identifier into a digitized audio sequence, wherein converting the identifier comprises determining, using an association table, a mapping between information in the identifier to the digitized audio sequence; activate, responsive to receiving the confirmation message, an audio sensor of the mobile device; issue, by a speaker of the mobile device, the digitized audio sequence; detect, by the audio sensor, the digitized audio sequence; and extract, by the audio sensor, the audio command from the digitized audio sequence. ### Claim 9 (depends on 8) The system of claim 8, wherein the audio command application is a plug-in for a content-accessing application stored on the mobile device. ### Claim 10 (depends on 9) The system of claim 9, wherein the content-accessing application includes a messaging application or a browser application. ### Claim 11 (depends on 8) The system of claim 8, the mobile device further configured to: queue, by the audio command application, the audio command for later transmission. ### Claim 12 (depends on 8) The system of claim 8, the mobile device further configured to: forward, by the mobile device, the audio command to a multimedia device. ### Claim 13 (depends on 8) The system of claim 8 wherein the mapping is between at least one ASCII character in the identifier and a sub-sequence of the digitized audio sequence. ### Claim 14 (depends on 8) The system of claim 8, the processor further configured to: store, after the extracting, the audio command in a playlist of audio commands; and transmit the playlist of audio commands to a multimedia device. ### Claim 15 A non-transitory computer-readable device having instructions stored thereon that, when executed by at least one computing device, cause the at least one computing device to perform operations comprising: downloading, by a mobile device, an audio command application; enabling, by the audio command application, an identifier to be accessible as an audio command; receiving, by the mobile device, a confirmation message; converting, responsive to receiving the confirmation message, the identifier into a digitized audio sequence, wherein converting the identifier comprises determining, using an association table, a mapping between information in the identifier to the digitized audio sequence; activating, responsive to receiving the confirmation message, an audio sensor of the mobile device; issuing, by the mobile device, the digitized audio sequence; detecting, by the audio sensor, the digitized audio sequence; and extracting, by the audio sensor, the audio command from the digitized audio sequence. ### Claim 16 (depends on 15) The non-transitory computer-readable device of claim 15, wherein the audio command application is a plug-in for a content-accessing application stored on the mobile device. ### Claim 17 (depends on 16) The non-transitory computer-readable device of claim 16, wherein the content-accessing application includes a messaging application or a browser application. ### Claim 18 (depends on 15) The non-transitory computer-readable device of claim 15, further comprising: forwarding, by the mobile device, the audio command to a multimedia device. ### Claim 19 (depends on 15) The non-transitory computer-readable device of claim 15, wherein the mapping is between at least one ASCII character in the identifier and a sub-sequence of the digitized audio sequence. ### Claim 20 (depends on 15) The non-transitory computer-readable device of claim 15, the operations further comprising: storing, after the extracting, the audio command in a playlist of audio commands; and transmitting the playlist of audio commands to a multimedia device.