# US 11,445,235 B2 · Determining context to initiate interactivity > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,445,235 B2 - Document ID: US11445235B2 - Status: Granted - Kind: B2 - Application number: 15/791,936 - Filed: 2017-10-24 - Published: 2019-04-25 - Granted: 2022-09-13 - Earliest claimed: 2017-10-24 - Assignees: Comcast Cable Communications, LLC - Applicants: Comcast Cable Communications, LLC - Inventors: Samuel Schwartz - Web page: https://patentgrep.com/patent/US11445235B2 ## CPC - H04N 21/42203: {sound input device, e.g. microphone} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/472: End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content {(end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods and systems are disclosed for executing a voice command based on and association of the voice command and one or more identifiers. Audio data associated with a content asset may be received at a user device such as a voice activated device. A voice command may also be received at the user device. One or more identifiers associated with the audio data, such as a content or product identifier, may be determined. The identifiers may be determined based on playback of the content asset or may be received in response to a request generated by the user device. One or more operations capable of being executed by the user device may be determined and initiated or executed by the user device based on the one or more identifiers and the received voice command. ## Claims ### Claim 1 A method comprising: receiving, at a device, a voice command; determining a time associated with the voice command and a type of identifier associated with the voice command; sending, to another device, a request for one or more identifiers that are each associated with a time within a time period before the time associated with the voice command and with the type of identifier associated with the voice command; receiving, from the another device, an indication of the one or more identifiers associated with the time within the time period and with the type of identifier; selecting, by the device, one identifier of the one or more identifiers that is associated with a time closest to the time associated with the voice command; determining, based on the voice command and the one identifier, an operation to be performed; and initiating, by the device, execution of the operation. ### Claim 2 (depends on 1) The method of claim 1, wherein the voice command comprises one or more keywords capable of being recognized by the device. ### Claim 3 (depends on 1) The method of claim 1, wherein the one or more identifiers comprise at least one of a unique program identifier, a content identifier or an audio watermark. ### Claim 4 (depends on 1) The method of claim 1, wherein the device is an always-on voice activated device. ### Claim 5 (depends on 1) The method of claim 1, wherein the another device is a playback device. ### Claim 6 (depends on 1) The method of claim 1, wherein selecting the one identifier of the one or more identifiers comprises: outputting the one or more identifiers; and receiving an indication of selection of the one identifier. ### Claim 7 (depends on 1) The method of claim 1, wherein receiving the indication of the one or more identifiers comprises receiving the indication of the one or more identifiers that were received during the time period before the time associated with the voice command. ### Claim 8 (depends on 1) The method of claim 1, wherein determining the operation to be performed comprises receiving a confirmation of the operation to be performed. ### Claim 9 (depends on 1) The method of claim 1, wherein the one or more identifiers are based on continuous recording of audio during the time period. ### Claim 10 (depends on 1) The method of claim 1, wherein the type of identifier associated with the voice command is a type associated with an object or a type associated with content. ### Claim 11 A method comprising: receiving, at a device and from a content playback device, audio data associated with a content asset; receiving, at the device and from a user, a voice command; determining a time associated with the voice command and a type of identifier associated with the voice command; sending a request for one or more identifiers that are each associated with a time within a time period before the time associated with the voice command and with the type of identifier associated with the voice command; receiving an indication of the one or more identifiers associated with the time within the time period and with the type of identifier; selecting, by the device, one identifier of the one or more identifiers that is associated with a time closest to the time associated with the voice command; determining, based on the voice command and the one identifier, an operation to be performed; and initiating, by the device, execution of the operation. ### Claim 12 (depends on 11) The method of claim 11, wherein the device is a voice-activated device. ### Claim 13 (depends on 12) The method of claim 12, wherein the voice command comprises one or more keywords capable of being recognized by the device. ### Claim 14 (depends on 11) The method of claim 11, wherein the one or more identifiers comprise at least one of a unique program identifier, a content identifier, or an audio watermark. ### Claim 15 (depends on 11) The method of claim 11, further comprising generating an audio output indicative of the operation to be performed. ### Claim 16 (depends on 11) The method of claim 11, wherein: sending the request for the one or more identifiers comprises sending, to the content playback device, the request for the one or more identifiers; and receiving the indication of the one or more identifiers comprises receiving, from the content playback device, the indication of the one or more identifiers. ### Claim 17 (depends on 11) The method of claim 11, wherein selecting the one identifier of the one or more identifiers comprises: outputting the one or more identifiers; and receiving an indication of selection of the one identifier. ### Claim 18 (depends on 11) The method of claim 11, wherein receiving the indication of the one or more identifiers comprises receiving the indication of the one or more identifiers that were received during the time period before the time associated with the voice command. ### Claim 19 (depends on 11) The method of claim 11, wherein determining the operation to be performed comprises receiving a confirmation of the operation to be performed. ### Claim 20 (depends on 11) The method of claim 11, wherein the type of identifier associated with the voice command is a type associated with an object or a type associated with content. ### Claim 21 A method comprising: receiving, at a device, a plurality of identifiers associated with audio data; receiving, at the device and from another device, a voice command; determining a time associated with the voice command and a type of identifier associated with the voice command; selecting, by the device and based on the time associated with the voice command, one identifier of the plurality of identifiers that is received at a time within a time period before the time associated with the voice command, wherein the one identifier of the plurality of identifiers is associated with the type of identifier associated with the voice command and is associated with a time closest to the time associated with the voice command; determining, based on the voice command and the one identifier, an operation to be performed; and initiating, by the device, execution of the operation. ### Claim 22 (depends on 21) The method of claim 21, wherein the plurality of identifiers associated with the audio data are received from a playback device. ### Claim 23 (depends on 21) The method of claim 21, wherein the plurality of identifiers comprise at least one of a unique program identifier, a content identifier or an audio watermark. ### Claim 24 (depends on 21) The method of claim 21, wherein the device is a voice activated device. ### Claim 25 (depends on 21) The method of claim 21, wherein the voice command comprises one or more keywords capable of being recognized by the device. ### Claim 26 (depends on 21) The method of claim 21, wherein determining the operation to be performed comprises receiving a confirmation of the operation to be performed. ### Claim 27 (depends on 21) The method of claim 21, wherein the type of identifier associated with the voice command is a type associated with an object or a type associated with content.