# US 12,596,525 B2 · Method to determine intended direction of a vocal command and target for vocal interaction > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,596,525 B2 - Document ID: US12596525B2 - Status: Granted - Kind: B2 - Application number: 18/534,033 - Filed: 2023-12-08 - Published: 2024-03-28 - Granted: 2026-04-07 - Earliest claimed: 2018-04-18 - Assignees: Comcast Cable Communications, LLC - Applicants: Comcast Cable Communications, LLC - Inventors: Mark David Francisco - Web page: https://patentgrep.com/patent/US12596525B2 ## CPC - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G02B 27/017: {Head mounted} - G06F 3/012: {Head tracking input arrangements} - H04R 1/406: {microphones} - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Systems and methods are described for recognizing and responding to commands in a virtual or physical environment. A system may receive voice data and determine an intended command. The system may then determine a position and viewpoint orientation of the user to be able to determine one or more digital assets associated with the user. The system may then determine a current state associated with each digital asset of the one or more digital assets to be able to determine at least one digital asset that is configured to process the command. The system can then apply the command to at least a first digital asset of the at least one digital asset that is configured to process the command. ## Claims ### Claim 1 A method comprising: receiving voice data associated with a user; determining that the voice data comprises a command; determining one or more devices capable of handling the command; outputting a different sensory pattern to each device of the one or more devices; receiving, from a user device, an indication of a first detected sensory pattern; determining a first device of the one or more devices that is associated with the first detected sensory pattern; and applying the command to the first device. ### Claim 2 (depends on 1) The method of claim 1, wherein the one or more devices are configured to communicate with a smart hub. ### Claim 3 (depends on 1) The method of claim 1, wherein the determining the one or more devices capable of handling the command comprises determining the one or more devices are each in a state that does not conflict with the command. ### Claim 4 (depends on 1) The method of claim 1, wherein the first detected sensory pattern comprises at least one of: flashes of light, a displayed image, or a tone. ### Claim 5 (depends on 1) The method of claim 1, wherein the first detected sensory pattern is imperceptible to the user. ### Claim 6 (depends on 1) The method of claim 1, wherein each of the different sensory patterns output to the one or more devices is unique in time to each other sensory pattern. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving, from the user device, a second detected sensory pattern, wherein the second detected sensory pattern is associated with a second device of the one or more devices different from the first device; determining the first detected sensory pattern has a higher intensity than the second detected sensory pattern; and determining, based on the higher intensity, to apply the command to the first device. ### Claim 8 (depends on 1) The method of claim 1, wherein the user device comprises one or more microphones for vocal interaction with the user and at least one of: a laptop; a television; a smartphone; a tablet; a desktop; an augmented reality headset; a virtual reality headset; or a device capable of presenting content to a user. ### Claim 9 (depends on 1) The method of claim 1, wherein the one or more devices comprise one or more of: a light; a lamp; a television; a monitor; a speaker; or an interactive device. ### Claim 10 A method comprising: receiving, by a user device, voice data from a user, wherein the voice data comprises a command; sending, to a computing device, the voice data; causing, based on the sending the voice data, output of a different sensory pattern to each of one or more devices capable of handling the command; detecting, by the user device and from a first device of the one or more devices, a first sensory pattern; sending, by the user device and to the computing device, an indication of the first detected sensory pattern. ### Claim 11 (depends on 10) The method of claim 10, wherein the one or more devices are configured to communicate with a smart hub. ### Claim 12 (depends on 10) The method of claim 10, wherein the one or more devices capable of handling the command are each in a state that does not conflict with the command. ### Claim 13 (depends on 10) The method of claim 10, wherein the first detected sensory pattern comprises at least one of: flashes of light, a displayed image, and a tone. ### Claim 14 (depends on 10) The method of claim 10, wherein the first detected sensory pattern is imperceptible to the user. ### Claim 15 (depends on 10) The method of claim 10, wherein each of the different sensory patterns output to the one or more devices is unique in time to each other sensory pattern. ### Claim 16 (depends on 10) The method of claim 10, further comprising: detecting, by the user device and from a second device of the one or more devices, a second sensory pattern; and sending, by the user device and to the computing device, an indication of the second detected sensory pattern. ### Claim 17 (depends on 10) The method of claim 10, wherein the user device comprises one or more microphones for vocal interaction with the user and at least one of: a laptop; a television; a smartphone; a tablet; a desktop; an augmented reality headset; a virtual reality headset; or a device capable of presenting content to a user. ### Claim 18 (depends on 10) The method of claim 10, wherein the one or more devices comprise one or more of: a light; a lamp; a television; a monitor; a speaker; or an interactive device. ### Claim 19 A non-transitory computer-readable medium storing instructions that, when executed, cause: receiving voice data associated with a user; determining that the voice data comprises a command; determining one or more devices capable of handling the command; outputting a different sensory pattern to each device of the one or more devices; receiving, from a user device, an indication of a first detected sensory pattern; determining a first device of the one or more devices that is associated with the first detected sensory pattern; and applying the command to the first device. ### Claim 20 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the one or more devices are configured to communicate with a smart hub. ### Claim 21 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the instructions that cause the determining one or more devices capable of handling the command cause determining the one or more devices are each in a state that does not conflict with the command. ### Claim 22 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the first detected sensory pattern comprises at least one of: flashes of light, a displayed image, and a tone. ### Claim 23 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the first detected sensory pattern is imperceptible to the user. ### Claim 24 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein each of the different sensory patterns output to the one or more devices is unique in time to each other sensory pattern. ### Claim 25 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the instructions, when executed, further cause: receiving, from the user device, a second detected sensory pattern, wherein the second detected sensory pattern is associated with a second device of the one or more devices different from the first device; determining the first detected sensory pattern has a higher intensity than the second detected sensory pattern; and determining, based on the higher intensity, to apply the command to the first device. ### Claim 26 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the user device comprises one or more microphones for vocal interaction with the user and at least one of: a laptop; a television; a smartphone; a tablet; a desktop; an augmented reality headset; a virtual reality headset; or a device capable of presenting content to a user. ### Claim 27 (depends on 19) The non-transitory computer-readable medium of claim 19, wherein the one or more devices comprise one or more of: a light; a lamp; a television; a monitor; a speaker; or an interactive device. ### Claim 28 A system comprising: a user device; one or more devices; and a computing device configured to: receive, from the user device, voice data associated with the user; determine that the voice data comprises a command; determine the one or more devices are capable of handling the command; output a different sensory pattern to each device of the one or more devices; receive, from the user device, a first detected sensory pattern; determine a first device of the one or more devices associated with the first detected sensory pattern; and apply the command to the first device. ### Claim 29 (depends on 28) The system of claim 28, wherein the one or more devices are configured to communicate with a smart hub. ### Claim 30 (depends on 28) The system of claim 28, wherein the computing device is configured to determine one or more devices capable of handling the command by determining the one or more devices are each in a state that does not conflict with the command. ### Claim 31 (depends on 28) The system of claim 28, wherein the first detected sensory pattern comprises at least one of: flashes of light, a displayed image, and a tone. ### Claim 32 (depends on 28) The system of claim 28, wherein the first detected sensory pattern is imperceptible to the user. ### Claim 33 (depends on 28) The system of claim 28, wherein each of the different sensory patterns output to the one or more devices is unique in time to each other sensory pattern. ### Claim 34 (depends on 28) The system of claim 28, wherein the computing device is further configured to: receive, from the user device, a second detected sensory pattern, wherein the second detected sensory pattern is associated with a second device of the one or more devices different from the first device; determine the first detected sensory pattern has a higher intensity than the second detected sensory pattern; and determine, based on the higher intensity, to apply the command to the first device. ### Claim 35 (depends on 28) The system of claim 28, wherein the user device comprises one or more microphones for vocal interaction with the user and at least one of: a laptop; a television; a smartphone; a tablet; a desktop; an augmented reality headset; a virtual reality headset; or a device capable of presenting content to a user. ### Claim 36 (depends on 28) The system of claim 28, wherein the one or more devices comprise one or more of: a light; a lamp; a television; a monitor; a speaker; or an interactive device.