# US 2022/0284897 A1 · Methods and systems for using voice to control multiple devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284897 A1
- Document ID: US20220284897A1
- Status: Published application
- Kind: A1
- Application number: 17/704,641
- Filed: 2022-03-25
- Published: 2022-09-08
- Earliest claimed: 2017-07-05
- Assignees: Comcast Cable Communications, LLC
- Applicants: Comcast Cable Communications, LLC
- Inventors: Michael Rekstad
- Web page: https://patentgrep.com/patent/US20220284897A1

## CPC

- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G06F 3/16: Sound input; Sound output (speech processing G10L)
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G06F 2203/0381: Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
- G10L 2015/223: {Execution procedure of a spoken command}
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Methods and systems for using voice (e.g., voice commands) to control a plurality of network devices via a motion sensing control device are provided. A control device can detect movement (e.g., a gesture) associated with the control device. Based on the movement satisfying a predefined condition, the control device can initiate a either a direct or a proxy communication session with a remote computing device. The communication session can be established and maintained for a predefined period such that data associated with a command can be immediately transmitted to the remote computing device. Thus, when a voice command is received, data associated with the command can be transmitted over the already established communication session to the remote computing device. The remote computing device can provide a response to the control device and/or transmit a command code associated with the voice command to one or more devices intended to be controlled.

## Claims

### Claim 1

One or more non-transitory computer-readable media storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to:
establish, based on a motion associated with a control device satisfying a motion threshold, a communication session with a computing device;
determine a voice input; and
send, to the computing device via the communication session, data indicative of the voice input.

### Claim 2 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein sending the data indicative of the voice input causes a response to be sent to one or more target devices, wherein the response is associated with the data indicative of the voice input.

### Claim 3 (depends on 2)

The one or more non-transitory computer-readable media of claim 2, wherein the response associated with the data indicative of the voice input comprises a command code, and wherein the processor-executable instructions further cause the at least one processor to send, to the one or more target devices, the command code.

### Claim 4 (depends on 3)

The one or more non-transitory computer-readable media of claim 3, wherein the processor-executable instructions further cause the at least one processor to execute, based on the command code, an operational command.

### Claim 5 (depends on 1)

The one or more non-transitory computer-readable media of claim 1, wherein the motion threshold is associated with at least one movement associated with the control device.

### Claim 6 (depends on 5)

The one or more non-transitory computer-readable media of claim 5, wherein the at least one movement is associated with a quantity of movements of the control device.

### Claim 7

A system comprising:
a control device configured to:
establish, based on a motion associated with the control device satisfying a motion threshold, a communication session with a computing device,
determine a voice input, and
send, to the computing device via the communication session, data indicative of the voice input; and
the computing device configured to:
receive the data indicative of the voice input.

### Claim 8 (depends on 7)

The system of claim 7, wherein the computing device is further configured to, based on the data indicative of the voice input, send a response to one or more target devices, wherein the response is associated with the data indicative of the voice input.

### Claim 9 (depends on 8)

The system of claim 8, wherein the response comprises a command code.

### Claim 10 (depends on 9)

The system of claim 9, further comprising:
the one or more target devices configured to:
execute, based on the command code, an operational command.

### Claim 11 (depends on 7)

The system of claim 7, wherein the control device is further configured to, based on the data indicative of the voice input, send a response to one or more target devices, wherein the response is associated with the data indicative of the voice input.

### Claim 12 (depends on 11)

The system of claim 11, wherein the response comprises a command code.

### Claim 13 (depends on 12)

The system of claim 12, further comprising:
the one or more target devices configured to:
execute, based on the command code, an operational command.

### Claim 14 (depends on 7)

The system of claim 7, wherein the motion threshold is associated with at least one movement associated with the control device.

### Claim 15 (depends on 14)

The system of claim 14, wherein the at least one movement is associated with a quantity of movements of the control device.

### Claim 16

One or more non-transitory computer-readable media storing processor-executable instructions that, when executed by at least one processor, cause the at least one processor to:
detect a motion associated with a control device;
determine that the motion satisfies a motion threshold;
establish, based on the motion satisfying the motion threshold, a communication session with a network device;
detect a voice input;
send, to the network device via the communication session, data indicative of the voice input; and
receive, from the network device, a response associated with the data indicative of the voice input.

### Claim 17 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein detecting the motion comprises determining, based on data from an accelerometer, a movement associated with the control device.

### Claim 18 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein the motion threshold is associated with a quantity of movements of the control device.

### Claim 19 (depends on 16)

The one or more non-transitory computer-readable media of claim 16, wherein the response associated with the data indicative of the voice input comprises a command code, and wherein the processor-executable instructions further cause the at least one processor to send, to one or more target devices, the command code.

### Claim 20 (depends on 19)

The one or more non-transitory computer-readable media of claim 19, wherein the processor-executable instructions further cause the at least one processor to execute, based on the command code, an operational command.

### Claim 21

A system comprising:
a control device configured to:
detect a motion associated with the control device,
determine that the motion satisfies a motion threshold,
establish, based on the motion satisfying the motion threshold, a communication session with a network device,
detect a voice input,
send, to the network device via the communication session, data indicative of the voice input, and
receive, from the network device, a response associated with the data indicative of the voice input; and
the network device configured to:
receive the data indicative of the voice input.

### Claim 22 (depends on 21)

The system of claim 21, wherein the control device is further configured to determine, based on data from an accelerometer, a movement associated with the control device to detect the motion.

### Claim 23 (depends on 21)

The system of claim 21, wherein the motion threshold is associated with a quantity of movements of the control device.

### Claim 24 (depends on 21)

The system of claim 21, wherein the response associated with the data indicative of the voice input comprises a command code, and wherein the control device is further configured to send, to one or more target devices, the command code.

### Claim 25 (depends on 24)

The system of claim 24, further comprising:
the one or more target devices configured to:
execute, based on the command code, an operational command.
