# US 2018/0321905 A1 · Enhanced control, customization, and/or security of a sound controlled device such as a voice controlled assistance device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0321905 A1
- Document ID: US20180321905A1
- Status: Published application
- Kind: A1
- Application number: 15/585,288
- Filed: 2017-05-03
- Published: 2018-11-08
- Earliest claimed: 2017-05-03
- Assignees: Transcendent Technologies Corp.
- Applicants: Transcendent Technologies Corp.
- Inventors: Dennis Fountaine
- Web page: https://patentgrep.com/patent/US20180321905A1

## CPC

- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path}
- G06F 16/683: using metadata automatically derived from the content
- G10L 15/26: Speech to text systems (G10L15/08 takes precedence)
- G10L 21/06: Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04M 1/6066: {including a wireless connection}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

Disclosed is a method, a device, a system and/or a manufacture of enhanced control, customization, and/or security of a sound controlled device such as a voice controlled assistance device. In one embodiment, an apparatus includes a signal input, a speaker, and a soundwave damper to dampen a sound receiving capability of a sound controlled device. The sound controlled device initiates a responsive action to a sound command received on a microphone, and may be a voice controlled assistance device. Upon receiving a command signal the apparatus utilizes a processor and a memory to determine an association between the command signal and an audio file storing the sound command and converts the audio file into an audio signal. The speaker is utilized to bypass the soundwave damper such that the sound command is received at the microphone of the sound controlled device, initiating the responsive action as a result of the command signal.

## Claims

### Claim 1

An apparatus comprising:
a sound input for at least one of: (i) receiving a first audio signal, and (ii) receiving a first soundwave and converting the first soundwave into the first audio signal;
a soundwave damper to dampen a sound receiving capability of a sound controlled device capable of initiating a responsive action in response to a sound command received on a microphone of the sound controlled device;
a processor;
a memory comprising a first audio file encoding a sound signature, a second audio file encoding the sound command, a relation data associating the first audio file and the second audio file, and computer-executable instructions that when executed on the processor cause the processor to:
upon determination of a threshold similarity between the first audio signal and the sound signature, convert the second audio file into a second audio signal for generating a second soundwave at a speaker to carry the sound command; and
the speaker, to bypass the soundwave damper such that the second soundwave carrying the sound command is communicable to the microphone of the sound controlled device.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the sound controlled device is a voice controlled assistance device and the sound command is a voice command.

### Claim 3 (depends on 1)

The apparatus of claim 1, further comprising:
a wireless receiver;
the memory further comprising computer-executable instructions that when executed on the processor cause the processor to:
receive the sound signature from a mobile device through at least one of the wireless network interface controller and the sound input device, and
store the sound signature from the mobile device as the first audio file in the memory.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising:
a base having a receiving dock to at least one of attach to, receive, and secure the sound controlled device;
a cap, the cap housing the speaker and the soundwave damper;
an adjustable connector between the base and the cap allowing for an adjustment of at least one of: (i) a relative orientation of the base and the cap, and (ii) a distance between the base and the cap; the adjustment such that the speaker and the soundwave damper can be placed proximate to the microphone of the sound controlled device when the sound controlled device is at least one of attached to, received by, and secured by the receiving dock; and
a configuration lock at least one of securing the sound controlled device in the receiving dock and securing a configuration of the adjustable connector.

### Claim 5 (depends on 4)

The apparatus of claim 4, wherein the adjustable connector comprises a rod on which at least one of the base and the cap slides to at least one of (i) adjust the relative orientation of the base and the cap, and (ii) adjust the distance between the base and the cap.

### Claim 6 (depends on 4)

The apparatus of claim 4, wherein the adjustable connector can be flexed to at least one of (i) adjust the relative orientation of the base and the cap, and (ii) adjust the distance between the base and the cap.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the soundwave damper is a sound barrier shielding the microphone of the sound controlled device, reducing an ordinary sound receiving environment of the sound controlled device.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the sound barrier is a flexible membrane forming a seal around the microphone of the sound controlled device.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the soundwave damper is a sound interference generator.

### Claim 10 (depends on 1)

The apparatus of claim 1 wherein the sound controlled device is a first sound controlled device and the apparatus of claim 1 further comprises:
a second speaker;
a second soundwave damper dampening a second sound controlled device;
the memory further comprising a second relation data associating the second audio file with the first sound controlled device and computer-executable instructions that when executed on the processor cause the processor to:
determine based on the second relation data between the sound audio file and the sound controlled device that the first sound controlled device is to primarily receive the sound command,
wherein the first sound controlled device transmits the command through a network to a server that interprets the sound command using a speech recognition engine, and
wherein the sound input device is a microphone.

### Claim 11

A method comprising:
dampening with a soundwave damper a sound receiving capability of a voice controlled device having a microphone;
receiving a command signal;
in response to the command signal, generating with a speaker a soundwave carrying a voice command capable of initiating at least one of a response action of the voice controlled device and a speech response of the voice controlled device; and
bypassing the soundwave damper to communicate the soundwave carrying the voice command from the speaker to the microphone of the sound controlled device.

### Claim 12 (depends on 11)

The method of claim 11, further comprising:
determining the command signal is associated with a voice command to which the voice controlled device is responsive, the voice command stored as a first audio file in a memory; and
utilizing the first audio file to generate the soundwave carrying the voice command.

### Claim 13 (depends on 12)

The method of claim 12, further comprising:
in response to the command signal, permitting a verbal communication of a user received from a damped region of an ordinary sound receiving environment of the voice controlled device to be reproduced by the speaker that bypasses the sound damper such that the verbal communication passes substantially unimpeded from the damped region to the microphone of the voice controlled device.

### Claim 14 (depends on 12)

The method of claim 12, wherein the command signal is a sound command, the method further comprising:
in response to a determination of a threshold similarity between a second audio signal generated from the sound command and a second audio file prerecorded in a memory, reducing a strength of the soundwave damper to increase a sound receiving environment of the voice controlled device relative to an ordinary sound receiving environment of the voice controlled device.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
receiving a text string data encoding the voice command of the voice controlled device; and
translating the text string data into an audio file with a text-speech converter,
wherein the audio file is utilized to generate the soundwave carrying the voice command.

### Claim 16 (depends on 12)

The method of claim 12, further comprising:
processing at the voice controlled device the soundwave carrying the voice command and communicating the voice command to a server comprising a speech recognition engine over a wide area network for recognition of the voice command and execution of the at least one of the response action of the sound controlled device associated with the voice command and the speech response of the sound controlled device associated with the voice command;
processing the speech response at the voice controlled device and generating a third soundwave carrying the speech response;
setting the first audio file in the memory of the voice controlled device based on a recording of the first audio file received from and generated by a mobile device,
wherein the soundwave damper is at least one of (i) a sound barrier shielding the microphone of the first device, and (ii) a sound interference generator,
wherein the determination that the command signal is associated with the voice command to which the voice controlled device is responsive is made by a sound interface device comprising the speaker and the soundwave damper communicatively coupled to the voice controlled device through sound, and
wherein the voice command is a wake word and the action is an activation of the voice controlled device.

### Claim 17 (depends on 11)

The method of claim 11, further comprising:
determining the command signal is exclusively associated with the voice controlled device when two or more voice controlled devices are suppressed with sound damping to reduce a sound receiving environment of the two or more voice controlled devices;
routing the an audio signal usable by the speaker to generate the soundwave carrying the voice command when it is determined that the command signal is associated with the voice controlled device when two or more voice controlled devices are suppressed with sound damping to reduce the sound receiving environment of the two or more voice controlled devices;
determining a response failure from the voice controlled device;
determining the command signal is associated with a backup device of the two or more voice controlled devices;
generating a second audio signal usable by at least one of the speaker and a second speaker to generate at least one of the soundwave carrying the voice command and a second soundwave carrying a second voice command to the backup device of the two or more voice controlled devices;
at least one of re-routing the audio signal and routing the second audio signal to at least one of the speaker and the second speaker to communicate at least one of the voice command and the second voice command to the backup device of the two or more voice controlled devices.

### Claim 18

A method comprising:
specifying an assistance application accessible through a voice controlled assistance device to be invoked by an invocation command of the assistance application communicated to the voice controlled assistance device;
specifying an assistance action of the assistance application, the assistance action conforming to a command protocol specifying predefined actions executable by the assistance application following invocation of the assistance application,
wherein the assistance action executable after at least one of (i) requesting one or more voice inputs associated with the assistance action provided following initiation of the assistance action, and (ii) further receiving one or more voice instructions associated with the assistance action provided following initiation of the assistance action;
specifying the one or more voice instructions associated with the assistance action;
selecting a trigger condition to invoke the assistance application and initiate the assistance action; and
upon determination of occurrence of the trigger condition, serially communicating the invocation command of the assistance application, the initiation command of the assistance action, and the one or more voice instructions to the voice controlled device to invoke the assistance application and execute the assistance action.

### Claim 19 (depends on 18)

The method of claim 18, further comprising:
generating a verbal communication of the voice controlled device with a speaker of the voice controlled device to at least one of (i) announce the assistance action to be initiated by the assistance application and (ii) request a confirmation from a user to execute the invocation command and the assistance action;
specifying one of the one or more voice instructions associated with the assistance action to be received in response to the one or more voice inputs in real-time from the user to complete the voice instruction of the assistance action;
determining expiration of a predetermined time within which each instance of the one or more voice inputs was not received and at least one of: (i) stopping execution of the assistance action of the assistance service; (ii) skipping the voice instruction associated with the verbal input; (iii) providing the voice instruction to be utilized in the verbal input associated with the voice instruction; and
generating a follow-up verbal communication with the speaker of the voice controlled device for the user to verbally provide the voice instruction to the voice input to complete the voice instructions required to initiate the assistance action.

### Claim 20 (depends on 19)

The method of claim 19, further comprising:
dampening with a soundwave damper a sound receiving capability of the voice controlled device having a microphone of the voice controlled device;
in response to receipt of a command signal, generating with a speaker a soundwave carrying at least one of the invocation command, the initiation command and the one or more voice instructions; and
bypassing the soundwave damper to communicate the soundwave carrying at least one of the invocation command, the initiation command, and the one or more voice instructions from the speaker to the microphone of the voice controlled device.

### Claim 21 (depends on 20)

The method of claim 20, further comprising:
associating a time delay between the any of: (i) the invocation command of the assistance application, (ii) the initiation command of the assistance action, and (iii) at least one of the one or more voice instructions;
determining a sound response of the voice controlled device has terminated before initiation at least one of: (i) the initiation command of the assistance action, and (ii) at least one of the one or more voice instructions;
referencing at least one of an audio file comprising the initiation command and a text string data comprising the initiation command;
referencing at least one of a second audio file comprising the one or more voice instructions associated with the assistance action and a second text string comprising the one or more voice instructions associated with the assistance action;
determining at least one of a failure of the assistance application and a failure of execution of the assistance action of the assistance application;
optionally informing the user of the failure of at least one of the assistance application and execution of the assistance action of the assistance application;
determining the assistance action of the assistance application is associated with a backup assistance action of the backup assistance application; and
executing the backup assistance action of the backup assistance application.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
specifying a second assistance action of a second assistance application to be automatically executed following completion of the assistance action of the assistance application;
translating a speech response of the assistance action and providing the speech response as the voice instruction of the second assistance action, and
wherein the initiation condition is at least one of an occurrence of a time and an occurrence of a date, and
wherein the assistance action is ordering a food service, ordering a professional service, purchasing a media content, ordering a product, paying a bill, reading a message, sending a message, accessing a file, controlling a connected device, and controlling a household appliance.

### Claim 23

A system comprising:
a sound controlled device communicatively coupled to a sound recognition engine, the sound controlled device comprising:
a processor of the sound controlled device,
a memory of the sound controlled device, and
a microphone of the sound controlled device for receiving a sound command; and
a sound interface device communicatively coupled to the sound controlled device, comprising:
a processor of the sound interface device,
a memory of the sound interface device,
a speaker of the sound interface device to generate a sound command conforming to a sound command protocol for receipt at the microphone of the sound controlled device,
an audio input device, and
a sound damper to reduce a sound receiving capability of the microphone of the sound controlled device from a user within an ordinary sound receiving environment of the sound controlled device by disrupting a soundwave communication medium.

### Claim 24 (depends on 23)

The system of claim 23, further comprising:
a network;
a server, comprising:
a processor of the server,
a memory of the server,
the sound recognition engine, and
an assistance service engine; and
the sound controlled device further comprising:
a network interface controller for communication with the sever over the network;
the sound interface device further comprising:
a wireless communication module of the sound interface device,
the memory comprising a sound signature stored as a first audio file, a sound command stored as a second audio file, a relation data between the first audio file and the second audio file, and computer-executable instructions that when executed on the processor of the sound interface device cause the processor of the sound interface control device to:
upon determination of a threshold similarity between an audio signal and the sound signature, convert the second audio file into a second audio signal and generate with the speaker a soundwave carrying the sound command, and
a mobile device comprising:
a processor of the mobile device;
a memory of the mobile device comprising computer executable instructions that when executed on the processor of the mobile device cause the processor of the mobile device to record the first audio file; and
a wireless communication module of the mobile device to communicate the first audio file to the sound interface device.

### Claim 25 (depends on 24)

The system of claim 24, further comprising:
the sound controlled device further comprising:
a text-speech translator,
wherein the soundwave damper is at least one of (i) a sound barrier shielding the microphone of the first device, and (ii) a sound interference generator,
wherein the sound interface device is communicatively coupled to the sound controlled device through a one-way communication generated by the speaker of the sound interface device and received by the microphone of the sound controlled device, and
wherein the sound controlled device is a voice controlled assistance device.
