# US 11,310,614 B2 · Smart hub > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,614 B2 - Document ID: US11310614B2 - Status: Granted - Kind: B2 - Application number: 15/930,081 - Filed: 2020-05-12 - Published: 2020-08-27 - Granted: 2022-04-19 - Earliest claimed: 2014-01-17 - Assignees: Proctor Consulting, LLC - Applicants: Proctor Consulting, LLC - Inventors: James A. Proctor, Jr.; James Arthur Proctor, III - Web page: https://patentgrep.com/patent/US11310614B2 ## CPC - H04R 29/007: {for public address systems (public address systems per se H04R27/00)} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - H04L 12/2834: {Switching of information between an external network and a home network (access arrangements H04L12/2856)} - H04L 12/2838: {Distribution of signals within a home automation network, e.g. involving splitting/multiplexing signals to/from different paths (adaptations of television systems for transmission by electric cable for domestic distribution H04N7/106; hybrid transport H04L12/6418; home network arrangements specially adapted for distribution of digital video signals H04N7/24)} - H04L 65/612: for unicast - H04N 5/268: Signal distribution or switching - H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite - H04N 21/4126: {The peripheral being portable, e.g. PDAs or mobile phones} - H04N 21/41265: {having a remote control device for bidirectional communication between the remote control device and client device (unidirectional remote control device H04N21/42204)} - H04N 21/42203: {sound input device, e.g. microphone} - H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)} - H04N 21/4367: Establishing a secure communication between the client and a peripheral device or smart card - H04N 21/439: Processing of audio elementary streams - H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)} - H04N 21/4622: {Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet (web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859)} - H04N 21/8106: {involving special audio data, e.g. different tracks for different languages} - H04R 27/00: Public address systems (circuits for preventing acoustic reaction H04R3/02; circuits for distributing signals to loudspeakers H04R3/12; {monitoring or testing arrangements for public address systems H04R29/007}; amplifiers H03F) - H04S 7/00: Indicating arrangements; Control arrangements, e.g. balance control - H04S 7/303: {Tracking of listener position or orientation} - H04W 4/80: Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication - H04R 2227/003: Digital PA systems using, e.g. LAN or internet - H04R 2227/005: Audio distribution systems for home, i.e. multi-room use - H04R 2420/07: Applications of wireless loudspeakers or wireless microphones - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04S: STEREOPHONIC SYSTEMS - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract An intelligent hub for interfacing with other devices and performing smart audio or video source selection. ## Claims ### Claim 1 A wireless speaker device for executing commands based on voice recognition and detecting the presence of other wireless speaker devices, the wireless speaker device comprising: a Wi-Fi radio; a Bluetooth radio; one or more microphones; at least one loudspeaker; a signal generator for providing one or more audio information signals; an audio information interface for providing the one or more audio information signals for use in the generation of respective acoustic signals to respective loudspeakers; and one or more processors configured to execute program code to: communicate with a second wireless speaker device utilizing the Wi-Fi radio and/or the Bluetooth radio, to provide simultaneous audio playback of streaming content utilizing both the at least one loudspeaker located within the wireless speaker device and at least one loudspeaker local to the second wireless speaker device; communicate with one or more remote servers using the Wi-Fi radio to receive streaming content for playback from a plurality of content sources; receive acoustic signals using the one or more microphones; perform voice command recognition on the acoustic signals, to determine a connected speaker command; in response to the at least one connected speaker command, select particular content from one of the plurality of content sources as the streaming content for playback to both of the wireless speaker devices at the same time; and wherein the processor is further configured to: determine that the second wireless speaker device is proximal to the wireless speaker device, based upon both (a) detection of at least one Bluetooth beacon and (b) detection of unique sounding signals. ### Claim 2 (depends on 1) The device of claim 1 wherein the acoustic signals include streaming content. ### Claim 3 (depends on 1) The device of claim 1 wherein at least one of the one or more processors is further configured to execute program code to: detect presence of the second wireless speaker device, utilizing the Wi-Fi radio and/or the Bluetooth radio. ### Claim 4 (depends on 1) The device of claim 1, wherein at least one of the one or more processors is further configured to execute program code to: determine recommendations of content to play. ### Claim 5 (depends on 1) The device of claim 1, wherein at least one of the one or more processors is further configured to execute program code to: determine recommendations of additional content related to currently playing content, and play the additional content. ### Claim 6 (depends on 1) The device of claim 1 wherein the second wireless speaker device is a smart phone. ### Claim 7 (depends on 1) The device of claim 1 wherein at least one of the processors is further configured to execute program code to: initiate a streaming content service selected from a plurality of streaming content services to which a user of the connected speaker is subscribed. ### Claim 8 (depends on 1) The device of claim 1, further comprising a WiFi access point. ### Claim 9 (depends on 1) The device of claim 1 wherein at least one of the processors is further configured to execute program code to communicate with a WiFi access point to provide control over configuration of the WiFi access point. ### Claim 10 (depends on 9) The device of claim 9, wherein the configuration includes allowing access of one or more devices onto a WiFi network associated with the access point. ### Claim 11 (depends on 10) The device of claim 10, wherein a change of configuration is controlled, at least in part, by communication with a mobile device. ### Claim 12 (depends on 1) The device of claim 1, wherein the voice command recognition is performed using a remote server. ### Claim 13 (depends on 12) The device of claim 12 wherein the remote server is a third party server providing a voice command recognition service. ### Claim 14 (depends on 1) The device of claim 1 wherein at least one of the processors further executes program code to: use the one or more microphones and at least one loudspeaker to perform one of (a) a Voice over IP communication session or (b) a video communication session or (c) an IP Multimedia Core Network Subsystem (IMS) session, the session established with a remote device. ### Claim 15 (depends on 1) The device of claim 1 wherein the processor further executes program code to: perform a network security function including at least approval of access for a new device on to a WiFi network. ### Claim 16 (depends on 1) The device of claim 1 wherein at least one of the processors further executes program code to: perform a network security function including at least provisioning of configuration values for a new device. ### Claim 17 (depends on 16) The device of claim 16 wherein the new device was detected utilizing a Bluetooth radio on a mobile phone prior to the provisioning of the configuration values. ### Claim 18 (depends on 1) The device of claim 1 wherein at least one of the processors further executes program code to: download and store user selected applications, and interact with other devices or remote servers via the applications. ### Claim 19 (depends on 1) The device of claim 1 wherein at least one of the processors further executes program code to interact with a smart phone to allow for another wireless device to gain access to a network or server.