# US 10,313,289 B2 · Observation platform using structured communications with external devices and systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,289 B2 - Document ID: US10313289B2 - Status: Granted - Kind: B2 - Application number: 16/119,948 - Filed: 2018-08-31 - Published: 2018-12-27 - Granted: 2019-06-04 - Earliest claimed: 2015-09-29 - Assignees: Theatro Labs, Inc. - Applicants: Theatro Labs, Inc. - Inventors: Ravi Shankar Kumar; Guy R. VanBuskirk; Steven M. Lucy; Shiva Cheedella; Kiran Kumar, S B; Ashok Donthe Manjunath - Web page: https://patentgrep.com/patent/US10313289B2 ## CPC - H04L 51/18: Commands or executable codes - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - H04W 4/18: Information format or content conversion, e.g. adaptation by the network of the transmitted or received information for the purpose of wireless delivery to users or terminals - H04W 4/20: Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel - H04W 4/70: Services for machine-to-machine communication [M2M] or machine type communication [MTC] - G06Q 30/0269: {based on user profile or attribute} - G06Q 30/0635: {replenishment orders; recurring orders} - H04L 67/52: specially adapted for the location of the user terminal - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract Methods and systems for using an observation platform with an external device are disclosed. A signal is received from a first communication device at a second communication device associated with a computer system. Context information is derived from the signal at the computer system from, a speech to text analysis of the audible source, a policy implemented in the computer system by a controlling enterprise, and inferences calculated by a combination of text analysis, and secondary information contained in the signal. An action is determined to take place at an external device or user device based on the context information, wherein the external device is one of a plurality of external devices and is networked to the second communication device or a plurality of devices. A second signal is sent to the external device to instruct the device to take the action. ## Claims ### Claim 1 A method for using an observation platform with an external device, comprising: receiving a signal from a first communication device at a second communication device associated with a computer system wherein a characteristic of said signal corresponds to an audible source proximate to said first communication device; deriving context information from said signal at said computer system from, at least in part, a speech to text analysis of said audible source, a policy implemented in said computer system by a controlling enterprise, and inferences calculated by a combination of policy, text analysis, and secondary information contained in said signal; determining an action to take place at an external device based on said context information, wherein said external device is one of a plurality of external devices and is networked to said second communication device; and sending a second signal to said external device to instruct said external device to take said action. ### Claim 2 (depends on 1) The method as recited in claim 1, further comprising: executing said action by said external device. ### Claim 3 (depends on 1) The method as recited in claim 1, further comprising: using said context information and said policy to identify which of said plurality of external devices at which said action is to take place. ### Claim 4 (depends on 1) The method as recited in claim 1, further comprising: pulling, by said computer system, said context information from one of said first communication device and a user of said first communication device. ### Claim 5 (depends on 1) The method as recited in claim 1, wherein said first communication device comprises a user interface with only one button for sending said communication as said signal, wherein said only one button is a virtual button or a physical button, and wherein said method further comprises: responsive to a press of said only one button, sending said signal from said first communication device to said second communication device. ### Claim 6 (depends on 1) The method as recited in claim 1, wherein said receiving said signal from said first communication device comprises: receiving said signal via an Internet communication from said first communication device, wherein said first communication device is an application that communicates through the Internet that said action is required by one or more users within the observation platform. ### Claim 7 (depends on 1) The method as recited in claim 1, wherein said first communication device is one of said plurality of external devices, and wherein said method further comprises: using, by said first communication device, said context information and said policy to issue instructions to one or more others of said plurality of external devices. ### Claim 8 (depends on 1) The method as recited in claim 1, further comprising: pulling, by the external device, said context information from said computer system. ### Claim 9 (depends on 1) The method as recited in claim 1, wherein said sending said second signal comprises: sending said second signal to more than one of said plurality of external devices. ### Claim 10 (depends on 1) The method as recited in claim 1, wherein said sending said second signal comprises: sending said second signal to said external device, wherein said external device is operated by a third party. ### Claim 11 (depends on 1) The method as recited in claim 1, wherein said sending said second signal comprises: sending said second signal to said external device through the Internet via a uniform resource locator (URL) and standard Internet protocols. ### Claim 12 (depends on 1) The method as recited in claim 1, wherein said sending said second signal comprises: sending said second signal to said external device by a communication protocol selected from the group of communications protocols consisting of: Bluetooth, low-energy Bluetooth (BLE), ZigBee, radio wave, cell phone signals, and any standard 802.x WiFi protocol. ### Claim 13 A non-transitory computer-usable storage medium having instructions embodied therein that when executed cause a computer system to perform a method of using an observation platform with an external device, said method comprising: receiving a signal from a first communication device at a second communication device associated with said computer system wherein a characteristic of said signal corresponds to an audible source proximate to said first communication device; deriving context information from said signal at said computer system from, at least in part, a speech to text analysis of said audible source, a policy implemented in said computer system by a controlling enterprise, and inferences calculated by a combination of text analysis, and secondary information contained in said signal; determining, by said computer system, an action to take place at an external device based on said context information, wherein said external device is one of a plurality of external devices and is networked to said second communication device; and sending a second signal to said external device to instruct said external device to take said action. ### Claim 14 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said method further comprises: using, at said computer system, said context information and said policy to identify which of said plurality of external devices at which said action is to take place. ### Claim 15 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said first communication device comprises a user interface with only one button for sending said communication as said signal, wherein said only one button is a virtual button or a physical button, and wherein said method further comprises: responsive to a press of said only one button, receiving said signal at said second communication device. ### Claim 16 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said method further comprises: pushing, by said computer system, said context information to said external device. ### Claim 17 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said method further comprises: pulling, by said computer system, said context information from one of said first communication device and a user of said first communication device. ### Claim 18 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said receiving said signal from said first communication device comprises: receiving said signal via an Internet communication from said first communication device, wherein said first communication device is an application that communicates through the Internet that said action is required by one or more users within the observation platform. ### Claim 19 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said sending said second signal comprises: sending, by said computer system, said second signal to more than one of said plurality of external devices. ### Claim 20 (depends on 13) The non-transitory computer-usable storage medium as recited in claim 13, wherein said sending said second signal comprises: sending said second signal to said external device by a communication protocol selected from the group of communications protocols consisting of: a uniform resource locator (URL) and standard Internet protocols, Bluetooth, low-energy Bluetooth (BLE), ZigBee, radio wave, cell phone signals, and any standard 802.x WiFi protocol.