# US 12,184,542 B2 · Observation platform communication relay > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,184,542 B2 - Document ID: US12184542B2 - Status: Granted - Kind: B2 - Application number: 18/138,646 - Filed: 2023-04-24 - Published: 2023-08-17 - Granted: 2024-12-31 - Earliest claimed: 2011-02-22 - Assignees: Theatro Labs, Inc. - Applicants: Theatro Labs, Inc. - Inventors: Guy R. VanBuskirk; Steven Paul Russell - Web page: https://patentgrep.com/patent/US12184542B2 ## CPC - H04L 45/44: Distributed routing - G06Q 30/02: Marketing; Price estimation or determination; Fundraising - H04L 67/561: Adding application-functional data or data for application control, e.g. adding metadata - H04W 4/02: Services making use of location information - H04W 4/025: {using location based information parameters} - H04M 2203/2038: Call context notifications - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract An observation platform comprises a first computer system associated with an organization, a first communication device associated with a first user, a second communication device communicatively and a second computer system both communicatively coupled with the first computer system The second computer system receives: via the first computer system and the first communication device, a signal with a characteristic corresponding to an audible source; and from the first computer system, context information at least in part from a speech to text analysis of the characteristic, where the context information represents one or more attributes of the first user and comprises a query about the organization made by the first user. The second computer system compiles a response to the query relative to the organization and responds via the first computer system and the second communication device, to the first communication device regarding the query based on the compiled response. ## Claims ### Claim 1 An observation platform comprising: a computer system associated with an organization; a first communication device associated with a first user; a second communication device associated with and communicatively coupled with a first computer system; and a second computer system; wherein the first computer system is configured to communicate with the second computer system and the second computer system is configured to: receive, via the first computer system, a signal from the first communication device, wherein a characteristic of the signal corresponds to an audible source, the audible source being a voice of the first user; receive, via the first computer system, context information at least in part from a speech to text analysis of the characteristic that corresponds to the audible source, wherein the context information represents one or more attributes of the first user, and wherein the context information comprises a query about the organization made by the first user; compile, by the second computer system, a response to the query relative to the organization; and respond, by the second computer system via the first computer system and the second communication device, to the first communication device regarding the query based on the compiled response. ### Claim 2 (depends on 1) The observation platform of claim 1, wherein the compiled response is related to the context information; and wherein the first computer system is configured to: respond, via the second communication device, to the first communication device about the query based on the compiled response from the second computer system; and send, by the first computer system via the second communication device, the compiled response to the first communication device. ### Claim 3 (depends on 1) The observation platform of claim 1, wherein the second computer system is configured as a plurality of secondary computer systems via a network. ### Claim 4 (depends on 1) The observation platform of claim 1, wherein the second computer system is cloud based. ### Claim 5 (depends on 1) The observation platform of claim 1, wherein the first user of the first communication device is one of: an employee, an associate, a potential customer, a past customer, and a manager. ### Claim 6 (depends on 1) The observation platform of claim 1, wherein the query is related to the organization based on one of the text from the speech to text analysis and an understanding at the first computer system. ### Claim 7 (depends on 1) The observation platform of claim 1, wherein the first computer system is configured to recognize a command based on the text in the speech to text analysis without a user saying key terms. ### Claim 8 (depends on 1) The observation platform of claim 1, wherein the first user is one of a plurality of speakers in communication with the first computer system, and wherein each speaker of the plurality of speakers is identified with a unique identifier and voice file so that a speech-to-text engine can train on each speaker's voice and more accurately choose words from dictionaries and individual user grammars. ### Claim 9 (depends on 1) The observation platform of claim 1, wherein the first computer system is configured to use individually customized dictionaries and grammars in the speech to text analysis for a sequential context of words in the text from the speech to text analysis. ### Claim 10 (depends on 9) The observation platform of claim 9, wherein metadata is a classification of the first user, and wherein the classification is related to one of a job performed by the first user, a skill of the first user, and a status of the first user in relation to the organization. ### Claim 11 (depends on 1) The observation platform of claim 1, wherein metadata associated with the first communication device may be parsed into individual attributes and stored as a set of attributes for the first user. ### Claim 12 (depends on 1) The observation platform of claim 1, wherein the speech to text analysis derives a contextual metric about the first user. ### Claim 13 (depends on 12) The observation platform of claim 12, wherein the contextual metric is based upon one or more of behavior of the first user, spoken words of the first user, a location and movement of the first user, and information carried by voice tone and quality of the first user. ### Claim 14 (depends on 1) The observation platform of claim 1, wherein the second computer system is configured to store data associated with the observation platform, and wherein the stored data comprises one or more of signal logs, the signal, the compiled response, and the text achieved by the speech to text analysis of the signal. ### Claim 15 A method of query response in an observation platform, the observation platform comprising a first computer system associated with an organization, a first communication device associated with a first user, a second communication device associated with and communicatively coupled with the first computer system, and a second computer system communicatively coupled with the first computer system, the method comprising: receiving, by the second computer system from the first computer system, a signal from the first communication device, wherein a characteristic of the signal corresponds to an audible source, the audible source being a voice of the first user; receiving, by the second computer system from the first computer system, context information at least in part from a speech to text analysis of the characteristic that corresponds to the audible source, wherein the context information represents one or more attributes of the first user, and wherein the context information comprises a query about the organization made by the first user; compiling, by the second computer system, a response to the query relative to the organization; and responding, by the second computer system via the first computer system and the second communication device, to the first communication device regarding the query based on the compiled response. ### Claim 16 (depends on 15) The method as recited in claim 15, wherein the compiled response is related to the context information and the method further comprises: receiving, by the first computer system from the second computer system, the compiled response; and sending, by the first computer system via the second communication device, the compiled response to the first communication device. ### Claim 17 (depends on 15) The method as recited in claim 15, further comprising: deriving, by the first computer system, the context information at least in part from the speech to text analysis of the characteristic that corresponds to the audible source, wherein the context information comprises the query about the organization made by the first user. ### Claim 18 A non-transitory computer-usable storage medium having instructions embodied therein that when executed cause computer systems of an observation platform to perform a method of query response, the observation platform comprising a first computer system associated with an organization, a first communication device associated with a first user, a second communication device associated with and communicatively coupled with the first computer system, and a second computer system communicatively coupled with the first computer system, the method comprising: receiving, by the second computer system from the first computer system, a signal from the first communication device, wherein a characteristic of the signal corresponds to an audible source, the audible source being a voice of the first user; receiving, by the second computer system from the first computer system, context information at least in part from a speech to text analysis of the characteristic that corresponds to the audible source, wherein the context information represents one or more attributes of the first user, and wherein the context information comprises a query about the organization made by the first user; compiling, by the second computer system, a response to the query relative to the organization; and responding, by the second computer system via the first computer system and the second communication device, to the first communication device regarding the query based on the compiled response. ### Claim 19 (depends on 18) The non-transitory computer-usable storage medium as recited in claim 18, wherein the compiled response is related to the context information and the method further comprises: receiving, by the first computer system from the second computer system, the compiled response; and sending, by the first computer system via the second communication device, the compiled response to the first communication device. ### Claim 20 (depends on 18) The non-transitory computer-usable storage medium as recited in claim 18, wherein the method further comprises: deriving, by the first computer system, the context information at least in part from the speech to text analysis of the characteristic that corresponds to the audible source, wherein the context information comprises the query about the organization made by the first user.