# US 2014/0156833 A1 · System and method for automatically triggered synchronous and asynchronous video and audio communications between users at different endpoints

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2014/0156833 A1
- Document ID: US20140156833A1
- Status: Published application
- Kind: A1
- Application number: 14/088,290
- Filed: 2013-11-22
- Published: 2014-06-05
- Earliest claimed: 2012-11-22
- Assignees: Perch Communications Inc.
- Applicants: Perch Communications Inc.
- Inventors: Danny Brant Robinson
- Web page: https://patentgrep.com/patent/US20140156833A1

## CPC

- H04L 43/0817: by checking functioning
- H04L 43/12: Network monitoring probes
- H04L 41/064: {involving time analysis}
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A method for audio and/or video communication between at least two endpoints in a networked environment comprises receiving a plurality of data (data points) via a plurality of notifications/sensors/probes in the networked environment, said plurality of notifications/sensors/probes monitoring the data points; analyzing the data points to determine a state of each endpoint and correlating the state of each endpoint with at least one pre-identified state, comparing state of endpoint to at least one pre-identified state to recognize if an activation event is triggered, wherein if the activation event is triggered, an action related to the pre-identified state is taken, wherein at least one of the steps is carried out by a computer device.

## Claims

### Claim 1

A method for audio and/or video communication between at least two endpoints in a networked environment comprises receiving a plurality of data (data points) via a plurality of notifiers/sensors/probes in the networked environment, said plurality of notifiers/sensors/probes monitoring the data points; analyzing the data points using at least one means of data analytics to determine a state of each endpoint and correlating the state of each endpoint with at least one pre-identified state, comparing state of endpoint to at least one pre-identified state to recognize if an activation event is triggered, wherein if the activation event is triggered, an action related to the pre-identified state is taken, wherein at least one of the steps is carried out by a computer device.

### Claim 2 (depends on 1)

The method of claim 1 wherein data analytics comprising at least one method of processing data points selected from the group consisting of: simple Boolean programmable logic, expert systems, probabilistic methods and adaptive methods (including machine learning).

### Claim 3 (depends on 1)

The method of claim 1 wherein using machine learning to analyze the data points to determine a state of each endpoint and to recognize if activation event is triggered comprises at least one of stochastic modeling, Support Vector Machines, Decision Trees, and Naieve Bayesian.

### Claim 4

A computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations relating to audio and/or video communication between at least two endpoints in a networked environment comprising: receiving a plurality of data (data points) via a plurality of notifiers/sensors/probes in the networked environment, said plurality of notifiers/sensors/probes monitoring the data points; analyzing the data points using at least one means of data analytics to determine a state of each endpoint and correlating the state of each endpoint with at least one pre-identified state, comparing state of endpoint to at least one pre-identified state to recognize if activation event is triggered, wherein if an activation event is triggered, an action related to the pre-identified state is taken.

### Claim 5

A method for audio and/or video communication between at least two endpoints in a networked environment wherein a first user is at a first endpoint and a second user is at a second endpoint which comprises a) capturing and collecting data (data points) via a plurality of notifiers/sensors/probes in the networked environment, relating to at least one of the first user and the first endpoint (first endpoint collected data), and analyzing the first endpoint collected data to determine a state of the first endpoint b) capturing and collecting data (data points) via a plurality of notifiers/sensors/probes in the networked environment, relating to at least one of the second user and the second endpoint (second endpoint collected data) and analyzing the second endpoint collected data to determine a state of the second endpoint, c) correlating the state of at least one of the first endpoint and the second endpoint with at least one pre-identified state and comparing state of at least one endpoint to at least one pre-identified state to recognize if an activation event is triggered, wherein if the activation event is triggered, an action related to the pre-identified state is taken, wherein at least one of the steps is carried out by a computer device and wherein data points are analyzed using at least one means of data analytics

### Claim 6 (depends on 5)

The method of claim 5 wherein data (data points) comprises at least one of: user specific features, endpoint features, user identity, user presence, environmental features at the endpoint, external cues, features and inputs and specific, pre-determined settings relating to the relationship between the first endpoint and the second endpoint.

### Claim 7 (depends on 5)

The method of claim 5 wherein data (data points) relate to at least one of the user presence and identity and are captured and collected by at least one of: proximity detection means, facial detection means, voice detection means, motion detection means, gesture detection means, biometric detection means and audio detection means.

### Claim 8 (depends on 5)

The method of claim 5 wherein data (data points) relate to environmental features selected from the group consisting of: time at an endpoint, day at an endpoint, weather at an endpoint, ambient light at an endpoint, physical location of an endpoint, network to which endpoint connected (or connectable), user at endpoint, group presence at endpoint, and corporate presence at endpoint.

### Claim 9 (depends on 5)

The method of claim 5 wherein data (data points) relate to at least one of user cues and endpoint cues and are selected from the group consisting of: system notifications to user, previous connection history of user to any endpoint, previous connection patterns of user to any endpoint, user's availability, user's location and user's mobility.

### Claim 10 (depends on 5)

The method of claim 5 wherein data (data points) relate to at least one of i) user's availability, location and mobility, any of which are detected via feedback from user's networked mobile device and ii) user generated data including data points generated or acquired by software and applications used by or connected to user on networked computing device or networked mobile device.

### Claim 11 (depends on 5)

The method of claim 5 wherein data (data points) relate to external cues, features and inputs selected from the group consisting of: activities relating to a user, a company or a group related to user, calendar systems, email systems, contact lists, social networks, and enterprise collaboration systems.

### Claim 12 (depends on 5)

The method of claim 5 wherein the action is related to operation of a communication system.

### Claim 13 (depends on 5)

The method of claim 5 wherein the action is selected from the group consisting of: transmission of data between endpoints, transmission of audio between endpoints, transmission of video between endpoints, transmission of user presence data, initiation of a call between the first user and the second user, transferring a call by at least one user, sending a notification to the first user, the second user or a third party, transmission of a prompt to a user to take an action, storage of data, updating data, making computational changes to existing data/data points, generating or updating data for use within the system, streaming data to a server and thereafter, either synchronously or asynchronously (in any combination thereof) to one or more intended users/recipients at the endpoints and other actions as are defined by a user.

### Claim 14 (depends on 5)

The method of claim 5 wherein a pre-determined combination of data points forms an activation event and wherein said pre-determined combination of data points is selected by one of: a) a third party service provider; b) a network provider; and c) a user.

### Claim 15 (depends on 5)

The method of claim 5 wherein user is engaged with a microprocessing device selected from the group consisting of desktop computer, laptop computer, personal digital assistant, Smartphone and tablet.

### Claim 16 (depends on 5)

The method of claim 5 wherein data analytics comprises at least one method of processing data points selected from the group consisting of: simple Boolean programmable logic, expert systems, probabilistic methods and adaptive methods (including machine learning).

### Claim 17 (depends on 5)

The method of claim 5 wherein there are a plurality of users at a plurality of endpoints.

### Claim 18

A computer storage medium encoded with a computer program, the program comprising instructions that when executed by one or more computers cause the one or more computers to perform operations relating to audio and/or video communication between at least two endpoints in a networked environment wherein a first user is at a first endpoint and a second user is at a second endpoint comprising: a) capturing and collecting data (data points) via a plurality of notifications/sensors/probes in the networked environment, relating to at least one of the first user and the first endpoint (first endpoint collected data), and analyzing the first endpoint collected data to determine a state of the first endpoint b) capturing and collecting data (data points) via a plurality of notifications/sensors/probes in the networked environment, relating to at least one of the second user and the second endpoint (second endpoint collected data) and analyzing the second endpoint collected data to determine a state of the second endpoint, c) correlating the state of at least one of the first endpoint and the second endpoint with at least one pre-identified state and comparing state of at least one endpoint to at least one pre-identified state to recognize if an activation event is triggered, wherein if the activation event is triggered, an action related to the pre-identified state is taken and wherein data points are analyzed and activation events recognized using at least one means of data analytics

### Claim 19

A system for audio and/or video communication between at least two endpoints in a networked environment wherein a first user is at a first endpoint on a first system and a second user is at a second endpoint on a second system which comprises:
a) a communication control server (CCS)
b) a video-over-telephony system (VOIPS) enabling communication between first endpoint and second endpoint;
c) at least one video and/or audio capture device and microprocessor at a each of first endpoint and second endpoint; and
d) at least one external data interface add storage (EDIS);
wherein said CCS collects data points, analyzes data points and compares the state of at least one endpoint to at least one pre-identified state to recognize if an activation event is triggered, wherein if the activation event is triggered, an action related to the pre-identified state is taken.

### Claim 20 (depends on 19)

The system of claim 19 wherein CCS comprises a data sources hub into which is relayed data points from or relating to endpoints and data from EDIS; an activation event database and a CCS database.

### Claim 21

A method for optimizing the conveyance and display of information to a first user at a first endpoint in regards to an audio and/or video communication between at least two endpoints (including the first endpoint) in a networked environment which comprises:
a) capturing and collecting data (data points) via at least one of i) a plurality of notifiers/sensors/probes in the networked environment, relating to at least one of the first user and the first endpoint and ii) an external data interface and storage system (EDIS) and wherein such data points relate at least to the first user, the environment and the endpoints and wherein EDIS comprises appropriate API Connectors to access, query and acquire the data points from the external systems;
b) comparing the data points to a proposed start time for an audio and/or video transfer/communication requiring presence and/or engagement of the user; and
c) leveraging the data points to augment the way in which one or more of the endpoints are accessible to, visible to or arranged for the first user.
