# US 2015/0103136 A1 · Methods and systems for multi-factor authentication in secure media-based conferencing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2015/0103136 A1 - Document ID: US20150103136A1 - Status: Published application - Kind: A1 - Application number: 14/480,091 - Filed: 2014-09-08 - Published: 2015-04-16 - Earliest claimed: 2013-10-11 - Assignees: Edifire LLC - Applicants: Edifire LLC - Inventors: Eric Anderson; Daniel P. Goepp - Web page: https://patentgrep.com/patent/US20150103136A1 ## CPC - H04M 3/38: Graded-service arrangements, i.e. some subscribers prevented from establishing certain connections (queuing arrangements H04Q3/64) - H04L 12/18: for broadcast or conference {, e.g. multicast} - H04L 12/1818: {Conference organisation arrangements, e.g. handling schedules, setting up parameters needed by nodes to attend a conference, booking network resources, notifying involved parties} - H04L 65/1069: Session establishment or de-establishment - H04L 65/1076: Screening of IP real time communications, e.g. spam over Internet telephony [SPIT] - H04L 65/1093: by adding participants; by removing participants - H04L 65/4038: with floor control - H04L 65/70: Media network packetisation - H04M 3/56: Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities (video conference systems H04N7/15) - H04M 3/567: {Multimedia conference systems} - H04N 7/152: {Multipoint control units therefor} - H04N 7/155: {involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831)} - H04M 2203/6009: Personal information, e.g. profiles or personal directories being only provided to authorised persons - H04M 2203/6054: Biometric subscriber identification - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Methods and apparatuses, including computer program products, are described for multi-factor authentication of media-based (e.g., video and/or audio) conferencing between a plurality of end point devices. The methods and apparatuses provide for analysis of an end point media stream using a matrix of authentication factors, where the authentication factors include at least two of: user-specific facial recognition attributes, user-specific audio recognition attributes, acoustic environment attributes, visual environment attributes, user gesture attributes, technical attributes of the end point device, and technical attributes of the media stream, to determine an authentication score for the first end point device. ## Claims ### Claim 1 A computerized method for authenticating an end point device participating in a media-based conference call, the method comprising: receiving, by a call processing module of a server computing device, a request to join a conference call between a plurality of end point devices, the request including credentials and attributes associated with a user of a first end point device, attributes associated with the first end point device, and a media stream associated with the first end point device; determining, at the call processing module, an identity of the user of the first end point device based upon the credentials and the attributes associated with the user; determining, at the call processing module, a level of conference call access based upon the attributes associated with the first end point device; retrieving, by the call processing module, a user profile based upon the identity of the user, the user profile including a set of permissions associated with authorization to participate in the conference call; generating, by the call processing module, a fingerprint associated with the request, the fingerprint comprising attributes derived from the user profile, the attributes associated with the end point device, and the requested conference call; analyzing, by the call processing module, the media stream using a matrix of authentication factors, wherein the authentication factors include at least two of: user-specific facial recognition attributes, user-specific audio recognition attributes, acoustic environment attributes, visual environment attributes, user gesture attributes, technical attributes of the end point device, and technical attributes of the media stream; determining, by the call processing module, an authentication score for the first end point device based upon the media stream analysis; and determining, by the call processing module, whether to connect the first end point device to the conference call, another media resource, or another user of a network or communication system based upon the authentication score and the fingerprint. ### Claim 2 (canceled) ### Claim 3 (depends on 1) The method of claim 1, wherein the acoustic environment attributes include (i) one or more pre-recorded audio files from a user and (ii) acoustic attributes of a room in which the first end point device is located. ### Claim 4 (depends on 1) The method of claim 1, wherein the visual environment attributes include (i) user-provided or system-captured still images and multiple video frames and (ii) lighting attributes of a room in which the first end point device is located. ### Claim 5 (depends on 1) The method of claim 1, wherein the technical attributes of the first end point device include an image resolution of a camera coupled to the first end point device, a device identifier, a location, and an originating address. ### Claim 6 (depends on 1) The method of claim 1, wherein the technical attributes of the media stream include a media format and a media quality. ### Claim 7 (depends on 1) The method of claim 1, further comprising: transmitting, by the call processing module, the media stream associated with the first end point device to one or more other end point devices connected to the conference call; receiving, by the call processing module, a validation signal from the one or more other end point devices to confirm an identity of a user of the first end point device; and adding, by the call processing module, the received validation signal to the matrix of authentication factors. ### Claim 8 (depends on 1) The method of claim 1, wherein the media stream analysis includes comparing the matrix of authentication factors for the media stream to a matrix of authentication factors for prior media streams associated with the first end point device. ### Claim 9 (depends on 8) The method of claim 8, wherein the media stream analysis includes analyzing the matrix of authentication factors for the media stream based upon user- and/or system-specified preferences. ### Claim 10 (depends on 1) The method of claim 1, further comprising storing, by the call processing module, the media stream analysis and authentication score for the media stream in a database. ### Claim 11 (depends on 1) The method of claim 1, wherein the media stream analysis and authentication score determination occur periodically during the conference call. ### Claim 12 (depends on 1) The method of claim 1, wherein the authentication score is below a predetermined threshold, the method further comprising transmitting, by the call processing module, a request for user credentials to the first end point device. ### Claim 13 (depends on 1) The method of claim 1, further comprising transmitting, by the call processing module, the authentication score for the first end point device for display on one or more other end point devices connected to the conference call. ### Claim 14 (depends on 1) The method of claim 1, further comprising: denying, by the call processing module, the request to join the conference call when the authentication score is below a predetermined threshold; and disconnecting, by the call processing module, the first end point device. ### Claim 15 (depends on 1) The method of claim 1, further comprising: allowing, by the call processing module, the request to join the conference call when the authentication score is at or above a predetermined threshold; and connecting, by the call processing module, the first end point device to the conference call. ### Claim 16 A system for authenticating an end point device participating in a media-based conference call, the system comprising a server computing device having a call processing module configured to: receive a request to join a conference call between a plurality of end point devices, the request including credentials and attributes associated with a user of a first end point device, attributes associated with the first end point device, and a media stream associated with the first end point device; determine an identity of the user of the first end point device based upon the credentials and the attributes associated with the user; determine a level of conference call access based upon the attributes associated with the first end point device; retrieve a user profile based upon the identity of the user, the user profile including a set of permissions associated with authorization to participate in the conference call; generate a fingerprint associated with the request, the fingerprint comprising attributes derived from the user profile, the attributes associated with the end point device, and the requested conference call; analyze the media stream using a matrix of authentication factors, wherein the authentication factors include at least two of: user-specific facial recognition attributes, user-specific audio recognition attributes, acoustic environment attributes, visual environment attributes, user gesture attributes, technical attributes of the end point device, and technical attributes of the media stream; determine an authentication score for the first end point device based upon the media stream analysis; and determine whether to connect the first end point device to the conference call, another media resource, or another user of a network or communication system based upon the authentication score and the fingerprint. ### Claim 17 (canceled) ### Claim 18 (depends on 16) The system of claim 16, wherein the acoustic environment attributes include (i) one or more pre-recorded audio files from a user and (ii) acoustic attributes of a room in which the first end point device is located. ### Claim 19 (depends on 16) The system of claim 16, wherein the visual environment attributes include (i) user-provided or system-captured still images and multiple video frames and (ii) lighting attributes of a room in which the first end point device is located. ### Claim 20 (depends on 16) The system of claim 16, wherein the technical attributes of the first end point device include an image resolution of a camera coupled to the first end point device, a device identifier, a location, and an originating address. ### Claim 21 (depends on 16) The system of claim 16, wherein the technical attributes of the media stream include a media format and a media quality. ### Claim 22 (depends on 16) The system of claim 16, wherein the call processing module is further configured to: transmit the media stream associated with the first end point device to one or more other end point devices connected to the conference call; receive a validation signal from the one or more other end point devices to confirm an identity of a user of the first end point device; and add the received validation signal to the matrix of authentication factors. ### Claim 23 (depends on 16) The system of claim 16, wherein the media stream analysis includes comparing the matrix of authentication factors for the media stream to a matrix of authentication factors for prior media streams associated with the first end point device. ### Claim 24 (depends on 23) The method of claim 23, wherein the media stream analysis includes analyzing the matrix of authentication factors for the media stream based upon user- and/or system-specified preferences. ### Claim 25 (depends on 16) The system of claim 16, wherein the call processing module is further configured to store the media stream analysis and authentication score for the media stream in a database. ### Claim 26 (depends on 16) The system of claim 16, wherein the media stream analysis and authentication score determination occur periodically during the conference call. ### Claim 27 (depends on 16) The system of claim 16, wherein the authentication score is below a predetermined threshold, the call processing module further configured to transmit a request for user credentials to the first end point device. ### Claim 28 (depends on 16) The system of claim 16, wherein the call processing module is further configured to: deny the request to join the conference call when the authentication score is below a predetermined threshold; and disconnect the first end point device. ### Claim 29 (depends on 16) The system of claim 16, wherein the call processing module is further configured to: allow the request to join the conference call when the authentication score is at or above a predetermined threshold; and connect the first end point device to the conference call. ### Claim 30 A computer program product, tangibly embodied in a non-transitory computer readable storage device, for authenticating an end point device participating in a media-based conference call, the computer program product including instructions operable to cause a call processing module of a server computing device to: receive a request to join a conference call between a plurality of end point devices, the request including credentials and attributes associated with a user of a first end point device, attributes associated with the first end point device, and a media stream associated with the first end point device; determine an identity of the user of the first end point device based upon the credentials and the attributes associated with the user; determine a level of conference call access based upon the attributes associated with the first end point device; retrieve a user profile based upon the identity of the user, the user profile including a set of permissions associated with authorization to participate in the conference call; generate a fingerprint associated with the request, the fingerprint comprising attributes derived from the user profile, the attributes associated with the end point device, and the requested conference call; analyze the media stream using a matrix of authentication factors, wherein the authentication factors include at least two of: user-specific facial recognition attributes, user-specific audio recognition attributes, acoustic environment attributes, visual environment attributes, user gesture attributes, technical attributes of the end point device, and technical attributes of the media stream; determine an authentication score for the first end point device based upon the media stream analysis; and determine whether to connect the first end point device to the conference call, another media resource, or another user of a network or communication system based upon the authentication score and the fingerprint.