# US 12,010,459 B1 · Separate representations of videoconference participants that use a shared device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,010,459 B1 - Document ID: US12010459B1 - Status: Granted - Kind: B1 - Application number: 17/710,731 - Filed: 2022-03-31 - Granted: 2024-06-11 - Earliest claimed: 2022-03-31 - Assignees: Amazon Technologies, Inc. - Applicants: Amazon Technologies, Inc. - Inventors: John Joseph Dunne; Michael Klingbeil; Michael Mark Goodwin; Siddhartha Shankara Rao - Web page: https://patentgrep.com/patent/US12010459B1 ## CPC - H04N 7/15: Conference systems - G06V 40/172: {Classification, e.g. identification} - G10L 17/00: Speaker identification or verification techniques - G10L 17/06: Decision making techniques; Pattern matching strategies - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/152: {Multipoint control units therefor} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A plurality of device-sharing participants may be detected that are participating in a videoconference via a shared computing device. The detecting of the plurality of device-sharing participants may be performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones or a video analysis of captured video from one or more cameras. A plurality of participant connections corresponding to the plurality of device-sharing participants may be joined to the videoconference. Each of the plurality of participant connections may be identified within the videoconference using a respective name. A plurality of video streams and a plurality of audio streams corresponding to the plurality of participant connections may be transmitted, and the plurality of video streams and the plurality of audio streams may be presented to at least one other conference participant. ## Claims ### Claim 1 A computing system comprising: one or more processors; and one or more memories having stored therein instructions that, upon execution by the one or more processors, cause the computing system to perform computing operations comprising: detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones connected to the shared computing device or a video analysis of captured video from one or more cameras connected to the shared computing device, and wherein at least one other participant also participates in the videoconference via at least one other computing device; joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name of a respective device-sharing participant of the plurality of device-sharing participants; transmitting a plurality of video streams corresponding to the plurality of participant connections, wherein each video stream of the plurality of video streams includes a respective part of the captured video corresponding to the respective device-sharing participant; and transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein each audio stream of the plurality of audio streams includes a respective part of the captured audio corresponding to the respective device-sharing participant, and wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant. ### Claim 2 (depends on 1) The computing system of claim 1, wherein the audio analysis comprises at least one of a voiceprinting analysis or a speech recognition analysis. ### Claim 3 (depends on 1) The computing system of claim 1, wherein the video analysis comprises at least one of a facial detection analysis, a facial recognition analysis, or a lip movement detection analysis. ### Claim 4 (depends on 1) The computing system of claim 1, wherein the operations further comprise: determining that a first device-sharing participant of the plurality of device-sharing participants is an active talker; and routing the captured audio via a first audio stream of the plurality of audio streams corresponding to the first device-sharing participant based on the determining that the first device-sharing participant is the active talker. ### Claim 5 (depends on 1) The computing system of claim 1, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one machine learning analysis of at least one of the captured audio or the captured video. ### Claim 6 A computer-implemented method comprising: detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein at least one other participant also participates in the videoconference via at least one other computing device; joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name; transmitting a plurality of video streams corresponding to the plurality of participant connections; and transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein each video stream of the plurality of video streams includes video of a respective device-sharing participant of the plurality of device-sharing participants. ### Claim 8 (depends on 6) The computer-implemented method of claim 6, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on an audio analysis of captured audio from one or more microphones connected to the shared computing device. ### Claim 9 (depends on 8) The computer-implemented method of claim 8, wherein the audio analysis comprises at least one of a voiceprinting analysis or a speech recognition analysis. ### Claim 10 (depends on 6) The computer-implemented method of claim 6, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on a video analysis of captured video from one or more cameras connected to the shared computing device. ### Claim 11 (depends on 10) The computer-implemented method of claim 10, wherein the video analysis comprises at least one of a facial detection analysis, a facial recognition analysis, or a lip movement detection analysis. ### Claim 12 (depends on 6) The computer-implemented method of claim 6, further comprising: determining that a first device-sharing participant of the plurality of device-sharing participants is an active talker. ### Claim 13 (depends on 12) The computer-implemented method of claim 12, further comprising: determining a plurality of voiceprints each corresponding to a respective one of the plurality of device-sharing participants. ### Claim 14 (depends on 13) The computer-implemented method of claim 13, wherein first device-sharing participant is determined to be the active talker based, at least in part, on voice characteristics of the active talker matching a first voiceprint of the plurality of voiceprints that corresponds to the first device-sharing participant. ### Claim 15 (depends on 12) The computer-implemented method of claim 12, further comprising: routing audio via a first audio stream of the plurality of audio streams corresponding to the first device-sharing participant based on the determining that the first device-sharing participant is the active talker. ### Claim 16 One or more non-transitory computer-readable storage media having stored thereon computing instructions that, upon execution by one or more compute nodes, cause the one or more compute nodes to perform computing operations comprising: detecting a plurality of device-sharing participants that are participating in a videoconference via a shared computing device, wherein at least one other participant also participates in the videoconference via at least one other computing device; joining, to the videoconference, a plurality of participant connections corresponding to the plurality of device-sharing participants, wherein each of the plurality of participant connections is identified within the videoconference using a respective name; and transmitting a plurality of video streams corresponding to the plurality of participant connections; and transmitting a plurality of audio streams corresponding to the plurality of participant connections, wherein the plurality of video streams and the plurality of audio streams are presented to the at least one other participant. ### Claim 17 (depends on 16) The one or more non-transitory computer-readable storage media of claim 16, wherein the detecting of the plurality of device-sharing participants is performed based, at least in part, on at least one of an audio analysis of captured audio from one or more microphones connected to the shared computing device or a video analysis of captured video from one or more cameras connected to the shared computing device. ### Claim 18 (depends on 16) The one or more non-transitory computer-readable storage media of claim 16, wherein the operations further comprise: determining that a first device-sharing participant of the plurality of device-sharing participants is an active talker. ### Claim 19 (depends on 18) The one or more non-transitory computer-readable storage media of claim 18, wherein the operations further comprise: providing, within the videoconference, a visual indication that indicates that the first device-sharing participant is the active talker. ### Claim 20 (depends on 18) The one or more non-transitory computer-readable storage media of claim 18, wherein the operations further comprise: routing audio via a first audio stream of the plurality of audio streams corresponding to the first device-sharing participant based on the determining that the first device-sharing participant is the active talker.