# US 8,787,547 B2 · Selective audio combination for a conference > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,787,547 B2 - Document ID: US8787547B2 - Status: Granted - Kind: B2 - Application number: 12/765,944 - Filed: 2010-04-23 - Published: 2011-10-27 - Granted: 2014-07-22 - Earliest claimed: 2010-04-23 - Assignees: LifeSize Communications, Inc. - Applicants: Ashish Goyal; Hrishikesh G. Kulkarni; Hitesh Chouhan; Sampath Kumar Srinivas; Vivek Wamorkar; Raghuram Belur - Inventors: Ashish Goyal; Hrishikesh G. Kulkarni; Hitesh Chouhan; Sampath Kumar Srinivas; Vivek Wamorkar; Raghuram Belur - Web page: https://patentgrep.com/patent/US8787547B2 ## CPC - H04N 7/152: {Multipoint control units therefor} - H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract Selective audio combination for a conference. The conference may be initiated between a plurality of participants at respective participant locations. The conference may be performed using a plurality of conferencing endpoints at each of the participant locations. Audio may be received from each of the plurality of conferencing endpoints. Audio level information may also be received from each of the plurality of conferencing endpoints. The audio may be combined from a plural subset of the plurality of conferencing endpoints to produce conference audio. The plural subset is less than all of the plurality of conferencing endpoints. The audio may be combined based on the audio level information. The conference audio may be provided to the plurality of conferencing endpoints. ## Claims ### Claim 1 A computer accessible non-transitory memory medium storing program instructions for performing a conference, wherein the program instructions are executable by a processor of a multipoint control unit (MCU) to implement: hosting a conference between a plurality of participants at respective participant locations, wherein the conference is performed using a plurality of endpoints at the respective participant locations; receiving audio from each of the plurality of endpoints; receiving audio level information from each of the plurality of endpoints; combining the audio from a plural subset of the plurality of endpoints to produce conference audio, wherein the audio from the plural subset is combined based on the audio level information, wherein the plural subset is less than all of the plurality of conferencing endpoints, wherein said combining comprises analyzing the audio level information from each of the plurality of endpoints to determine audio from a designated number (n) of videoconferencing endpoints which have highest audio levels, wherein the value of n is determined dynamically based on said analyzing, and wherein said combining the audio from the plural subset of the plurality of endpoints comprises combining only the audio from the n endpoints; and providing the conference audio to the plurality of endpoints. ### Claim 2 (depends on 1) The non-transitory memory medium of claim 1, wherein the audio level information is received as a header associated with the audio stream. ### Claim 3 (depends on 1) The non-transitory memory medium of claim 1, wherein the level information is received as out of band signaling. ### Claim 4 (depends on 1) The non-transitory memory medium of claim 1, wherein the program instructions are further executable to implement: allocating a decoder for each of the plural subset of the plurality of conferencing endpoints based on the level information; and decoding the audio from the plural subset of the plurality of endpoints based on the audio level information. ### Claim 5 (depends on 1) The non-transitory memory medium of claim 1, wherein said receiving, said combining, and said providing are performed a plurality of times in a dynamic fashion during the conference. ### Claim 6 (depends on 1) The computer accessible non-transitory memory medium of claim 1, wherein the MCU is comprised in an endpoint in the conference. ### Claim 7 A method for performing a conference, comprising: a multipoint control unit (MCU) hosting a conference between a plurality of participants at respective participant locations, wherein the conference is performed using a plurality of endpoints at the respective participant locations; the MCU receiving audio from each of the plurality of videoconferencing endpoints; the MCU receiving audio level information from each of the plurality of endpoints; the MCU combining the audio from a plural subset of the plurality of endpoints to produce conference audio, wherein the audio from the plural subset is combined based on the audio level information, wherein the plural subset is less than all of the plurality of conferencing endpoints, wherein said combining comprises analyzing the audio level information from each of the plurality of endpoints to determine audio from a designated number (n) of videoconferencing endpoints which have highest audio levels, wherein the value of n is determined dynamically based on said analyzing, and wherein said combining the audio from the plural subset of the plurality of endpoints comprises combining only the audio from the n endpoints; and the MCU providing the conference audio to the plurality of videoconferencing endpoints. ### Claim 8 (depends on 7) The method of claim 7, wherein the audio level information is received as a header of the audio. ### Claim 9 (depends on 7) The method of claim 7, wherein said receiving, said combining, and said providing are performed a plurality of times in a dynamic fashion during the conference. ### Claim 10 (depends on 7) The method of claim 7, wherein the MCU is comprised in an endpoint in the conference. ### Claim 11 A multi-point control unit (MCU), comprising: a processor; one or more inputs coupled to the processor; one or more decoders coupled to the processor; one or more outputs coupled to the processor; one or more encoders coupled to the processor; and a memory medium coupled to the processor, wherein the memory medium stores program instructions for performing a videoconference, wherein the program instructions are executable by the processor to implement: hosting a conference between a plurality of participants at respective participant locations, wherein the conference is performed using a plurality of endpoints at the respective participant locations; receiving encoded audio from each of the plurality of endpoints via the one or more inputs; receiving audio level information from each of the plurality of endpoints; decoding the encoded audio from a plural subset of the plurality of endpoints using the one or more decoders to produce decoded audio, wherein the audio from the plural subset is decoded based on the audio level information, and wherein the plural subset is less than all of the plurality of endpoints, said decoding comprising analyzing the audio level information from each of the plurality of endpoints to determine audio from a designated number (n) of videoconferencing endpoints which have highest audio levels, wherein the value of n is determined dynamically based on said analyzing, and wherein said combining the audio from the plural subset of the plurality of endpoints comprises combining only the audio from the n endpoints; encoding the decoded audio using the one or more encoders to produce conference audio; and providing the conference audio to the plurality of endpoints via the one or more outputs. ### Claim 12 (depends on 11) The MCU of claim 11, wherein said receiving, said decoding, said encoding, and said providing are performed a plurality of times in a dynamic fashion during the conference. ### Claim 13 (depends on 11) The MCU of claim 11, wherein the MCU is comprised in an endpoint in the conference.