# US 12,224,874 B2 · Adaptive background in video conferencing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,224,874 B2 - Document ID: US12224874B2 - Status: Granted - Kind: B2 - Application number: 18/467,946 - Filed: 2023-09-15 - Published: 2024-01-04 - Granted: 2025-02-11 - Earliest claimed: 2022-03-21 - Assignees: Cisco Technology, Inc. - Applicants: Cisco Technology, Inc. - Inventors: Zhaoyi Jin; Hongling Cen; Bhargavkumar Ghanshyamlal Pandya; Yasi Xi; Sebastian Jeuk; Maria Soledad Palmero; Gonzalo Salgueiro - Web page: https://patentgrep.com/patent/US12224874B2 ## CPC - H04L 12/1813: {for computer conferences, e.g. chat rooms (instant messaging H04L51/04; protocols for multimedia communication H04L65/1101; arrangements for multi-party communication H04L65/403; telephonic conference arrangements H04M3/56; television conference systems H04N7/15)} - H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - H04L 12/1827: {Network arrangements for conference optimisation or adaptation} - H04L 51/10: Multimedia information - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Methods are provided in which a collaboration server connects at least two participants via respective user devices to a collaboration session. The collaboration server further distributes, to the respective user devices, media stream data and one or more customized graphical items that are distinguishably displayed in the collaboration session. The one or more customized graphical items are displayed in a foreground or a background associated with a collaboration space of first participant of the at least two participants. The collaboration server further detects a selection, by one of the respective user devices, of a graphical item from the one or more customized graphical items displayed in the collaboration space and performs at least one action associated with the graphical item during the collaboration session based on detecting the selection of the graphical item. ## Claims ### Claim 1 A method comprising: connecting, by a collaboration server, at least two participants via respective user devices to a collaboration session; detecting, by the collaboration server, in a collaboration space, at least one element contextually relevant to the collaboration session by contextually analyzing media stream data of the collaboration session; generating, by the collaboration server, at least one actionable object based on the at least one element being detected in the collaboration space and by replacing the at least one element with the at least one actionable object that is modifiable in the collaboration space during the collaboration session by one or more of the at least two participants; and providing, by the collaboration server, the at least one actionable object in the collaboration space during the collaboration session by integrating the at least one actionable object into a background or a foreground of a respective participant view at a location where the at least one element is being detected. ### Claim 2 (depends on 1) The method of claim 1, wherein detecting in the collaboration space the at least one element includes one or more of: detecting a first element in a background of the collaboration space based on participant interactions; or detecting a second element in a foreground of the collaboration space based on the participant interactions. ### Claim 3 (depends on 1) The method of claim 1, wherein detecting in the collaboration space the at least one element includes: detecting one or more interactions of the at least two participants with the at least one element; and detecting changes related to the at least one element in the collaboration space during the collaboration session. ### Claim 4 (depends on 1) The method of claim 1, wherein generating the at least one actionable object includes one or more of: transforming a respective image element into a respective actionable object that is capable of being modified by one or more of the at least two participants via the respective user devices; or associating at least one action to the respective image element, wherein the at least one action is performed based on a selection of the respective actionable object. ### Claim 5 (depends on 4) The method of claim 4, wherein providing the at least one actionable object in the collaboration space during the collaboration session includes: replacing the respective image element with the respective actionable object in the collaboration space during the collaboration session. ### Claim 6 (depends on 5) The method of claim 5, further comprising: detecting one or more interactions with the respective actionable object; and based on the one or more interactions with the respective actionable object, modifying the collaboration space to include the respective actionable object that is modified based on the one or more interactions or to return to displaying the respective image element. ### Claim 7 (depends on 1) The method of claim 1, wherein providing the at least one actionable object in the collaboration space during the collaboration session is based on an access level of a respective participant of the at least two participants. ### Claim 8 (depends on 1) The method of claim 1, further comprising: selecting the at least one actionable object from the collaboration space during the collaboration session into an embedded application associated with a first participant of the at least two participants of the collaboration session. ### Claim 9 (depends on 8) The method of claim 8, wherein the embedded application provides a view that includes a plurality of customized graphical items selectable by the first participant for the collaboration space, and wherein the embedded application further provides for setting at least one action to be performed based on a selection of a graphical item from one or more customized graphical items displayed in the collaboration space. ### Claim 10 (depends on 9) The method of claim 9, further comprising: detecting, by the collaboration server, the selection of the graphical item from the one or more customized graphical items displayed in the collaboration space; and performing the at least one action associated with the graphical item during the collaboration session based on detecting the selection of the graphical item. ### Claim 11 (depends on 1) The method of claim 1, wherein the at least one actionable object is similar in appearance to the at least one element. ### Claim 12 An apparatus comprising: a memory; a network interface configured to enable network communications; and a processor, wherein the processor is configured to perform operations comprising: connecting at least two participants via respective user devices to a collaboration session; detecting, in a collaboration space, at least one element contextually relevant to the collaboration session by contextually analyzing media stream data of the collaboration session; generating at least one actionable object based on the at least one element being detected in the collaboration space and by replacing the at least one element with the at least one actionable object that is modifiable in the collaboration space during the collaboration session by one or more of the at least two participants; and providing the at least one actionable object in the collaboration space during the collaboration session by integrating the at least one actionable object into a background or a foreground of a respective participant view at a location where the at least one element is being detected. ### Claim 13 (depends on 12) The apparatus of claim 12, wherein the processor is configured to detect in the collaboration space the at least one element by performing one or more of: detecting a first element in a background of the collaboration space based on participant interactions; or detecting a second element in a foreground of the collaboration space based on the participant interactions. ### Claim 14 (depends on 12) The apparatus of claim 12, wherein the processor is configured to detect in the collaboration space the at least one element by: detecting one or more interactions of the at least two participants with the at least one element; and detecting changes related to the at least one element in the collaboration space during the collaboration session. ### Claim 15 (depends on 12) The apparatus of claim 12, wherein the processor is configured to generate the at least one actionable object by performing one or more of: transforming a respective image element into a respective actionable object that is capable of being modified by one or more of the at least two participants via the respective user devices; or associating at least one action to the respective image element, wherein the at least one action is performed based on a selection of the respective actionable object. ### Claim 16 (depends on 15) The apparatus of claim 15, wherein the processor is configured to provide the at least one actionable object in the collaboration space during the collaboration session by: replacing the respective image element with the respective actionable object in the collaboration space during the collaboration session. ### Claim 17 (depends on 16) The apparatus of claim 16, wherein the processor is further configured to perform: detecting one or more interactions with the respective actionable object; and based on the one or more interactions with the respective actionable object, modifying the collaboration space to include the respective actionable object that is modified based on the one or more interactions or to return to displaying the respective image element. ### Claim 18 (depends on 16) The apparatus of claim 16, wherein the processor is configured to provide the at least one actionable object in the collaboration space during the collaboration session is based on an access level of a respective participant of the at least two participants. ### Claim 19 One or more non-transitory computer readable storage media encoded with instructions that, when executed by a processor, cause the processor to execute a method comprising: connecting at least two participants via respective user devices to a collaboration session; detecting, in a collaboration space, at least one element contextually relevant to the collaboration session by contextually analyzing media stream data of the collaboration session; generating at least one actionable object based on the at least one element being detected in the collaboration space and by replacing the at least one element with the at least one actionable object that is modifiable in the collaboration space during the collaboration session by one or more of the at least two participants; and providing the at least one actionable object in the collaboration space during the collaboration session by integrating the at least one actionable object into a background or a foreground of a respective participant view at a location where the at least one element is being detected. ### Claim 20 (depends on 19) The one or more non-transitory computer readable storage media of claim 19, wherein detecting in the collaboration space the at least one element includes one or more of: detecting a first element in a background of the collaboration space based on participant interactions; or detecting a second element in a foreground of the collaboration space based on the participant interactions.