# US 12,192,675 B2 · Recreating keyboard and mouse sounds within virtual working environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,192,675 B2 - Document ID: US12192675B2 - Status: Granted - Kind: B2 - Application number: 17/823,789 - Filed: 2022-08-31 - Published: 2024-02-29 - Granted: 2025-01-07 - Earliest claimed: 2022-08-31 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Brandon Francis; Andrew Cheng-Min Lin; Walton Lin - Web page: https://patentgrep.com/patent/US12192675B2 ## CPC - H04N 7/15: Conference systems - G06F 3/0202: {Constructional details or processes of manufacture of the input device} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - H04L 65/1083: In-session procedures - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for recreating keyboard and mouse sounds within a virtual working environment. The program and method provide for receiving, from a first client device of a first participant of a group of participants within a virtual working environment, a timing of keyboard and mouse input detected at the client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; and providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices. ## Claims ### Claim 1 A method, comprising: receiving, from a first client device of a first participant of a group of participants within a virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices; determining, based on the timing of the keyboard and mouse input, that the first participant is active or idle with respect to use of the first client device; providing, to the one or more second client devices, an indication that the first participant is active or idle; and providing, for each participant of the plural participants, display of a transparent, full-screen window to overlay a desktop display, wherein the indication is presented on a dock that is displayed on the transparent, full-screen window. ### Claim 2 (depends on 1) The method of claim 1, wherein the virtual working environment is implemented by a virtual conferencing system which provides for displaying the transparent, full-screen window. ### Claim 3 (depends on 1) The method of claim 1, wherein generating the keyboard and mouse sounds is based on respectively positioning audio for each participant in the group of participants across a stereo field, such that the keyboard and mouse sounds are audibly perceived as corresponding to the first participant. ### Claim 4 A method comprising: providing a configuration interface for configuring a virtual working environment for the plural participants, the configuration interface for specifying groups of participants within the virtual working environment, each group comprising respective participants selected from among the plural participants; receiving an indication of user input provided via the configuration interface, the user input specifying the group of participants; receiving, from a first client device of a first participant of the group of participants within the virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; and providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices. ### Claim 5 (depends on 1) The method of claim 1, wherein each group of participants is provided to simulate a group of co-workers in a physical office. ### Claim 6 A system comprising: a processor; and a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising: receiving, from a first client device of a first participant of a group of participants within a virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices; determining, based on the timing of the keyboard and mouse input, that the first participant is active or idle with respect to use of the first client device; providing, to the one or more second client devices, an indication that the first participant is active or idle; and providing, for each participant of the plural participants, display of a transparent, full-screen window to overlay a desktop display, wherein the indication is presented on a dock that is displayed on the transparent, full-screen window. ### Claim 7 (depends on 6) The system of claim 6, wherein the virtual working environment is implemented by a virtual conferencing system which provides for displaying the transparent, full-screen window. ### Claim 8 (depends on 6) The system of claim 6, wherein generating the keyboard and mouse sounds is based on respectively positioning audio for each participant in the group of participants across a stereo field, such that the keyboard and mouse sounds are audibly perceived as corresponding to the first participant. ### Claim 9 A system comprising: a processor; and a memory storing instructions that, when executed by the processor, configure the processor to perform operations comprising: providing a configuration interface for configuring a virtual working environment for plural participants, the configuration interface for specifying groups of participants within the virtual working environment, each group comprising respective participants selected from among the plural participants; receiving an indication of user input provided via the configuration interface, the user input specifying the group of participants; receiving, from a first client device of a first participant of the group of participants within the virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; and providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices. ### Claim 10 (depends on 6) The system of claim 6, wherein each group of participants is provided to simulate a group of co-workers in a physical office. ### Claim 11 A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising: receiving, from a first client device of a first participant of a group of participants within a virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices; determining, based on the timing of the keyboard and mouse input, that the first participant is active or idle with respect to use of the first client device; providing, to the one or more second client devices, an indication that the first participant is active or idle; and providing, for each participant of the plural participants, display of a transparent, full-screen window to overlay a desktop display, wherein the indication is presented on a dock that is displayed on the transparent, full-screen window. ### Claim 12 (depends on 11) The computer-readable medium of claim 11, wherein the virtual working environment is implemented by a virtual conferencing system which provides for displaying the transparent, full-screen window. ### Claim 13 (depends on 11) The computer-readable medium of claim 11, wherein generating the keyboard and mouse sounds is based on respectively positioning audio for each participant in the group of participants across a stereo field, such that the keyboard and mouse sounds are audibly perceived as corresponding to the first participant. ### Claim 14 A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising: providing a configuration interface for configuring a virtual working environment for plural participants, the configuration interface for specifying groups of participants within the virtual working environment, each group comprising respective participants selected from among the plural participants; receiving an indication of user input provided via the configuration interface, the user input specifying the group of participants; receiving, from a first client device of a first participant of the group of participants within the virtual working environment, a timing of keyboard and mouse input detected at the first client device, the group of participants having been selected from among plural participants of the virtual working environment; generating, in response to the receiving, keyboard and mouse sounds that correspond to the timing of the keyboard and mouse input; providing the generated keyboard and mouse sounds to one or more second client devices of respective one or more second participants of the group of participants, for presentation on the one or more second client devices.