# US 12,118,149 B2 · Virtual reality communication interface with haptic feedback response > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,118,149 B2 - Document ID: US12118149B2 - Status: Granted - Kind: B2 - Application number: 17/646,418 - Filed: 2021-12-29 - Published: 2022-10-06 - Granted: 2024-10-15 - Earliest claimed: 2021-03-31 - Assignees: Snap Inc. - Applicants: Snap Inc. - Inventors: Alexander P. Powell; Mark Thomas - Web page: https://patentgrep.com/patent/US12118149B2 ## CPC - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/014: {Hand-worn input/output arrangements, e.g. data gloves} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - H04L 65/1089: by adding media; by removing media - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract Method starts with processor causing virtual reality (VR) interface for communication session to be displayed on first user interface of a first head-wearable apparatus and on second user interface of second head-wearable apparatus. Processor detects first touch input from first VR input device and second touch input from second VR input device. Processor monitors location of the first touch input within the first user interface and location of the second touch input within second user interface. Processor determines distance between location of the first touch input within first user interface and location on first user interface corresponding to location of second touch input within second user interface. Processor causes first and second VR input devices to generate haptic feedback response based on the distance. Haptic feedback response increases in intensity or speed as distance decreases and decreases in intensity or speed as distance increases. Other embodiments are described herein. ## Claims ### Claim 1 A system comprising: a processor; and a memory having instructions thereon, when executed by the processor, causes the system to perform operations comprising: causing a virtual reality (VR) interface for a communication session to be displayed on a first user interface of a first head-wearable apparatus and on a second user interface of a second head-wearable apparatus, wherein the communication session is between a plurality of head-wearable apparatuses including the first head-wearable apparatus and the second head-wearable apparatus; detecting a first touch input from a first VR input device coupled to the first head-wearable apparatus and a second touch input from a second VR input device coupled to the second head-wearable apparatus; monitoring a location of the first touch input within the first user interface and a location of the second touch input within the second user interface; determining a distance between the location of the first touch input within the first user interface and a location on the first user interface corresponding to the location of the second touch input within the second user interface; causing the first VR input device and the second VR input device to generate a haptic feedback response based on the distance, wherein the haptic feedback response increases in intensity or speed as the distance decreases and decreases in intensity or speed as the distance increases; and in response to determining that the distance is below a predetermined threshold, causing the first user interface and the second user interface to generate an augmentation to the VR interface, wherein the augmentation comprises a visual effect and a sound effect. ### Claim 2 (depends on 1) The system of claim 1, wherein a first user of the first head-wearable apparatus and a second user of the second head-wearable apparatus are present in the communication session. ### Claim 3 (depends on 1) The system of claim 1, wherein the system to perform the operations further comprising: in response to determining that the distance is below the predetermined threshold, causing the first VR input device and the second VR input device to generate a reward haptic feedback response, the reward haptic response is different from the haptic feedback response. ### Claim 4 (depends on 3) The system of claim 3, wherein the haptic feedback response comprises a first vibration pattern and the reward haptic feedback response comprises a second vibration pattern that is different from the first vibration pattern. ### Claim 5 (depends on 1) The system of claim 1, wherein the augmentation further comprises an overlay. ### Claim 6 (depends on 1) The system of claim 1, wherein the augmentation further comprises an animation. ### Claim 7 (depends on 5) The system of claim 5, wherein the augmentation is generated temporarily for a predetermined period of time. ### Claim 8 (depends on 1) The system of claim 1, wherein the system to perform the operations further comprising: causing the first user interface to display a first indicator element at the location of the first touch input and a second indicator element at the location within the first user interface corresponding to the location of the second touch input within the second user interface; or causing the second user interface to display the first indicator element at the location of the second touch input and the second indicator element at the location on the second user interface corresponding to the location of the first touch input within the first user interface. ### Claim 9 (depends on 1) The system of claim 1, wherein the communication session is a real-time communication session between users of the plurality of head-wearable apparatuses in a VR environment of the VR interface. ### Claim 10 (depends on 1) The system of claim 1, wherein the first VR input device and the second VR input device are VR gloves. ### Claim 11 A method comprising: causing, by a processor, a virtual reality (VR) interface for a communication session to be displayed on a first user interface of a first head-wearable apparatus and on a second user interface of a second head-wearable apparatus, wherein the communication session is between a plurality of head-wearable apparatuses including the first head-wearable apparatus and the second head-wearable apparatus; detecting a first touch input from a first VR input device coupled to the first head-wearable apparatus and a second touch input from a second VR input device coupled to the second head-wearable apparatus; monitoring a location of the first touch input within the first user interface and a location of the second touch input within the second user interface; determining a distance between the location of the first touch input within the first user interface and a location on the first user interface corresponding to the location of the second touch input within the second user interface; causing the first VR input device and the second VR input device to generate a haptic feedback response based on the distance, wherein the haptic feedback response increases in intensity or speed as the distance decreases and decreases in intensity or speed as the distance increases; and in response to determining that the distance is below a predetermined threshold, causing the first user interface and the second user interface to generate an augmentation to the VR interface, wherein the augmentation comprises a visual effect and a sound effect. ### Claim 12 (depends on 11) The method of claim 11, wherein a first user of the first head-wearable apparatus and a second user of the second head-wearable apparatus are present in the communication session. ### Claim 13 (depends on 11) The method of claim 11, further comprising: in response to determining that the distance is below the predetermined threshold, causing the first VR input device and the second VR input device to generate a reward haptic feedback response, the reward haptic response is different from the haptic feedback response. ### Claim 14 (depends on 13) The method of claim 13, wherein the haptic feedback response comprises a first vibration pattern and the reward haptic feedback response comprises a second vibration pattern that is different from the first vibration pattern. ### Claim 15 (depends on 11) The method of claim 11, wherein the augmentation further comprises an overlay. ### Claim 16 (depends on 11) The method of claim 11, wherein the augmentation further comprises an animation. ### Claim 17 (depends on 15) The method of claim 15, wherein the augmentation is generated temporarily for a predetermined period of time. ### Claim 18 (depends on 11) The method of claim 11, further comprising: causing the first user interface to display a first indicator element at the location of the first touch input and a second indicator element at the location within the first user interface corresponding to the location of the second touch input within the second user interface; or causing the second user interface to display the first indicator element at the location of the second touch input and the second indicator element at the location on the second user interface corresponding to the location of the first touch input within the first user interface. ### Claim 19 (depends on 11) The method of claim 11, wherein the communication session is a real-time communication session between users of the plurality of head-wearable apparatuses in a VR environment of the VR interface. ### Claim 20 (depends on 11) The method of claim 11, wherein the first VR input device and the second VR input device are VR gloves. ### Claim 21 A non-transitory computer-readable storage medium having stored thereon, instructions when executed by a processor, causes the processor to perform operations comprising: causing a virtual reality (VR) interface for a communication session to be displayed on a first user interface of a first head-wearable apparatus and on a second user interface of a second head-wearable apparatus, wherein the communication session is between a plurality of head-wearable apparatuses including the first head-wearable apparatus and the second head-wearable apparatus; detecting a first touch input from a first VR input device coupled to the first head-wearable apparatus and a second touch input from a second VR input device coupled to the second head-wearable apparatus; monitoring a location of the first touch input within the first user interface and a location of the second touch input within the second user interface; determining a distance between the location of the first touch input within the first user interface and a location on the first user interface corresponding to the location of the second touch input within the second user interface; causing the first VR input device and the second VR input device to generate a haptic feedback response based on the distance, wherein the haptic feedback response increases in intensity or speed as the distance decreases and decreases in intensity or speed as the distance increases; and in response to determining that the distance is below a predetermined threshold, causing the first user interface and the second user interface to generate an augmentation to the VR interface, wherein the augmentation comprises a visual effect and a sound effect.