# US 2021/0342000 A1 · Systems and methods for interacting with a computing device using gaze information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0342000 A1 - Document ID: US20210342000A1 - Status: Published application - Kind: A1 - Application number: 17/335,136 - Filed: 2021-06-01 - Published: 2021-11-04 - Earliest claimed: 2017-09-21 - Assignees: Tobii AB - Applicants: Tobii AB - Inventors: Daniel Ricknäs; Erland George-Svahn; Rebecka Lannsjö; Andrew Ratcliff; Regimantas Vegele; Geoffrey Cooper; Niklas Blomqvist - Web page: https://patentgrep.com/patent/US20210342000A1 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G02B 27/017: {Head mounted} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract Techniques for interacting with a first computing device based on gaze information are described. In an example, the first computing device captures a gaze direction of a first user of the first computing device by using an eye tracking device. The first computing device displays a representation of a second user on a display of the first computing device. Further, the first computing device receives from the first user, communication data generated by an input device. The first computing device determines if the gaze direction of the first user is directed to the representation of the second user. If the gaze direction of the first user is directed to the representation of the second user, the first computing device transmits the communication data to a second computing device of the second user. ## Claims ### Claim 1 A method of interaction, performed by a first computing device, comprising the steps of using an eye tracking device, capturing a gaze direction of a first user of the first computing device; displaying a representation of a second user on a display of the first computing device; receiving from the first user, communication data generated by an input device; determining if the gaze direction of the first user is directed to the representation of the second user; transmitting the communication data to a second computing device of the second user, if the gaze direction of the first user is directed to the representation of the second user. ### Claim 2 (depends on 1) The method according to claim 1, further comprising the steps of: receiving, from the second computing device, information regarding if a gaze direction of the second user is directed to a representation of the first user on a display of the second computing device; and transmitting the communication data to the second computing device, only if both the gaze direction of the first user is directed to the representation of the second user on a display of the first computing device, and the gaze direction of the second user is directed to the representation of the first user on the display of the second computing device. ### Claim 3 (depends on 1) The method according to claim 1, wherein the input device is a microphone and the communication data is voice data received from the microphone. ### Claim 4 (depends on 1) The method according to claim 1, wherein the input device is a keyboard and the communication data is text data received from the keyboard. ### Claim 5 (depends on 1) The method according to claim 1, wherein the input device is a camera and the communication data is an image received from the camera. ### Claim 6 (depends on 1) The method according to claim 1, wherein the input device is a video camera and the communication data is a video received from the video camera. ### Claim 7 (depends on 1) The method according to claim 1, wherein the input device is a pointing device and the communication data is a file that has been moved on the display to the representation of a second user by means of the pointing device. ### Claim 8 (depends on 1) The method according to claim 1, wherein the input device is a pointing device and the communication data comprises the position of the pointing device. ### Claim 9 (depends on 1) The method according to claim 1, wherein the input device is a pointing device and wherein the communication data only is transmitted to the second computing device if, additionally, an action is triggered by the pointing device during the period when the gaze direction of the first user is directed to the representation of the second user. ### Claim 10 A first computing device, comprising: an eye tracking device configured to capture a gaze direction of a first user; and a display configured to display a representation of a second user, wherein the first computing device is configured to: receive from the first user, communication data generated by an input device; determine if the gaze direction of the first user is directed to the representation of the second user; transmit the communication data to a second computing device of the second user, if the gaze direction of the first user is directed to the representation of the second user. ### Claim 11 (depends on 10) The first computing device according to claim 10, wherein the first computing device further is configured to: receive, from the second computing device, information regarding if a gaze direction of the second user is directed to a representation of the first user on a display of the second computing device; and transmit the communication data to the second computing device, only if both the gaze direction of the first user is directed to the representation of the second user on a display of the first computing device, and the gaze direction of the second user is directed to the representation of the first user on the display of the second computing device. ### Claim 12 (depends on 10) The first computing device according to claim 10, wherein the input device is a microphone and the communication data is voice data generated by the microphone. ### Claim 13 (depends on 10) The first computing device according to claim 10, wherein the input device is a keyboard and the communication data is text data generated by the keyboard. ### Claim 14 (depends on 10) The first computing device according to claim 10, wherein the input device is a camera and the communication data is an image generated by the camera. ### Claim 15 (depends on 10) The first computing device according to claim 10, wherein the input device is a video camera and the communication data is a video generated by the video camera. ### Claim 16 (depends on 10) The first computing device according to claim 10, wherein the input device is a pointing device and the communication data is a file or document that has been moved on the display to the representation of a second user by means of the pointing device. ### Claim 17 (depends on 10) The first computing device according to claim 10, wherein the input device is a pointing device and the communication data comprises the position of the pointing device. ### Claim 18 (depends on 10) The first computing device according to claim 10, wherein the input device is a pointing device and wherein the first computing device is configured to transmit the communication data to the second computing device only if, additionally, an action is triggered by the pointing device during the period when the gaze direction of the first user is directed to the representation of the second user. ### Claim 19 (depends on 10) The first computing device according to claim 10, wherein the display is a head-mounted display. ### Claim 20 A non-transitory computer-readable storage medium storing instructions that, upon execution on a first computing device, configure the first computing device to perform operations comprising: using an eye tracking device, capturing a gaze direction of a first user of the first computing device; displaying a representation of a second user on a display of the first computing device; receiving from the first user, communication data generated by an input device; determining if the gaze direction of the first user is directed to the representation of the second user; and transmitting the communication data to a second computing device of the second user, if the gaze direction of the first user is directed to the representation of the second user.