# US 2023/0418542 A1 · Colocated shared augmented reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0418542 A1
- Document ID: US20230418542A1
- Status: Published application
- Kind: A1
- Application number: 18/243,815
- Filed: 2023-09-08
- Published: 2023-12-28
- Earliest claimed: 2020-09-10
- Assignees: Snap Inc.
- Applicants: Snap Inc.
- Inventors: Ana Maria Cardenas Gasca; Ella Dagan Peled; Andrés Monroy-Hernández; Ava Robinson; Yu Jiang Tham; Rajan Vaish
- Web page: https://patentgrep.com/patent/US20230418542A1

## CPC

- A63F 13/87: Communicating with other players during game play, e.g. by e-mail or chat
- G06F 3/1454: {involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay}
- A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence)
- A63F 13/216: using geographical information, e.g. location of the game device or player using GPS
- A63F 13/48: Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
- A63F 13/65: automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F 13/795: for finding other players; for building a team; for providing a buddy list
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06K 7/1439: {including a method step for retrieval of the optical code}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- H04L 67/52: specially adapted for the location of the user terminal
- A63F 2300/8082: Virtual reality
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30196: Human being; Person
- G06T 2219/024: Multi-user, collaborative environment
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a client device, input that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences; in response to receiving the input, determining one or more resources associated with the selected shared AR experience; determining, by the client device, that two or more users are located within a threshold proximity of the client device; and activating the selected shared AR experience in response to determining that the two or more users are located within the threshold proximity of the client device.

## Claims

### Claim 1

A method comprising:
receiving input, via a client device, that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences;
determining that two or more users are located within a threshold proximity of the client device;
activating the selected shared AR experience in response to determining that the two or more users are located within the threshold proximity of the client device; and
in response to activating the selected shared AR experience, displaying, by the client device, a user interface comprising a group timer and a task timer, the group timer representing a collective amount of time available for the two or more users to complete respectively assigned tasks, and the task timer representing an amount of time remaining for a given user of the two or more users to complete the respectively assigned task.

### Claim 2 (depends on 1)

The method of claim 1, wherein the selected shared AR experience comprises a shared device AR experience that is accessed one-at-a-time by each of two or more users on a same shared client device.

### Claim 3 (depends on 1)

The method of claim 1, wherein:
the task timer indicates how much longer the given user has left to complete a task as well as a current score.

### Claim 4 (depends on 1)

The method of claim 1, wherein the client device is a first client device, and the method further comprises:
synchronizing the shared AR experience between the first client device and a second client device;
wherein a marker in a physical environment of the first and second client devices is also displayed on a third client device, the marker representing a value of a group timer; and
in response to both the second and the third client devices detecting the marker, initiating the selected shared AR experience concurrently on the first and second client devices.

### Claim 5 (depends on 1)

The method of claim 1, further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:
receiving a video feed from a camera of the client device;
detecting presence of real-world feet within the video feed captured by the camera; and
presenting a story on the client device in response to detecting presence of the real-world feet within the video feed.

### Claim 6 (depends on 1)

The method of claim 1, further comprising:
presenting a first AR puppet on a first foot to replace a depiction of the first foot in a video feed displayed in the client device with a depiction of the first AR puppet;
controlling the first AR puppet based on detecting movement of the first foot; and
controlling a second AR puppet based on detecting movement of a second foot.

### Claim 7 (depends on 6)

The method of claim 6, further comprising:
detecting contact between the first foot and the second foot indicating tapping of the first foot and the second foot together; and
in response to detecting contact between the first foot and the second foot, presenting an AR effect.

### Claim 8 (depends on 1)

The method of claim 1, further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:
detecting presence of a whole body of a user of two or more users within a video feed captured by the client device;
receiving input that taps a screen of the client device at a position at which a portion of the whole body of the user is presented;
overlaying a first AR element on the video feed at the position in response to receiving input that taps the screen of the client device; and
ending the AR experience in response to determining that the whole body of the user has been overlaid by a plurality of AR elements.

### Claim 9

A system comprising:
a processor; and
a memory component having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising:
receiving input, via a client device, that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences;
determining that two or more users are located within a threshold proximity of the client device;
activating the selected shared AR experience in response to determining that the two or more users are located within the threshold proximity of the client device; and
in response to activating the selected shared AR experience, displaying, by the client device, a user interface comprising a group timer and a task timer, the group timer representing a collective amount of time available for the two or more users to complete respectively assigned tasks, and the task timer representing an amount of time remaining for a given user of the two or more users to complete the respectively assigned task.

### Claim 10 (depends on 9)

The system of claim 9, wherein the selected shared AR experience comprises a shared device AR experience that is accessed one-at-a-time by each of two or more users on a same shared client device.

### Claim 11 (depends on 9)

The system of claim 9, wherein:
the task timer indicates how much longer the given user has left to complete a task as well as a current score.

### Claim 12 (depends on 9)

The system of claim 9, wherein the client device is a first client device, and the operations further comprise:
synchronizing the shared AR experience between the first client device and a second client device;
wherein a marker in a physical environment of the first and second client devices is also displayed on a third client device, the marker representing a value of a group timer; and
in response to both the second and the third client devices detecting the marker, initiating the selected shared AR experience concurrently on the first and second client devices.

### Claim 13 (depends on 9)

The system of claim 9, the operations further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:
receiving a video feed from a camera of the client device;
detecting presence of real-world feet within the video feed captured by the camera; and
presenting a story on the client device in response to detecting presence of the real-world feet within the video feed.

### Claim 14 (depends on 9)

The system of claim 9, the operations further comprising:
presenting a first AR puppet on a first foot to replace a depiction of the first foot in a video feed displayed in the client device with a depiction of the first AR puppet;
controlling the first AR puppet based on detecting movement of the first foot; and
controlling a second AR puppet based on detecting movement of a second foot.

### Claim 15 (depends on 14)

The system of claim 14, the operations further comprising:
detecting contact between the first foot and the second foot indicating tapping of the first foot and the second foot together; and
in response to detecting contact between the first foot and the second foot, presenting an AR effect.

### Claim 16 (depends on 9)

The system of claim 9, the operations further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:
detecting presence of a whole body of a user of two or more users within a video feed captured by the client device;
receiving input that taps a screen of the client device at a position at which a portion of the whole body of the user is presented;
overlaying a first AR element on the video feed at the position in response to receiving input that taps the screen of the client device; and
ending the AR experience in response to determining that the whole body of the user has been overlaid by a plurality of AR elements.

### Claim 17

A non-transitory computer-readable storage medium having stored thereon, instructions when executed by a processor, causes the processor to perform operations comprising:
receiving input, via a client device, that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences;
determining that two or more users are located within a threshold proximity of the client device;
activating the selected shared AR experience in response to determining that the two or more users are located within the threshold proximity of the client device; and
in response to activating the selected shared AR experience, displaying, by the client device, a user interface comprising a group timer and a task timer, the group timer representing a collective amount of time available for the two or more users to complete respectively assigned tasks, and the task timer representing an amount of time remaining for a given user of the two or more users to complete the respectively assigned task.

### Claim 18 (depends on 17)

The medium of claim 17, wherein the selected shared AR experience comprises a shared device AR experience that is accessed one-at-a-time by each of two or more users on a same shared client device.

### Claim 19 (depends on 17)

The medium of claim 17, wherein:
the task timer indicates how much longer the given user has left to complete a task as well as a current score.

### Claim 20 (depends on 17)

The medium of claim 17, wherein the client device is a first client device, and the operations further comprise:
synchronizing the shared AR experience between the first client device and a second client device;
wherein a marker in a physical environment of the first and second client devices is also displayed on a third client device, the marker representing a value of a group timer; and
in response to both the second and the third client devices detecting the marker, initiating the selected shared AR experience concurrently on the first and second client devices.
