# US 2021/0176427 A1 · Dynamic shared experience recommendations

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176427 A1
- Document ID: US20210176427A1
- Status: Published application
- Kind: A1
- Application number: 16/784,105
- Filed: 2020-02-06
- Published: 2021-06-10
- Earliest claimed: 2019-12-04
- Assignees: Facebook, Inc.
- Applicants: Facebook, Inc.
- Inventors: Suchada Sutasirisap; John Kilcline; Tomas Brennessl; Tianyu Li
- Web page: https://patentgrep.com/patent/US20210176427A1

## CPC

- H04N 7/15: Conference systems
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 9/451: Execution arrangements for user interfaces
- G06F 16/24578: {using ranking}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04L 65/1083: In-session procedures
- H04L 65/1096: Supplementary features, e.g. call forwarding or call holding (systems providing special services or facilities to telephony subscribers H04M3/42)
- H04N 7/152: {Multipoint control units therefor}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A communication server facilitates a video call between client devices of a plurality of participants. During the video call, the communication server identifies an in-call activity to recommend to the plurality of participants in the video call based on user information. The in-call activity is selected to be relevant to each of the plurality of participants and jointly recommended to the plurality of participants of the video call. To identify the recommended in-call activity, the communication server may determine common interests among the plurality of participants and select an in-call activity that is associated with the common interests. After the recommended in-call activity is selected, an indication of the recommended in-call activity is provided to the client devices to enable the client devices to display a user interface including the in-call activity to the participants during the video call.

## Claims

### Claim 1

A method comprising:
facilitating a video call between a plurality of client devices over a network;
retrieving user information associated with each participant of a plurality of participants associated with the plurality of client devices included in the video call;
determining common interests among the plurality of participants based on the user information;
identifying one or more in-call activities associated with the common interests;
selecting a recommended in-call activity from the identified one or more in-call activities for the plurality of participants;
transmitting to a client device of the plurality of client devices, an indication of the recommended in-call activity to enable the client device to display a user interface control for initiating the recommended in-call activity;
receiving a selection from the user interface control displayed on the client device to initiate the recommended in-call activity from the client device; and
initiating the recommended in-call activity on each of the plurality of client devices in response to the selection.

### Claim 2 (depends on 1)

The method of claim 1, wherein the common interests are determined based on an overlap in user interests and user activities among the plurality of participants.

### Claim 3 (depends on 1)

The method of claim 1, wherein the common interests are determined based on location and current time at the location of at least one participant of the plurality of participants.

### Claim 4 (depends on 1)

The method of claim 1, wherein the common interests are determined based on relationships among the plurality of participants.

### Claim 5 (depends on 1)

The method of claim 1, wherein the common interests are determined based on content recognition from an audio signal or a video signal from a client device during the video call.

### Claim 6 (depends on 1)

The method of claim 1, wherein selecting the recommended in-call activity from the identified one or more in-call activities comprises:
ranking the identified one or more in-call activities; and
selecting the recommended in-call activity based on the ranking.

### Claim 7 (depends on 1)

The method of claim 1, wherein the recommended in-call activity is displayed along with a plurality of default in-call activities.

### Claim 8 (depends on 7)

The method of claim 7, wherein the plurality of default in-call activities is different for at least one participant of the plurality of participants.

### Claim 9 (depends on 1)

The method of claim 1, wherein the one or more in-call activities include one or more of the following: watching a video, listening to music, interactive book reading, visual effects, games, or karaoke.

### Claim 10

A method comprising:
establishing a video call with one or more client devices;
generating a video call user interface (UI) window to be displayed during the video call;
during the video call, receiving a recommendation of an in-call activity for participants of the video call;
generating an in-call activity control in the UI window, the in-call activity control including the recommendation;
receiving a selection of an in-call activity from the in-call activity control;
transmitting the selection of the in-call activity to a server; and
facilitating the in-call activity during the video call.

### Claim 11 (depends on 10)

The method of claim 10, wherein the in-call activity control in the UI window dynamically updates over time.

### Claim 12 (depends on 10)

The method of claim 10, wherein the in-call activity control in the UI window changes when a new participant is added to the video call.

### Claim 13 (depends on 10)

The method of claim 10, further comprising:
receiving a scrolling command in the in-call activity control; and
responsive to receiving the request, scrolling through available in-call activities in the in-call activity control.

### Claim 14 (depends on 13)

The method of claim 13, wherein an in-call activity displayed in the in-call activity control is removed from the in-call activity control and a new in-call activity is displayed.

### Claim 15 (depends on 10)

The method of claim 10, wherein the in-call activity control overlaps a window displaying the video call.

### Claim 16

A non-transitory computer-readable medium comprising computer program instructions that when executed by a computer processor of an online system cause the processor to perform steps comprising:
facilitating a video call between a plurality of client devices over a network;
retrieving user information associated with each participant of a plurality of participants associated with the plurality of client devices included in the video call;
determining common interests among the plurality of participants based on the user information;
identifying one or more in-call activities associated with the common interests;
selecting a recommended in-call activity from the identified one or more in-call activities for the plurality of participants;
transmitting to a client device of the plurality of client devices, an indication of the recommended in-call activity to enable the client device to display a user interface control for initiating the recommended in-call activity;
receiving a selection from the user interface control displayed on the client device to initiate the recommended in-call activity from the client device; and
initiating the recommended in-call activity on each of the plurality of client devices in response to the selection.

### Claim 17 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the common interests are determined based on an overlap in user interests and user activities among the plurality of participants.

### Claim 18 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the common interests are determined based on location and current time at the location of at least one participant of the plurality of participants.

### Claim 19 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the common interests are determined based on relationships among the plurality of participants.

### Claim 20 (depends on 16)

The non-transitory computer-readable medium of claim 16, wherein the common interests are determined based on content recognition from an audio signal or a video signal from a client device during the video call.
