# US 11,115,540 B1 · Complex computing network for providing audio conversations and associated visual representations on a mobile application

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,115,540 B1
- Document ID: US11115540B1
- Status: Granted
- Kind: B1
- Application number: 17/003,876
- Filed: 2020-08-26
- Granted: 2021-09-07
- Earliest claimed: 2020-08-26
- Assignees: Stereo App Limited
- Applicants: Stereo App Limited
- Inventors: Artur Nugumanov; Sergey Frolovichev; Andrey Ogandzhanyants
- Web page: https://patentgrep.com/patent/US11115540B1

## CPC

- H04M 1/27457: Management thereof, e.g. manual editing of data
- H04M 3/565: {relating to time schedule aspects}
- H04M 1/72445: for supporting Internet browser applications
- H04M 3/561: {by multiplexing}
- H04M 3/567: {Multimedia conference systems}
- H04M 3/568: {audio processing specific to telephonic conferencing, e.g. spatial distribution, mixing of participants (echo suppression in two-way loud-speaking telephone systems H04M9/02; sound field processing per se H04S7/30)}
- H04M 1/27475: using interactive graphical means or pictorial representations
- H04M 1/2753: providing data content
- H04M 3/42348: {Location-based services which utilize the location information of a target}
- H04M 2203/2044: Group features, e.g. closed user group
- H04M 2203/205: Broadcasting
- H04M 2203/655: Combination of telephone service and social networking
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

Systems, methods, and computer program products are provided for selecting and initiating playing of audio conversations on mobile computing devices. For example, a method comprises determining a first user accesses a mobile application on a mobile device associated with the first user; selecting an audio conversation for the first user, wherein the audio conversation involves at least a second user, wherein the audio conversation is selected for the first user based on at least one of first user information associated with the first user, second user information associated with the second user, or conversation information associated with the audio conversation; and initiating playing of the audio conversation on the mobile application on the mobile device.

## Claims

### Claim 1

A method for selecting and initiating streaming of audio conversations, the method comprising:
determining, using one or more computing device processors, a first user accesses a mobile application on a first mobile device associated with the first user;
selecting, using the one or more computing device processors, an audio conversation for the first user, wherein the audio conversation involves at least a second user who accesses the mobile application on a second mobile device associated with the second user, and a third user located remotely from the second user who accesses the mobile application on a third mobile device associated with the third user, wherein the audio conversation is selected for the first user based on at least one of first user information associated with the first user, second user information associated with the second user, or conversation information associated with the audio conversation;
streaming, using the one or more computing device processors, the audio conversation to the mobile application on the first mobile device;
recording, using the one or more computing device processors, the audio conversation;
transmitting, using the one or more computing device processors, to the first mobile device for visual display, during the streaming of the audio conversation, on a first user interface of the mobile application on the first mobile device, a selectable first visual representation of the second user not comprising a first video of the second user and, simultaneously with the visual display of the selectable first visual representation on the first user interface of the mobile application on the first mobile device, a selectable second visual representation of the third user not comprising a second video of the third user;
adding, using the one or more computing device processors, the conversation information associated with the audio conversation to user profile information associated with the second user;
receiving, using the one or more computing device processors, a selection of the selectable first visual representation of the second user not comprising the first video of the second user; and
in response to receiving the selection of the selectable first visual representation of the second user not comprising the first video of the second user, transmitting, using the one or more computing device processors, to the first mobile device for visual display, during the streaming of the audio conversation, on a second user interface, different from the first user interface, of the mobile application on the first mobile device, the user profile information associated with the second user;
wherein the conversation information, comprised in the user profile information, is displayed on the second user interface or a third user interface, different from the first user interface, of the mobile application on the first mobile device,
wherein the user profile information associated with the second user is editable by the second user during the audio conversation involving the at least the second user and the third user,
wherein second user profile information associated with the first user is editable by the first user during the audio conversation involving the at least the second user and the third user being streamed to the mobile application on the first mobile device, and
wherein the audio conversation involving the at least the second user and the third user continues to stream when the second user accesses, during the audio conversation, a second mobile application on the second mobile device of the second user.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first user information comprises at least one of an interest associated with the first user; a third visual representation associated with the first user; the second user profile information associated with the first user; listening history, associated with the first user, on the mobile application; speaking history, associated with the first user, on the mobile application; usage history, associated with the first user, on the mobile application; a fourth user that follows the first user on the mobile application; third user information associated with the fourth user; a fifth user that the first user follows on the mobile application; fourth user information associated with the fifth user; third-party social network information associated with the first user; search history, associated with the first user, on the mobile application; search history, associated with the first user, on a third-party application or website; time spent on the mobile application by the first user; duration of at least one previous audio conversation, associated with the first user, on the mobile application; at least one statistic associated with multiple previous audio conversations, associated with the first user, on the mobile application; current location associated with the first user; location history associated with the first user; device information associated with the first mobile device; network information associated with the first mobile device; a previous, current, or predicted mood of the first user during a period; an average listening time for one or more listeners associated with one or more current, previous, or future audio conversations involving the first user as a speaker; a listening time statistic or information for the one or more listeners associated with the one or more current, previous, or future audio conversations involving the first user as the speaker; a speaking time statistic or information for the one or more current, previous, or future audio conversations involving the first user as the speaker; or a subject, topic, or hashtag that the first user is predicted to be interested in.

### Claim 3 (depends on 1)

The method of claim 1, wherein the conversation information comprises at least one of: the second user information associated with the second user; a topic, subject, or hashtag associated with the audio conversation; location information associated with the audio conversation; user information or location information associated with at least one listener who is listening to or has listened to the audio conversation; number of current listeners associated with the audio conversation; current duration of the audio conversation; waitlist information associated with the audio conversation; followers associated with the second user; users followed by the second user; an audio message transmitted to the second user during the audio conversation; an average listening time associated with one or more previous or current listeners in the audio conversation; a listening time statistic or information associated with the one or more previous or current listeners in the audio conversation; a speaking time statistic or information associated with one or more previous or current speakers in the audio conversation; predicted audio content associated with a remaining portion of the audio conversation; predicted conversation duration associated with the remaining portion of the audio conversation; and predicted number or location of listeners associated with the remaining portion of the audio conversation.

### Claim 4 (depends on 1)

The method of claim 1, further comprising selecting the audio conversation for the first user based on at least partially matching the first user information with at least one of the second user information or the conversation information.

### Claim 5 (depends on 1)

The method of claim 1, further comprising selecting the audio conversation based on at least one parameter input by the first user.

### Claim 6 (depends on 5)

The method of claim 5, wherein the at least one parameter comprises a topic, subject, or hashtag.

### Claim 7 (depends on 5)

The method of claim 5, wherein the at least one parameter is selected from multiple parameters available for selection in the mobile application.

### Claim 8 (depends on 7)

The method of claim 7, wherein the multiple parameters are extracted from an external social network.

### Claim 9 (depends on 5)

The method of claim 5, wherein the least one parameter comprises location information.

### Claim 10 (depends on 1)

The method of claim 1, wherein the audio conversation is added to a first user profile of the first user.

### Claim 11 (depends on 1)

The method of claim 1, wherein the audio conversation comprises a live audio conversation.

### Claim 12 (depends on 1)

The method of claim 1, wherein the audio conversation comprises a recorded audio conversation.

### Claim 13 (depends on 1)

The method of claim 1, wherein the first user interface indicates a number of listeners listening to the audio conversation.

### Claim 14 (depends on 1)

The method of claim 1, further comprising selecting the audio conversation based on optimizing a listening time, associated with the audio conversation, for the first user.

### Claim 15

An apparatus for selecting and initiating streaming of audio conversations, the apparatus comprising:
one or more computing device processors;
one or more memory systems comprising code, executable by the one or more computing device processors, and configured to:
determine a first user accesses a mobile application on a first mobile device associated with the first user;
selecting an audio conversation for the first user, wherein the audio conversation involves at least a second user who accesses or accessed the mobile application on a second mobile device associated with the second user, and a third user who accesses or accessed the mobile application on a third mobile device associated with the third user, wherein the audio conversation is selected for the first user based on at least one of first user information associated with the first user, second user information associated with the second user, or conversation information associated with the audio conversation;
streaming the audio conversation on the mobile application to the first mobile device;
transmit, to the first mobile device for visual display, during the streaming of the audio conversation, on a first user interface of the mobile application on the first mobile device, a selectable first visual representation of the second user not comprising a first video of the second user and, simultaneously with the visual display of the selectable first visual representation on the first user interface of the mobile application on the first mobile device, a selectable second visual representation of the third user not comprising a second video of the third user;
receive a selection of the selectable first visual representation of the second user not comprising the first video of the second user; and
in response to receiving the selection of the selectable first visual representation of the second user not comprising the first video of the second user, transmit, to the first mobile device for visual display, during the streaming of the audio conversation, on a second user interface, different from the first user interface, of the mobile application on the first mobile device, user profile information associated with the second user;
wherein the user profile information associated with the second user is editable by the second user during the audio conversation involving the at least the second user and the third user,
wherein second user profile information associated with the first user is editable by the first user during the audio conversation involving the at least the second user and the third user being streamed to the mobile application on the first mobile device, and
wherein the audio conversation involving the at least the second user and the third user continues to stream when the second user accesses, during the audio conversation, a second mobile application on the second mobile device of the second user.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the apparatus comprises at least one of an application server or the first mobile device.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the first user cannot converse, in substantially real-time, with the second user.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein the code is further configured to provide an option to the first user to substantially instantaneously switch from listening to the audio conversation involving the at least the second user and the third user to initiating a second audio conversation with a fourth user.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein the code is further configured to provide an option to the first user to substantially instantaneously switch from the audio conversation involving the at least the second user and the third user to a second audio conversation involving a fourth user.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein a number of listeners listening to the audio conversation is presented on the user interface of the mobile application on the first mobile device, and wherein the first user cannot view listener user information associated with a listener of the audio conversation.

### Claim 21 (depends on 1)

The method of claim 1, wherein the selectable first visual representation comprises at least one of an avatar, an emoji, a symbol, a persona, an animation, a cartoon, an indicia, an illustration, a histogram, or a graph.

### Claim 22 (depends on 1)

The method of claim 1, wherein at least a portion of the selectable first visual representation on the user interface of the mobile application on the first mobile device changes shape or form when the second user speaks during the audio conversation, and wherein the at least the portion of the selectable first visual representation on the user interface of the mobile application on the first mobile device does not change the shape or form when the second user does not speak during the audio conversation.

### Claim 23 (depends on 22)

The method of claim 22, wherein the selectable first visual representation comprises a facial representation.

### Claim 24 (depends on 22)

The method of claim 22, wherein the at least the portion of the selectable first visual representation comprises a lip or a mouth.

### Claim 25 (depends on 1)

The method of claim 1, wherein the second user information comprises an average listening time, for one or more listeners, for one or more previous, current, or future audio conversations involving the second user as a speaker during a first period.

### Claim 26 (depends on 1)

The method of claim 1, wherein the second user information comprises a listening time statistic or information, for one or more listeners, for one or more previous, current, or future audio conversations involving the second user as a speaker during a first period, or a speaking time statistic or information for the one or more previous, current, or future audio conversations involving the second user as the speaker during the first period.

### Claim 27 (depends on 1)

The method of claim 1, wherein the second user information comprises a link to a social network account associated with the second user that is viewable on a third mobile application different from the mobile application.

### Claim 28 (depends on 15)

The apparatus of claim 15, wherein the audio conversation is selected based on a smart data processing operation.

### Claim 29 (depends on 28)

The apparatus of claim 28, wherein the smart data processing operation is based on a listening history of the first user.
