# US 2018/0324303 A1 · Web real-time communication from an audiovisual file

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324303 A1
- Document ID: US20180324303A1
- Status: Published application
- Kind: A1
- Application number: 15/611,489
- Filed: 2017-06-01
- Published: 2018-11-08
- Earliest claimed: 2017-05-05
- Assignees: Sorenson IP Holdings, LLC
- Applicants: Sorenson IP Holdings, LLC
- Inventors: Kenneth Boehme
- Web page: https://patentgrep.com/patent/US20180324303A1

## CPC

- H04M 3/5315: {where the non-audio components are still images or video (still image mailbox systems H04N1/324, intermediate storage of video signals for videophones H04N7/147)}
- H04L 12/1831: {Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status}
- H04L 51/066: Format adaptation, e.g. format conversion or compression
- H04L 51/10: Multimedia information
- H04L 51/224: providing notification on incoming messages, e.g. pushed notifications of received messages
- H04L 65/1069: Session establishment or de-establishment
- H04L 65/1083: In-session procedures
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04M 2203/4509: Unified messaging with single point of access to voicemail and other mail or messaging systems
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

According to one or more aspects of the present disclosure, operations may include accessing an audiovisual file of an audiovisual presentation that includes an audio track that includes audio data and a video track that includes video data. The operations may also include generating an audio stream of the audio data that mimics the audio data as being sequentially obtained from audio being captured in real-time. Further, the operations may include generating a video stream of the video data that mimics the video data as being sequentially obtained from video being captured in real-time. Moreover, the operations may include providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client of a system. In addition, the operations may include communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of a user device using WebRTC protocols.

## Claims

### Claim 1

A system comprising:
one or more computer-readable storage media having instructions stored thereon; and
one or more processors communicatively coupled to the one or more computer-readable storage media and configured to, in response to execution of the instructions, cause the system to perform operations comprising:
receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;
storing the video mail file in a database;
receiving, from a second user device of the second user, a request to view the video mail message; and
in response to receiving the request to view the video mail message:
generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data that mimics the audio data of the video mail file as being sequentially obtained from audio being captured by a microphone in real-time;
generating, from the video track of the video mail file stored in the database, a video stream of the video data that mimics the video data of the video mail file as being sequentially obtained from images being captured by a video camera in real-time;
providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client of the system;
communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream;
receiving the audio stream back from the second user device;
generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream; and
providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message for presentation of the text transcriptions in real-time with the presentation of the video mail message by the second user device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the operations further comprise establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

### Claim 3 (depends on 1)

The system of claim 1, wherein the operations further comprise:
receiving, from the first user device, a communication session request intended for the second user device;
communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;
determining a declination of the communication session request at the second user device;
communications a declination notification to the first user device in response to determining the declination of the communication session request; and
receiving the video mail file from the first user device based on the declination notification.

### Claim 4 (depends on 3)

The system of claim 3, wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

### Claim 5 (depends on 3)

The system of claim 3, wherein the operations further comprise determining the declination of the communication session request in response to the second user device not responding to the communication session request.

### Claim 6 (depends on 1)

The system of claim 1, wherein the video mail file includes recorded audio and video of the first user.

### Claim 7 (depends on 1)

The system of claim 1, wherein the first user device is configured to present text transcriptions received from the system.

### Claim 8

A method comprising:
receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;
storing the video mail file in a database;
receiving, from a second user device of the second user, a request to view the video mail message; and
in response to receiving the request to view the video mail message:
generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data that mimics the audio data of the video mail file as being sequentially obtained from audio being captured in real-time;
generating, from the video track of the video mail file stored in the database, a video stream of the video data that mimics the video data of the video mail file as being sequentially obtained from video being captured in real-time;
providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client of a system; and
communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream.

### Claim 9 (depends on 8)

The method of claim 8, further comprising:
generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream; and
providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message.

### Claim 10 (depends on 8)

The method of claim 8, further comprising establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

### Claim 11 (depends on 8)

The method of claim 8, further comprising:
receiving, from the first user device, a communication session request intended for the second user device;
communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;
determining a declination of the communication session request at the second user device;
communications a declination notification to the first user device in response to determining the declination of the communication session request; and
receiving the video mail file from the first user device based on the declination notification.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

### Claim 13 (depends on 11)

The method of claim 11, further comprising determining the declination of the communication session request in response to the second user device not responding to the communication session request.

### Claim 14 (depends on 8)

The method of claim 8, wherein the video mail file includes recorded audio and video of the first user.

### Claim 15

At least one non-transitory computer-readable media configured to store one or more instructions that in response to being executed by at least one computing system cause performance of operations comprising:
receiving, from a first user device of a first user, a video mail file of a video mail message designated as being for a second user, the video mail file including an audio track that includes audio data of audio of the video mail message and a video track that includes video data of video of the video mail message;
storing the video mail file in a database;
receiving, from a second user device of the second user, a request to view the video mail message; and
in response to receiving the request to view the video mail message:
generating, from the audio track of the video mail file stored in the database, an audio stream of the audio data that mimics the audio data of the video mail file as being sequentially obtained from audio being captured in real-time;
generating, from the video track of the video mail file stored in the database, a video stream of the video data that mimics the video data of the video mail file as being sequentially obtained from video being captured in real-time;
providing the audio stream and the video stream to a system Web Real-Time Communication (WebRTC) client of a system; and
communicating, from the system WebRTC client, the audio stream and the video stream to a user-device WebRTC client of the second user device using WebRTC protocols such that the second user device is able to present the video mail message based on the audio stream and the video stream.

### Claim 16 (depends on 15)

The at least one non-transitory computer-readable media of claim 15, wherein the operations further comprise:
generating a plurality of text transcriptions of the audio of the video mail message based on the audio stream; and
providing the plurality of text transcriptions to the second user device while the second user device is presenting the video mail message.

### Claim 17 (depends on 15)

The at least one non-transitory computer-readable media of claim 15, wherein the operations further comprise establishing a WebRTC connection between the system WebRTC client and the user-device WebRTC client in response to receiving the request to view the video mail message.

### Claim 18 (depends on 15)

The at least one non-transitory computer-readable media of claim 15, wherein the operations further comprise:
receiving, from the first user device, a communication session request intended for the second user device;
communicating the communication session request to the second user device in response to the communication session request being intended for the second user device;
determining a declination of the communication session request at the second user device;
communications a declination notification to the first user device in response to determining the declination of the communication session request; and
receiving the video mail file from the first user device based on the declination notification.

### Claim 19 (depends on 15)

The at least one non-transitory computer-readable media of claim 15, wherein the first user device is configured to prompt the first user to record the video mail message in response to receiving the declination notification.

### Claim 20 (depends on 15)

The at least one non-transitory computer-readable media of claim 15, wherein the video mail file includes recorded audio and video of the first user.
