# US 8,542,804 B2 · Voice and text mail application for communication devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 8,542,804 B2
- Document ID: US8542804B2
- Status: Granted
- Kind: B2
- Application number: 12/721,442
- Filed: 2010-03-10
- Published: 2010-07-01
- Granted: 2013-09-24
- Earliest claimed: 2008-02-08
- Assignees: Voxer IP LLC
- Applicants: Thomas E. Katis; James T. Panttaja; Mary G. Panttaja; Matthew J. Ranney
- Inventors: Thomas E. Katis; James T. Panttaja; Mary G. Panttaja; Matthew J. Ranney
- Web page: https://patentgrep.com/patent/US8542804B2

## CPC

- H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission}
- H04L 51/04: Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L 51/56: Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM]
- H04L 65/1083: In-session procedures
- H04L 65/1094: Inter-user-equipment sessions transfer or sharing
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/764: {at the destination (reformatting of additional data in video clients H04N21/4355)}
- H04M 3/53333: {Message receiving aspects}
- H04L 12/1831: {Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status}
- H04L 51/224: providing notification on incoming messages, e.g. pushed notifications of received messages
- H04M 2203/253: where a visual mode is used instead of a voice mode
- H04M 2203/4563: Voicemail monitoring during recording
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)

## Abstract

A voice and text mail application method and apparatus capable of supporting both synchronous and asynchronous voice communication. The application is configured to (i) simultaneously and progressively store media of an incoming message as the media is received at a communication device over the network and (ii) provides a “catch up” rendering option which enables the rendering of previously received media of the message starting at any previous point of the message and to catch up the rendering to the current point or head of the message as the media of the message is being received. By rendering the previously received media of the incoming message out of storage at a rate faster relative to when the media of the incoming message was originally encoded, eventually the rendering will catch up and seamlessly transition the rendering from an asynchronous time-shifted mode out of storage to a synchronous mode as the media of the message is received over the network. In various alternative embodiments, the application also enables the (a) screening of the media of the incoming message as the media is received over the network; (b) the ability to join a live conversation with the sender of the incoming message as the media of the incoming message is received over the network, and/or (c) the option to ignore the media of the incoming message.

## Claims

### Claim 1

A messaging method for communicating on a client communication device, the method comprising:
simultaneously and progressively storing media of an incoming asynchronous voice message as the media of the incoming message is received at the client communication device of a first party over a network; and
providing a rendering option for rendering the media of the incoming asynchronous voice message as the incoming media of the message is received at the client communication device;
invoking a catch up to the most recently received media of the incoming asynchronous voice message while continuing progressively storing media of the incoming message as the media of the incoming message is progressively received, the catch up to the most recently received media rendering option causing:
(i) rendering on the client communication device in a time-shifted mode the previously received media of the incoming asynchronous voice message out of storage at a rate faster relative to when the media of the incoming message was originally encoded; and
(ii) seamlessly transitioning the rendering of the incoming media from the time-shifted mode to a real-time mode when the rendering of the previously received media of the incoming asynchronous voice message out of storage at the faster rate has caught up to and coincides with the media of the incoming message as the media is received over the network, the rendering of the media in the real-time mode occurring progressively as the media of the incoming asynchronous voice message is progressively received;
enabling a live conversation, in the real-time mode, between the client communication device and a remote communication device of a second party sending the incoming asynchronous message;
in the real-time mode, simultaneously and progressively storing incoming media received at the client communication device from the remote communication device; and
in the real time mode, simultaneously and progressively storing outgoing media transmitted from the client communication device to the remote communication device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the rendering option is either:
(i) a catch-up-to-live (CTL) rendering option and the rendering of the media of the incoming asynchronous voice message after the seamless transition is live as the media of the incoming message is created and transmitted over the network; or
(ii) a catch-up-to the most recently received media of the incoming asynchronous voice message, where the media of the incoming message was created at a time before the media is transmitted and received at the client communication device over the network.

### Claim 3 (depends on 1)

The method of claim 1, wherein the media of the asynchronous voice message comprises one of the following:
(i) voice media;
(ii) video media;
(iii) text media;
(iv) GPS data;
(v) sensor data;
(vi) photos or images; or
(vii) any combination of (i) through (vi).

### Claim 4 (depends on 1)

The method of claim 1, further comprising providing a screening option which enables the screening of the media of the incoming asynchronous voice message in real-time, as the media of the incoming message is received over the network.

### Claim 5 (depends on 1)

The method of claim 1, further comprising providing an ignore option for ignoring of the media of the incoming asynchronous voice message.

### Claim 6 (depends on 1)

The method of claim 1, further comprising generating on the client communication device a response message and transmitting the response message over the network to a remote communication device which sent the incoming asynchronous voice message.

### Claim 7 (depends on 6)

The method of claim 6, wherein the response message is sent synchronously relative to the incoming asynchronous voice message.

### Claim 8 (depends on 6)

The method of claim 6, wherein the media of the incoming asynchronous voice message and the response message is voice media respectively.

### Claim 9 (depends on 6)

The method of claim 6, wherein the media of the incoming asynchronous voice message is voice media and the media of the response message is text media.

### Claim 10 (depends on 6)

The method of claim 6, wherein transmitting the response message over the network to the remote communication device further comprises transmitting the response message without first establishing a circuit connection over the network with the remote communication device.

### Claim 11 (depends on 1)

The method of claim 1, further comprising providing a delete option for deleting the incoming asynchronous voice message.

### Claim 12 (depends on 11)

The method of claim 11, wherein providing the delete option further comprises one of the following:
(i) providing the option to manually delete the incoming asynchronous voice message;
(ii) providing for the automatic deletion of the incoming asynchronous voice message after a predetermined period of time has lapsed after receipt of the incoming asynchronous voice message; or
(iii) providing both (i) and (ii).

### Claim 13 (depends on 1)

The method of claim 1, further comprising associating the incoming asynchronous voice message with a conversation.

### Claim 14 (depends on 13)

The method of claim 13, further comprising selectively displaying a history of the conversation, the history including the asynchronous voice messages associated with the conversation.

### Claim 15 (depends on 1)

The method of claim 1, further comprising visually displaying a visual indicator showing the receipt of the incoming asynchronous voice message at the client communication device before the incoming message is received in full.

### Claim 16 (depends on 1)

The method of claim 1, further comprising notifying on the communication device the receipt of the incoming asynchronous voice message before the incoming asynchronous voice message is received in full.

### Claim 17 (depends on 1)

A messaging application capable of supporting both synchronous and asynchronous messaging on a communication device, the messaging application including modules for performing the steps recited in claim 1.

### Claim 18 (depends on 17)

The communication device of claim 17, comprising:
a housing;
a processor contained in the housing; and
the messaging application running on the processor.

### Claim 19 (depends on 1)

The method of claim 1, further comprising:
receiving meta data associated with the incoming message; and
notifying on the communication device the receipt of the incoming asynchronous voice message when the meta data associated with the incoming asynchronous voice message is received, but before the media of the incoming message is received in full.

### Claim 20 (depends on 16)

The method of claim 16, wherein the notification of the receipt of the incoming asynchronous voice message before the incoming asynchronous voice message is received in full further comprises one of the following:
(i) providing a visual indicator on the client communication device;
(ii) providing an audio indicator on the client communication device; or
(iii) both (i) and (ii).

### Claim 21

A messaging method for communicating on a client communication device, the method comprising:
simultaneously and progressively storing media of an incoming asynchronous voice message as the media of the incoming message is received at the client communication device of a first party over a network; and
providing on the communication device one or more options for responding to the incoming asynchronous voice message, the one or more options including:
(i) rendering the media of the incoming asynchronous voice message from storage;
(ii) screening the media of the incoming asynchronous voice message as the media is received over the network;
(iii) joining a live conversation with the sender of the incoming asynchronous voice message as the media of the incoming message is received over the network and simultaneously and progressively storing media associated with the live conversation received at the client communication device;
(iv) invoking a catch up to the most recently received media of the incoming asynchronous voice message while continuing progressively storing media of the incoming asynchronous voice message as the media of the incoming asynchronous voice message is progressively received, the catch up causing rendering the media of the incoming asynchronous voice message previously received from storage at a rate faster than the media was originally encoded in a time-shifted mode and then seamlessly transitioning the rendering of the media of the incoming asynchronous voice message as the media is received over the network when the rendering from storage has caught up to and coincides with the media of the incoming asynchronous voice message as it is received over the network, the rendering of the media in a real-time mode occurring progressively as the media of the incoming asynchronous voice message is progressively received, enabling a live conversation, in a real-time mode, between the client communication device and a remote communication device of a second party sending the incoming asynchronous message, and simultaneously and progressively storing media associated with the conversation in the real-time mode; and
(v) ignoring the media of the incoming asynchronous voice message.

### Claim 22 (depends on 21)

The method of claim 21, further comprising:
notifying on the communication device the receipt of the incoming asynchronous voice message received over the network as soon as meta data associated with the incoming media is received at the client communication device.

### Claim 23 (depends on 21)

The method of claim 21, wherein screening the media of the incoming asynchronous voice message as the media is received over the network further comprise not notifying the sender of the incoming message that the incoming message is being reviewed.

### Claim 24 (depends on 21)

The method of claim 21, further comprising generating on the communication device a response message and transmitting the response message over the network to a remote communication device which sent the incoming asynchronous voice message.

### Claim 25 (depends on 24)

The method of claim 24, wherein the response message is sent synchronously relative to the incoming asynchronous voice message.

### Claim 26 (depends on 24)

The method of claim 24, wherein the response message is sent asynchronously relative to the incoming asynchronous voice message.

### Claim 27 (depends on 24)

The method of claim 24, wherein the media of the incoming asynchronous voice message and the response message is voice media respectively.

### Claim 28 (depends on 24)

The method of claim 24, wherein the media of the incoming asynchronous voice message is voice media and the media of the response message is text media.

### Claim 29 (depends on 24)

The method of claim 24, wherein transmitting the response message over the network to the remote communication device further comprises transmitting the response message without first establishing a circuit connection over the network with the remote communication device.

### Claim 30 (depends on 21)

The method of claim 21, further comprising providing a delete option for deleting the incoming asynchronous voice message.

### Claim 31 (depends on 30)

The method of claim 30, wherein providing the delete option further comprises one of the following:
(i) providing the option to manually delete the incoming asynchronous voice message;
(ii) providing for the automatic deletion of the incoming asynchronous voice message after a predetermined period of time has lapsed after receipt of the incoming message; or
(iii) providing both (i) and (ii).

### Claim 32 (depends on 21)

The method of claim 21, further comprising associating the incoming asynchronous voice message with a conversation.

### Claim 33 (depends on 32)

The method of claim 32, further comprising selectively displaying a history of the conversation, the history including the messages associated with the conversation, wherein the messages of the conversation comprises one of the following:
(i) one or more voice messages;
(ii) one or more text messages; or
(iii) a combination of (i) and (ii).

### Claim 34 (depends on 21)

The method of claim 21, further comprising notifying on the client communication device the receipt of the incoming asynchronous voice message before the incoming message is received in full.

### Claim 35 (depends on 34)

The method of claim 34, wherein notifying the receipt of the incoming asynchronous voice message before the incoming asynchronous voice message is received in full further comprises one of the following:
(i) providing a visual indicator on the client communication device;
(ii) providing an audio indicator on the client communication device; or
(iii) both (i) and (ii).

### Claim 36 (depends on 21)

A messaging application capable of supporting both synchronous and asynchronous messaging on a communication device, the messaging application including modules for performing the steps recited in claim 21.

### Claim 37 (depends on 36)

The communication device of claim 36, further comprising:
a housing; and
a processor contained in the housing, the messaging application running on the processor.

### Claim 38

A messaging method for communicating on a client communication device, the method comprising:
receiving an incoming asynchronous voice message over a network at the client communication device of a first party;
notifying on the communication device an indicator indicating the receipt of the incoming asynchronous voice message at the client communication device before the incoming message is received in full at the client communication device;
simultaneously and progressively storing media of the incoming asynchronous voice message as the media of the incoming asynchronous voice message is received at the client communication device over the network; and
providing on the client communication device one or more options for responding to the media of the incoming asynchronous voice message, the one or more options including:
(i) rendering the media of the incoming asynchronous voice message from storage;
(ii) screening the media of the incoming asynchronous voice message as the media is received over the network;
(iii) joining a live conversation with the sender of the incoming asynchronous voice message as the media of the incoming asynchronous voice message is received over the network and simultaneously and progressively storing media associated with the live conversation received at the client communication device;
(iv) invoking a catch up to the most recently received media of the incoming asynchronous voice message while continuing progressively storing media of the incoming message as the media of the incoming asynchronous voice message is progressively received, the catch up causing rendering the media of the incoming asynchronous voice message previously received from storage at a rate faster than the media was originally encoded in a time-shifted mode and then seamlessly transitioning the rendering of the media of the incoming asynchronous voice message “live” in a real-time mode as the media is received over the network when the rendering from storage has caught up to and coincides with the media of the incoming asynchronous voice message as it is received over the network, the rendering of the media in the real-time mode occurring progressively as the media of the incoming asynchronous voice message is progressively received, enabling a live conversation, in a real-time mode, between the client communication device and a remote communication device of a second party sending the incoming asynchronous message, and simultaneously and progressively storing media associated with the conversation in the real-time mode; and
(v) ignoring the media of the incoming asynchronous voice message.

### Claim 39 (depends on 36)

The method of claim 36, wherein the notification indicating the receipt of the incoming asynchronous voice message occurs when meta data associated with the incoming asynchronous voice message is received, but before the media of the incoming asynchronous voice message is received in full.

### Claim 40 (depends on 38)

The method of claim 38, further comprising:
simultaneously and progressively storing media of the incoming asynchronous voice message as the media of the incoming message is received at the client communication device over the network; and
providing a rendering option to catch up to the most recently received media of the incoming asynchronous voice message, the catch up to the most recently received media rendering option causing:
(i) rendering on the client communication device in a time-shifted mode the previously received media of the incoming asynchronous voice message out of storage at a rate faster relative to when the media of the incoming message was originally encoded; and
(ii) seamlessly transitioning the rendering of the incoming media from the time-shifted mode to a real-time mode when the rendering of the previously received media of the incoming asynchronous voice message out of storage at the faster rate has caught up to and coincides with the media of the incoming asynchronous voice message as the media is received over the network.

### Claim 41 (depends on 40)

The method of claim 40, wherein the rendering option is either:
(i) a catch-up-to-live (CTL) rendering option and the rendering of the media of the incoming asynchronous voice message after the seamless transition is live as the media of the incoming asynchronous voice message is created and transmitted over the network; or
(ii) a catch-up-to the most recently received media of the incoming asynchronous voice message, where the media of the incoming asynchronous voice message was created at a time before the media is transmitted and received at the client communication device over the network.

### Claim 42 (depends on 38)

The method of claim 38, wherein the notification comprises one of the following:
(i) a visual indicator notifying the receipt of the incoming message;
(ii) an audible notification notifying of the receipt of the incoming message; or
(iii) both (i) and (ii).

### Claim 43 (depends on 38)

The method of claim 38, wherein screening the media of the incoming asynchronous voice message as the media is received over the network further comprise not notifying the sender of the incoming asynchronous voice message that the incoming asynchronous voice message is being reviewed.

### Claim 44 (depends on 38)

The method of claim 38, further comprising generating on the client communication device a response message and transmitting the response message over the network to a remote communication device which sent the incoming asynchronous voice message.

### Claim 45 (depends on 44)

The method of claim 44, wherein the response message is sent synchronously relative to the incoming asynchronous voice message.

### Claim 46 (depends on 44)

The method of claim 44, wherein the response message is sent asynchronously relative to the incoming asynchronous voice message.

### Claim 47 (depends on 44)

The method of claim 44, wherein the media of the incoming asynchronous voice message and the response message is voice media respectively.

### Claim 48 (depends on 47)

The method of claim 47, wherein the media of the incoming asynchronous voice message is voice media and the media of the response message is text media.

### Claim 49 (depends on 44)

The method of claim 44, wherein transmitting the response message over the network to the remote communication device further comprises transmitting the response message without first establishing a circuit connection over the network with the remote communication device.

### Claim 50 (depends on 38)

The method of claim 38, further comprising associating the incoming asynchronous voice message with a conversation.

### Claim 51 (depends on 50)

The method of claim 50, further comprising selectively displaying a history of the conversation, the history including the messages associated with the conversation, wherein the messages of the conversation comprises one of the following:
(i) one or more voice messages;
(ii) one or more text messages; or
(iii) a combination of (i) and (ii).

### Claim 52 (depends on 38)

A messaging application capable of supporting both synchronous and asynchronous messaging on a client communication device, the messaging application including modules for performing the steps recited in claim 38.

### Claim 53 (depends on 52)

The communication device of claim 52, further comprising:
a housing; and
a processor contained in the housing, the messaging application running on the processor.