# US 10,484,318 B2 · Messages augmented with structured entities > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,484,318 B2 - Document ID: US10484318B2 - Status: Granted - Kind: B2 - Application number: 16/169,067 - Filed: 2018-10-24 - Published: 2019-02-21 - Granted: 2019-11-19 - Earliest claimed: 2012-12-20 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Sadi Khan; Kazi Al-Rashid; Jeremy Bong; Arwa Tyebkhan - Web page: https://patentgrep.com/patent/US10484318B2 ## CPC - H04L 51/08: Annexed information, e.g. attachments - G06F 40/106: Display of layout of documents; Previewing - G06F 40/134: Hyperlinking - G06F 40/197: Version control (for software G06F8/71) - H04W 4/12: Messaging; Mailboxes; Announcements - H04W 4/14: Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD] - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract Messages containing structured entities may be sent between devices in a way that leverages the existing Short Message Service (SMS) protocol. On the message sender's device, the sender may author a message indicating specific entities such as people, places, dates, or times. When the message is to be sent, an SMS representation of the message is sent to the recipient, and a full representation of the message, including the included entities, is sent to a server. If the SMS message is received at a device that is equipped with software that can retrieve and render the rich representation, then the device queries the server to determine whether there is a rich message that corresponds to the SMS message. If such a message exists, then the message is communicated to the recipient's device and is rendered in place of the SMS message. ## Claims ### Claim 1 A computer-implemented method comprising: receiving, via a computer system, a first message that is sent using a communication protocol; sending, via the computer system, indicia of the first message to a server; sending, via the computer system, a request for the server to make a determination, based on the indicia, whether the server has a second message that corresponds to the first message, with the requested determination to be made based on a finding that a time at which the first message was received is within a range of a timestamp that the server associated with the second message; receiving, via the computer system, the second message from the server, the second message comprising text and an entity, the first message comprising the text and a text representation of the entity; and displaying, via the computer system, the text and the entity to a user without displaying the first message. ### Claim 2 (depends on 1) The method of claim 1, with the indicia comprising a digest of the first message. ### Claim 3 (depends on 2) The method of claim 2, with the indicia comprising a time at which the first message was received. ### Claim 4 (depends on 3) The method of claim 3, with the indicia comprising a first phone number of a sender of the first message and a second phone number of a recipient of the first message. ### Claim 5 (depends on 3) The method of claim 3, wherein the timestamp that the server associated with the second message was associated with the second message at a time at which the second message was received by the server from a sender of the first message. ### Claim 6 (depends on 1) The method of claim 1, with the entity comprising a date and time, the displaying comprising displaying the date and the time separate from the text. ### Claim 7 (depends on 1) The method of claim 1, with the entity comprising a person, the displaying comprising displaying contact information for the person separate from the text. ### Claim 8 (depends on 1) The method of claim 1, with the entity comprising a place, the displaying comprising displaying a place page of the place, or a map of a location of the place, separate from the text. ### Claim 9 A computer system comprising: memory; one or more processors; a display; and a component stored in the memory, that when executed with the one or more processors, performs acts comprising: receiving a first message that is sent using a communication protocol; sending indicia of the first message to a server; requesting that the server make a determination, based on the indicia, whether the server has a second message that corresponds to the first message, with the requested determination to be made based on a finding that a time at which the first message was received is within a range of a timestamp that the server associated with the second message; receiving the second message from the server, the second message comprising text and an entity, the first message comprising the text and a text representation of the entity; and displaying, on the display, the text and the entity to a user without displaying the first message. ### Claim 10 (depends on 9) The system of claim 9, with the indicia comprising a digest of the first message, a first phone number of a sender of the first message, a second phone number of a recipient of the first message, and a time at which the first message was received. ### Claim 11 (depends on 10) The system of claim 10, with the determination being made based on a finding that the time at which the first message was received is within a range of a timestamp that the server associated with the second message at a time at which the second message was received by the server from the sender. ### Claim 12 (depends on 9) The system of claim 9, with the entity comprising a date and time, the displaying comprising displaying the date and the time separate from the text. ### Claim 13 (depends on 9) The system of claim 9, with the entity comprising a person, the displaying comprising displaying contact information for the person separate from the text. ### Claim 14 (depends on 9) The system of claim 9, with the entity comprising a place, the displaying comprising displaying a place page of the place, or a map of a location of the place, separate from the text. ### Claim 15 One or more computer-readable memory having computer-executable instructions embodied thereon that, when executed by at least one processor, cause at least one processor to perform acts comprising: receiving, via a computer system, a first message that is sent using a communication protocol; sending, via the computer system, indicia of the first message to a server; sending, via the computer system, a request for the server to make a determination, based on the indicia, whether the server has a second message that corresponds to the first message, with the requested determination to be made based on a finding that a time at which the first message was received is within a range of a timestamp that the server associated with the second message; receiving, via the computer system, the second message from the server, the second message comprising text and an entity, the first message comprising the text and a text representation of the entity; and displaying, via the computer system, the text and the entity to a user without displaying the first message. ### Claim 16 (depends on 15) The one or more computer-readable memory of claim 15, with the indicia comprising a digest of the first message. ### Claim 17 (depends on 16) The one or more computer-readable memory of claim 16, with the indicia comprising a time at which the first message was received. ### Claim 18 (depends on 17) The one or more computer-readable memory of claim 17, with the indicia comprising a first phone number of a sender of the first message and a second phone number of a recipient of the first message. ### Claim 19 (depends on 18) The one or more computer-readable memory of claim 18, wherein the timestamp that the server associated with the second message was associated with the second message at a time at which the second message was received by the server from the sender. ### Claim 20 (depends on 15) The one or more computer-readable memory of claim 15, with the entity comprising a date and time, the displaying comprising displaying the date and the time separate from the text.