# US 2019/0319903 A1 · Preserving digital ink spatial relationships in electronic messages

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0319903 A1
- Document ID: US20190319903A1
- Status: Published application
- Kind: A1
- Application number: 15/954,245
- Filed: 2018-04-16
- Published: 2019-10-17
- Earliest claimed: 2018-04-16
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Elise L. LIVINGSTON; Allison SMEDLEY; Robin Winter TROY; Daniel Y. PARISH; Zhouying FAN
- Web page: https://patentgrep.com/patent/US20190319903A1

## CPC

- H04B 7/0417: Feedback systems
- H04L 51/10: Multimedia information
- H04B 7/0413: MIMO systems
- H04W 4/14: Short messaging services, e.g. short message services [SMS] or unstructured supplementary service data [USSD]
- H04B: TRANSMISSION
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72)

## Abstract

Systems and methods for sending an electronic message including digital ink. One system includes at least one electronic processor. The at least one electronic processor is configured to receive the digital ink for inclusion in the electronic message, determine positional information for the digital ink, the positional information representing a position of the digital ink within the electronic message relative to a position of at least one additional object within the electronic message, and send the digital ink and the positional information as part of the electronic message.

## Claims

### Claim 1

A system for sending an electronic message including digital ink, the system comprising:
at least one electronic processor configured to
receive the digital ink for inclusion in the electronic message;
determine positional information for the digital ink, the positional information representing a position of the digital ink within the electronic message relative to a position of at least one additional object within the electronic message; and
send the digital ink and the positional information as part of the electronic message.

### Claim 2 (depends on 1)

The system of claim 1, wherein the at least one electronic processor is further configured to generate markup language data for the digital ink, the markup language data including coordinates of the digital ink and the positional information, wherein the at least one electronic processor is configured to send the digital ink and the positional information by sending the markup language data.

### Claim 3 (depends on 1)

The system of claim 1, wherein the positional information includes a location of a drawing canvas including the digital ink within the electronic message and coordinates of the digital ink with respect to the drawing canvas and the at least one additional object.

### Claim 4 (depends on 1)

The system of claim 1, wherein the at least one electronic processor is configured to determine the positional information for the digital ink by determining a first position of the at least one additional object within the electronic message and determining a second position of the digital ink, and wherein the positional information includes the first position and the second position.

### Claim 5 (depends on 1)

The system of claim 1, wherein the at least one electronic processor is configured to determine the positional information for the digital ink by determining a first position of the at least one additional object within the electronic message and determining a second position of the digital ink, wherein the positional information includes a difference between the first position and the second position.

### Claim 6 (depends on 1)

The system of claim 1, wherein the at least one electronic processor is further configured to select the at least one additional object by comparing a position of each of a plurality of objects included in the electronic message to a position of the digital ink and selecting the at least one additional object from the plurality of objects in response to the position of the at least one additional object being within a predetermined distance from the position of the digital ink.

### Claim 7 (depends on 1)

The system of claim 1, wherein the at least one electronic processor is further configured to generate an image including the digital ink and the at least one additional object and send the image as part of the electronic message.

### Claim 8 (depends on 7)

The system of claim 7, wherein the at least one electronic processor is further configured to identify white space in the image and remove the white space from the image before sending the image as part of the electronic message.

### Claim 9

A method of displaying an electronic message, the method comprising:
receiving, with an electronic processor, the electronic message, the electronic message including digital ink and positional information, the positional information representing a position of the digital ink within the electronic message relative to a position of at least one additional object within the electronic message; and
displaying the digital ink within a body of the electronic message based on the positional information.

### Claim 10 (depends on 9)

The method of claim 9, wherein displaying the digital ink within the body of the electronic message includes displaying the digital ink wherein a user can select the digital ink to manipulate the digital ink.

### Claim 11 (depends on 9)

The method of claim 9, further comprising receiving timing information for the digital ink, the timing information representing creation of the digital ink by a user over a time period, and wherein displaying the digital ink includes replaying the digital ink based on the timing information.

### Claim 12 (depends on 9)

The method of claim 9, further comprising receiving an image associated with the electronic message, the image including the digital ink and the at least one additional object, and determining, with the electronic processor, whether to display the digital ink within the body of the electronic message or to display the image within the body of the electronic message in place of the digital ink.

### Claim 13 (depends on 9)

The method of claim 9, further comprising receiving creator information for the digital ink, the creator information representing an identity of a user who created the digital ink, and wherein displaying the digital ink includes displaying an indicator representing the identity of the user with the digital ink.

### Claim 14 (depends on 13)

The method of claim 13, wherein displaying the indicator representing the identity of the user includes displaying the digital ink with a color associated with the identity of the user.

### Claim 15 (depends on 9)

The method of claim 9, further comprising receiving audio data associated with the electronic message and wherein displaying the digital ink within the body of the electronic message includes displaying the digital ink at a predetermined time during playing of the audio data.

### Claim 16 (depends on 9)

The method of claim 9, wherein comprising receiving audio data associated with the digital ink, receiving a user selection of the digital ink, and playing the audio data associated with the digital ink.

### Claim 17

Non-transitory computer-readable medium storing instructions that, when executed by an electronic processor, perform a set of functions, the set of functions comprising:
receiving an electronic message from a first user device, the electronic message including an image, digital ink, and positional information associated with the digital ink, the positional information representing a position of the digital ink within the electronic message relative to a position of at least one additional object within the electronic message;
receiving from a second user device a request for the electronic message; and
in response to the request,
determining whether the second user device is configured to display digital ink within electronic messages,
in response to the second user device being configured to display digital ink within electronic messages, transmit the electronic message including the digital ink and the positional information associated with the digital ink to the second user device, and
in response to the second user device not being configured to display digital ink within electronic messages, transmit the electronic message including the image to the second user device.

### Claim 18 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the image includes the digital ink and the at least one additional object.

### Claim 19 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the positional information includes a first position of the digital ink and a second position of the at least one additional object.

### Claim 20 (depends on 17)

The non-transitory computer-readable medium of claim 17, wherein the positional information includes a difference between a first position of the digital ink and a second position of the at least one additional object.
