# US 10,120,854 B2 · Application/document collaboration in a multi-device environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,120,854 B2
- Document ID: US10120854B2
- Status: Granted
- Kind: B2
- Application number: 15/438,504
- Filed: 2017-02-21
- Published: 2017-06-08
- Granted: 2018-11-06
- Earliest claimed: 2013-06-15
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: John Campbell; Carlos Augusto Otero
- Web page: https://patentgrep.com/patent/US10120854B2

## CPC

- G06F 40/18: of spreadsheets (form-filling G06F40/174)
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06Q 10/101: Collaborative creation, e.g. joint development of products or services
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 65/4038: with floor control
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/80: Responding to QoS
- G06F 9/452: {Remote windowing, e.g. X-Window System, desktop virtualisation (protocols for virtual reality H04L67/131)}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

Application/document collaboration in a multi-device environment is provided. An application and associated document or other content, for example, a spreadsheet application and associated spreadsheet documents and content may be displayed on one or more endpoint display devices. A presenter may control the application/document from another device, for example, a smartphone, tablet-style computer, laptop computer, desktop computer, and the like. User interactions on the presenter control device may be reflected on the display device, including, document navigation, document editing, document entry, and the like. Document content may be previewed on the control device before it is sent to the display device. Document metadata and/or presenter notes/comments, etc., may be displayed only on the control device, but not on the display device, as desired by the presenter/user.

## Claims

### Claim 1

A computer-implemented method of collaboration in a multi-device environment, comprising:
displaying, via a cloud-based application at a presentation control device, an electronic document, wherein the presentation control device displays a smaller form factor than an endpoint display device, and wherein at least one control provided by the cloud-based application is operable to navigate display of the electronic document on the endpoint display device;
providing the electronic document to the endpoint display device;
receiving a change to the electronic document from the presentation control device via the cloud-based application;
in response to receiving the change to the electronic document, providing a preview of a corresponding change via the cloud-based application before the corresponding change is made to the electronic document provided to the endpoint display device;
translating the corresponding change to a format interpretable by the endpoint display device; and
after providing the preview, providing the translated corresponding change to the electronic document on the endpoint display device, wherein the translated corresponding change is interpretable for display on the endpoint display device based on the format.

### Claim 2 (depends on 1)

The method of claim 1, wherein displaying the electronic document includes displaying the electronic document to the endpoint display device according to a form factor of the endpoint display device.

### Claim 3 (depends on 1)

The method of claim 1, wherein displaying the electronic document on the endpoint display device includes duplicating the electronic document displayed via the cloud-based application to the endpoint display device.

### Claim 4 (depends on 1)

The method of claim 1, further comprising
receiving, via the cloud-based application, a command on the electronic document;
applying the received command to the electronic document; and
applying the received command to the electronic document displayed to the endpoint display device.

### Claim 5 (depends on 4)

The method of claim 4, further comprising operatively associating the cloud-based application with the endpoint display device such that commands received via the cloud-based application are automatically passed to the endpoint display device for application to the corresponding electronic document provided to the endpoint display device.

### Claim 6 (depends on 4)

The method of claim 4, wherein applying the received command to the electronic document displayed on the endpoint display device includes capturing the received command and translating the received command for application to the electronic document provided to the endpoint display device.

### Claim 7 (depends on 1)

The method of claim 1, in response to providing a preview of the corresponding change, further comprising providing a command to make a lesser included change to the electronic document provided to the endpoint display device.

### Claim 8 (depends on 1)

The method of claim 1, wherein making the corresponding change to the electronic document provided to the endpoint display device includes providing a lesser included change to the electronic document provided to the endpoint display device.

### Claim 9 (depends on 1)

The method of claim 1, further comprising providing, via the cloud-based application, one or more metadata items for the electronic document that are not provided with the electronic document to the endpoint display device.

### Claim 10 (depends on 1)

The method of claim 1, further comprising providing, via the cloud-based application, one or more presentation notes for the electronic document that are not provided with the electronic document to the endpoint display device.

### Claim 11 (depends on 1)

The method of claim 1, further comprising providing a command, via the cloud-based application, to designate a different display device as a second endpoint display device such that the electronic document is provided to the second endpoint display device.

### Claim 12 (depends on 1)

The method of claim 1, further comprising providing a command, via the cloud-based application, to designate a second display device as a second endpoint display device such that providing the electronic document to the endpoint display device includes providing the electronic document to both the endpoint display device and the second endpoint display device.

### Claim 13 (depends on 1)

The method of claim 1, further comprising:
prior to displaying an electronic document, displaying an instance of an application user interface; and
prior to providing the electronic document to the endpoint display device, displaying an instance of an application user interface on an endpoint display device.

### Claim 14 (depends on 13)

The method of claim 13, wherein providing the instance of the application user interface to the endpoint display device includes providing, via the cloud-based application, the instance of the application user interface to the endpoint display device having a subset of functionalities available on the instance of the application user interface displayed on the presentation control device.

### Claim 15

A computer-implemented method of spreadsheet application and content collaboration in a multi-device environment, comprising:
displaying, via a cloud-based application at a presenter control device, an instance of a spreadsheet application user interface, wherein the presenter control device displays a smaller form factor than an endpoint display device, and wherein at least one control provided by the cloud-based application is operable to navigate display of an electronic spreadsheet document on the endpoint display device;
providing an instance of a spreadsheet application user interface to the endpoint display device, and providing the electronic spreadsheet document to the endpoint display device;
receiving a change to the electronic spreadsheet document via a spreadsheet application from the presenter control device via the cloud-based application;
in response to receiving the change to the electronic spreadsheet document, providing a preview of a corresponding change via the cloud-based application before the corresponding change is made to the electronic document provided to the endpoint display device;
translating the corresponding change to a format interpretable by the endpoint display device; and
after providing the preview, providing the translated corresponding change to the electronic spreadsheet document to the endpoint display device, wherein the translated corresponding change is interpretable for display on the endpoint display device based on the format.

### Claim 16 (depends on 15)

The method of claim 15, wherein providing the instance of the spreadsheet application user interface to the endpoint display device includes providing, via the cloud-based application, the instance of the spreadsheet application user interface to the endpoint display device having a subset of functionalities available on the instance of the spreadsheet application user interface displayed on the presenter control device.

### Claim 17 (depends on 15)

The method of claim 15, further comprising operatively associating the presenter control device via the cloud-based application with the endpoint display device such that commands received on the electronic spreadsheet document displayed on the presenter control device are automatically passed to the endpoint display device for application to the corresponding electronic spreadsheet document provided to the endpoint display device.

### Claim 18 (depends on 15)

The method of claim 15, further comprising providing a command to make a lesser included change to the electronic spreadsheet document provided to the endpoint display device.

### Claim 19

A system for collaboration in a multi-device environment, comprising:
one or more processors; and
a memory coupled to the one or more processors, the one or more processors operable to:
display, via a cloud-based application at a presentation control device, an electronic document, wherein the presentation control device displays a smaller form factor than an endpoint display device;
provide the electronic document to the endpoint display device;
capture a received command for making a change to the electronic document, wherein at least one control provided by the cloud-based application is operable to navigate display of the electronic document on the endpoint display device;
in response to receiving the command for making the change to the electronic document, providing a preview of an effect of the change via the cloud-based application before the change is made to the electronic document provided to the endpoint display device;
translate the received command and pass the translated received command to the endpoint display device; and
after providing the preview, providing the change to the electronic document on the endpoint display device in response to the translated received command.

### Claim 20 (depends on 19)

The system of claim 19, wherein providing the electronic document to the endpoint display device includes providing, via the cloud-based application, an instance of an application user interface to the endpoint display device having a subset of functionalities available on an instance of the application user interface displayed on the presentation control device.
