# US 2016/0261666 A1 · Cooperative federation of digital devices via proxemics and device micro-mobility

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0261666 A1
- Document ID: US20160261666A1
- Status: Published application
- Kind: A1
- Application number: 15/062,036
- Filed: 2016-03-04
- Published: 2016-09-08
- Earliest claimed: 2013-03-14
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Kenneth P. Hinckley; Nicolai Marquardt
- Web page: https://patentgrep.com/patent/US20160261666A1

## CPC

- H04L 67/02: based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L 69/16: Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The subject disclosure is directed towards co-located collaboration/data sharing that is based upon detecting the proxemics of people and/or the proxemics of devices. A federation of devices is established based upon proxemics, such as when the users have entered into a formation based upon distance between them and orientation. User devices may share content with other devices in the federation based upon micro-mobility actions performed on the devices, e.g., tilting and/or otherwise interacting with a sending device.

## Claims

### Claim at position 1

1-20. (canceled)

### Claim 21

A system comprising a server configured to process image data to determine a formation based upon proxemics of users having digital devices, the server further configured to:
maintain federation data corresponding to:
an identity of the digital devices in the formation;
a distance between users associated with the digital devices; and
a relative body orientation of the users; and
communicate the federation data to the digital devices in the formation to establish a federation between two or more digital devices in the formation based on the federation data, the federation between the digital devices in the formation enabling the two or more digital devices in the formation to communicate content with one another based upon one or more micro-mobility actions detected by at least one of the two or more digital devices in the formation.

### Claim 22 (depends on 21)

The system of claim 21, wherein the server dynamically updates the federation data and the two or more digital devices in the formation upon a change to the formation.

### Claim 23 (depends on 21)

The system of claim 21, wherein the image data comprises depth data, and wherein the server includes a processing pipeline that determines the users within the depth data and the relative body orientation of the users relative to one another.

### Claim 24 (depends on 23)

The system of claim 23, wherein the relative body orientation of the users relative to one another comprises a face to face orientation, a side-to-side orientation, or a corner-to-corner orientation.

### Claim 25 (depends on 21)

The system of claim 21, wherein the server comprises a central server coupled to one or more cameras that provide the image data.

### Claim 26 (depends on 21)

The system of claim 21, wherein at least one of the digital devices in the federation is associated with the federation by proxemics but not associated with any one of the users.

### Claim 27 (depends on 21)

The system of claim 21, wherein at least one of the digital devices comprises a digital whiteboard or other display mechanism configured to render content.

### Claim 28 (depends on 21)

The system of claim 21, wherein the server is further configured to exclude a user from the federation based on the relative body orientation of the users.

### Claim 29

A method comprising;
determining proxemics among a plurality of devices, the plurality of digital devices comprising one or more of the following: at least two users having digital devices, at least one user and at least two digital devices, and at least two digital devices;
maintaining federation data indicative of a distance between users associated with the plurality of digital devices and a relative body orientation of the users;
establishing a federation between a set of the plurality of digital devices based upon the federation data, the federation enabling the set of the plurality of digital devices to communicate data between one another using micro-mobility actions, the micro-mobility actions comprising one or more of the following: device tilting, touch gesture, pen gesture, and multi-touch gesture.

### Claim 30 (depends on 29)

The method of claim 29, wherein maintaining the federation data further comprises updating the federation data upon a change to the federation.

### Claim 31 (depends on 29)

The method of claim 29, further comprising associating detected users with the devices.

### Claim 32 (depends on 29)

The method of claim 29, further comprising excluding a user from the federation based on the relative body orientation of the users.

### Claim 33 (depends on 29)

The method of claim 29, wherein the relative body orientation comprises a head orientation.

### Claim 34 (depends on 29)

The method of claim 29, further comprising detecting a tilting of a device in the federation prior to sharing content of the device.

### Claim 35 (depends on 34)

The method of claim 34 further comprising, taking one of a plurality of sharing actions based upon an amount of tilt detected.

### Claim 36

One or more computer-readable storage media having computer-executable instructions, which when executed on at least one processor perform operations comprising:
receiving content at a recipient device from a sending device, the sending device and the recipient device being participants in a federation established by relative body orientations between a user of the sending device and a user of the recipient device; and
rendering the content on the recipient device in partial, increasing amounts over time until the content is fully rendered, the rendering in partial, increasing amounts occurring from one direction based upon a location of the sending device relative to the recipient device to have the content appear to have come from a direction of the sending device relative to the recipient device.

### Claim 37 (depends on 36)

The one or more computer-readable storage media of claim 36 having further computer-executable instructions comprising:
detecting, at the sending device, one of a first micro-mobility action or a second micro-mobility action; and
sharing a full screen of content based on the first micro-mobility action or sharing less than a full screen of content based upon the second micro-mobility action.

### Claim 38 (depends on 37)

The one or more computer-readable storage media of claim 37, wherein the first micro-mobility action and the second micro-mobility action comprises one or more of the following: device tilting, touch gesture, pen gesture, and multi-touch gesture.

### Claim 39 (depends on 37)

The one or more computer-readable storage media of claim 37, wherein a difference between the first micro-mobility action and the second micro-mobility action is an amount of tilt detected by the sending device.

### Claim 40 (depends on 37)

The one or more computer-readable storage media of claim 37 having further computer-executable instructions comprising excluding a device from the federation based on a relative body orientation of a user associated with the device.
