# US 10,504,277 B1 · Communicating within a VR environment

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,504,277 B1
- Document ID: US10504277B1
- Status: Granted
- Kind: B1
- Application number: 15/638,051
- Filed: 2017-06-29
- Granted: 2019-12-10
- Earliest claimed: 2017-06-29
- Assignees: Amazon Technologies, Inc.
- Applicants: Amazon Technologies, Inc.
- Inventors: Robert Yuji Haitani; Alaa-Eddine Mendili; William R. Hazlewood; Dominick Khanh Pham
- Web page: https://patentgrep.com/patent/US10504277B1

## CPC

- G06T 15/20: Perspective computation
- H04L 65/403: Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15)
- H04L 65/1069: Session establishment or de-establishment
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 21/466: Learning process for intelligent management, e.g. learning user preferences for recommending movies {(services using the results of monitoring in broadcast systems H04H60/61)}
- G02B 2027/014: {comprising information/image processing systems}
- G06F 17/00: Digital computing or data processing equipment or methods, specially adapted for specific functions (information retrieval, database structures or file system structures therefor G06F16/00)
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

Techniques described herein include systems and methods for transforming communications and content from one communication platform to another communication platform such that content can be shared between users utilizing different user devices. In some embodiments, a communication session may be maintained between one or more users where each user is utilizing a different user device. First input may be received from a first communication platform from a first user that is intended to be shared to the one or more users in the communication session. In embodiments, a corresponding communication platform for each user participating in the communication session may be determined based on device information provided by associated user devices of the user when providing previous communications with the communication session and content included in the first input. The first input may be transformed from the first communication platform to one or more different communication platforms.

## Claims

### Claim 1

A computer-implemented method, comprising:
obtaining, by a virtual reality device, input identifying one or more entities to include in a communication session, the input provided by a user interacting with the virtual reality device and obtained by an input device associated with the virtual reality device;
initiating, by the virtual reality device, the communication session with the identified one or more entities based at least in part on the input;
transforming, by the virtual reality device, a communication from the user from a first media type of a first communication platform associated with the virtual reality device to a second media type of a second communication platform based at least in part on content of the communication and device information provided by respective user devices of the one or more entities of the communication session, the communication including first content to be shared, via the communication session, to the one or more entities, and the device information indicating device capabilities for each user device of the user devices;
receiving, by the virtual reality device, a response including second content from a particular entity of the one or more entities to be shared to the one or more entities in the communication session, the response including the device information about a user device of the user devices used by the particular entity to provide the response;
determining, by the virtual reality device, an appropriate communication platform to associate with the particular entity for the communication session based at least in part on the response and the device information about the user device; and
updating, by the virtual reality device, information associated with the communication session to enable subsequent communications, within the communications session, from the user to the particular entity to be transformed to the appropriate communication platform.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, further comprising generating, by the virtual reality device, a data object representing the response in the communication session.

### Claim 3 (depends on 2)

The computer-implemented method of claim 2, further comprising displaying the generated data object within a virtual reality environment displayed to the user interacting with the virtual reality device.

### Claim 4 (depends on 3)

The computer-implemented method of claim 3, wherein
displaying the generated data object within the virtual reality environment comprises displaying the data object in a certain position of the virtual environment based at least in part on a content type associated with the data object.

### Claim 5

A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a computer system, configure the computer system to perform operations comprising:
maintaining a communication session between users, each user utilizing a different user device to participate in the communication session;
receiving first input, via a first communication platform, from a first user of the users intended to be shared in the communication session to the users;
determining a communication platform for each user of the users participating in the communication session based at least in part on device information provided by respective user devices of the users of the communication session and content of the first input, the device information indicating device capabilities for the respective user devices;
transforming the first input from a first media type of the first communication platform to one or more different media types of one or more different communication platforms corresponding to the determined communication platform for each user of the users participating in the communication session thereby enabling different user devices associated with the users to consume the content of the first input; and
transmitting the transformed first input via the one or more different communication platforms to the users participating in the communication session.

### Claim 6 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise updating the communication session to enable subsequent input provided by the users within the communication session to utilize the one or more different communication platforms.

### Claim 7 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise maintaining user preferences that identify a preferred communication platform to utilize for subsequent content provided to the communication session based at least in part on different user devices.

### Claim 8 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein transforming the first input from the first communication platform to the one or more different communication platforms comprises generating a data object of a different media type from the media type associated with the first input.

### Claim 9 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise initiating the communication session based at least in part on an external input device associated with a user device obtaining the first input from the first user, the user device associated with the first user.

### Claim 10 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise providing certain communications within the communication session to a social media platform.

### Claim 11 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein receiving the first input from the first user comprises receiving the first input from the first user interacting with a virtual reality device.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium of claim 11, wherein the device information includes a user-specified context of the virtual reality device.

### Claim 13 (depends on 5)

The non-transitory computer-readable storage medium of claim 5, wherein the device information includes a hardware identifier for the different user devices and application information of the different user devices.

### Claim 14

A computer system comprising:
a memory configured to store computer-executable instructions;
a processor in communication with the memory configured to execute the computer-executable instructions to at least:
maintain a communication session that enables entities to communicate;
receive first input via a first device from an entity participating in the communications session;
identify a first media type of a first communication platform to associate with the entity based on device information corresponding to the first device and first content of the first input, the device information indicating device capabilities of the first device;
receive second input via a second device from the entity participating in the communication session;
identify a second media type of a second communication platform to associate with the entity based on the updated device information corresponding to the second device and second content of the second input, the updated device information indicating the device capabilities of the second device; and
update the communication session such that subsequent input provided by the entities of the communication session are provided to the entity utilizing the second communication platform.

### Claim 15 (depends on 14)

The computer system of claim 14, wherein the processor is further configured to maintain a timeline associated with the communication session that identifies when certain content was provided to the communication session.

### Claim 16 (depends on 14)

The computer system of claim 14, wherein the communication session is configured to enable the entities to interact with certain content maintained in the communication session based at least in part on transitioning to a device capable of consuming the certain content.

### Claim 17 (depends on 14)

The computer system of claim 14, wherein the processor is further configured to archive an original content type of certain content provided to the communication session and a transformed content type of the certain content provided to the entities of the communication session.

### Claim 18 (depends on 14)

The computer system of claim 14, wherein the processor is further configured to display the subsequent input to the communication session according to a hierarchical content scheme that utilizes a type of content associated with the subsequent input to rank the display of the subsequent input.

### Claim 19 (depends on 14)

The computer system of claim 14, wherein identifying the second communication platform to associate with the entity is further based at least in part on input and output device capabilities indicated by the updated device information.

### Claim 20 (depends on 14)

The computer system of claim 14, wherein the processor is further configured to transmit a notification of the subsequent input provided by the entities of the communication session to the entities based at least in part on a contextual mode specified by each of the entities.