# US 2017/0373969 A1 · Routing virtual area based communications

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0373969 A1
- Document ID: US20170373969A1
- Status: Published application
- Kind: A1
- Application number: 15/696,135
- Filed: 2017-09-05
- Published: 2017-12-28
- Earliest claimed: 2007-10-24
- Assignees: Sococo, Inc.
- Applicants: Sococo, Inc.
- Inventors: Robert J. Butler; Joseph Altmaier; David Van Wie
- Web page: https://patentgrep.com/patent/US20170373969A1

## CPC

- H04L 67/131: Protocols for games, networked simulations or virtual reality
- G06T 11/60: Creating or editing images; Combining images with text
- G06T 13/40: of characters, e.g. humans, animals or virtual beings
- G06T 15/205: {Image-based rendering}
- G06T 17/05: Geographic models
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 19/20: Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
- H04L 45/54: {Organization of routing tables}
- H04L 65/61: for supporting one-way streaming services, e.g. Internet radio
- H04L 65/765: {intermediate}
- G06T 2200/04: involving 3D image data
- G06T 2207/10012: Stereo images
- G06T 2207/10016: Video; Image sequence
- G06T 2207/10072: Tomographic images
- G06T 2207/30196: Human being; Person
- G06T 2215/16: Using real world measurements to influence rendering
- G06T 2219/024: Multi-user, collaborative environment
- G06T 2219/2004: Aligning objects, relative positioning of parts
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In association with a virtual area, a first network connection is established with a first network node present in the virtual area and a second network connection is established with a second network node present in the virtual area. Based on stream routing instructions, a stream router is created between the first network node and the second network node. The stream router includes a directed graph of processing elements operable to receive network data, process the received network data, and output the processed network data. On the first network connection, an input data stream derived from output data generated by the first network node is received in association with the virtual area. The input data stream is processed through the stream router to produce an output data stream. On the second network connection, the output data stream is sent to the second network node.

## Claims

### Claim at position 1

1-40. (canceled)

### Claim 41

A method of routing data streams between client network nodes in connection with a virtual area, comprising:
routing one or more data streams of a first data stream type over a first topology of one or more network connections between the client network nodes;
responsive to an event that satisfies a topology switching predicate, determining a second topology of one or more network connections between the client network nodes, wherein the first and second topologies are different;
responsive to a determination that the second topology of one or more connections currently exists, transmitting one or more data streams of the first data stream type over the existing second topology of one or more connections between the client network nodes; and
responsive to a determination that the second topology of one or more connections currently does not exist, establishing the one or more connections according to the second topology, and transmitting one or more data streams of the first data stream type over the established second topology of one or more connections between the client network nodes.

### Claim 42 (depends on 41)

The method of claim 41, wherein the virtual area is associated with a first switching rule that defines a first communication property of the virtual area in terms of connections of sources to sinks of the first data stream type between ones of the client network nodes of users who are copresent in the virtual area.

### Claim 43 (depends on 42)

The method of claim 42, wherein the topology switching predicate is satisfied based on a count of client network nodes of the copresent users who are concurrently communicating streams of the first data stream type in the virtual area.

### Claim 44 (depends on 42)

The method of claim 42, wherein the topology switching predicate is satisfied based on respective bandwidth capabilities of client network nodes of the copresent users who are concurrently communicating streams of the first data stream type in the virtual area.

### Claim 45 (depends on 42)

The method of claim 42, wherein the topology switching predicate is satisfied based on respective current network latencies experienced by the client network nodes of the copresent users who are concurrently communicating streams of the first data stream type in the virtual area.

### Claim 46 (depends on 42)

The method of claim 42, wherein the topology switching predicate is satisfied based on respective packet losses experienced by the client network nodes of the copresent users who are concurrently communicating streams of the first data stream type in the virtual area.

### Claim 47 (depends on 42)

The method of claim 42, wherein the topology switching predicate is satisfied based on attribute values associated with positions in the virtual area in which the users are copresent.

### Claim 48 (depends on 42)

The method of claim 42, wherein the first data stream type is audio data.

### Claim 49 (depends on 42)

The method of claim 42, wherein the first data stream type is video data.

### Claim 50 (depends on 42)

The method of claim 42, further comprising, after the establishing, tearing down the first topology of one or more network connections between the client network nodes.

### Claim 51 (depends on 42)

The method of claim 42, further comprising, after the establishing, reconfiguring the first topology of one or more network connections between the client network nodes as a standby route.

### Claim 52 (depends on 42)

The method of claim 42, wherein the first topology corresponds to a peer-to-peer session between the first and second client network nodes, and the second topology corresponds to a session between the client network nodes that is at least in part is mediated by a server network node.

### Claim 53 (depends on 42)

The method of claim 42, wherein the virtual area comprises zones each of which supports establishment of communicant presence, and the first switching rule is associated with each of multiple of the zones.

### Claim 54 (depends on 53)

The method of claim 53, wherein each of the multiple zones is associated with a second switching rule that defines a second communications property of the virtual area in terms of connections of sources to sinks of a second data stream type between client network nodes of users who are copresent in a respective one of the multiple zones, wherein the first and second data stream types are different.

### Claim 55 (depends on 54)

The method of claim 54, wherein: before the event, one or more data streams of the second data stream type are routed over a topology of one or more network connections between the client network nodes that is different from the first topology.

### Claim 56 (depends on 54)

The method of claim 54, wherein: after the event, one or more data streams of the second data stream type are routed over the second topology.

### Claim 57 (depends on 41)

The method of claim 41, wherein the first topology is a peer-to-peer topology and the second topology is mediated at least in part by a server network node.

### Claim 58

A system for routing data streams between client network nodes in connection with a virtual area, comprising
at least one memory storing processor-readable instructions, and
at least one processor, operable to execute the instructions, and based at least in part on the execution of the instructions operable to perform operations comprising:
routing one or more data streams of a first data stream type over a first topology of one or more network connections between the client network nodes;
responsive to an event that satisfies a topology switching predicate, determining a second topology of one or more network connections between the client network nodes, wherein the first and second topologies are different;
responsive to a determination that the second topology of one or more connections currently exists, transmitting one or more data streams of the first data stream type over the existing second topology of one or more connections between the client network nodes; and
responsive to a determination that the second topology of one or more connections currently does not exist, establishing the one or more connections according to the second topology, and transmitting one or more data streams of the first data stream type over the established second topology of one or more connections between the client network nodes.

### Claim 59

A computer program product for execution by a computer system and comprising at least one non-transitory computer-readable medium having computer-readable program code portions embodied therein, the computer-readable program code portions comprising:
an executable code portion configured to route one or more data streams of a first data stream type over a first topology of one or more network connections between the client network nodes;
an executable code portion configured to determine, responsive to an event that satisfies a topology switching predicate, a second topology of one or more network connections between the client network nodes, wherein the first and second topologies are different;
an executable code portion configured to transmit, responsive to a determination that the second topology of one or more connections currently exists, one or more data streams of the first data stream type over the existing second topology of one or more connections between the client network nodes; and
an executable code portion configured to establish, responsive to a determination that the second topology of one or more connections currently does not exist, the one or more connections according to the second topology, and transmitting one or more data streams of the first data stream type over the established second topology of one or more connections between the client network nodes.
