# US 2019/0246146 A1 · Simulating a local experience by live streaming sharable viewpoints of a live event

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0246146 A1
- Document ID: US20190246146A1
- Status: Published application
- Kind: A1
- Application number: 16/269,478
- Filed: 2019-02-06
- Published: 2019-08-08
- Earliest claimed: 2018-02-06
- Assignees: Phenix Real Time Solutions, Inc.
- Applicants: PhenixP2P Inc.
- Inventors: Fabián BUSTAMANTE; Stefan BIRRER
- Web page: https://patentgrep.com/patent/US20190246146A1

## CPC

- H04N 21/2187: Live feed
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/012: {Head tracking input arrangements}
- H04L 65/4015: {where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference}
- H04L 65/611: for multicast or broadcast (systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06)
- H04L 65/612: for unicast
- H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)}
- H04L 65/80: Responding to QoS
- H04L 67/131: Protocols for games, networked simulations or virtual reality
- H04L 67/306: User profiles
- H04N 21/21805: {enabling multiple viewpoints, e.g. using a plurality of cameras}
- H04N 21/2396: {characterized by admission policies (admission control, resource allocation in open networks H04L12/5692; arrangements for network security using user profiles for access control H04L63/102; access security in wireless networks H04W12/08)}
- H04N 21/242: Synchronisation processes, e.g. processing of PCR [Programme Clock References] {(arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18)}
- H04N 21/2743: Video hosting of uploaded data from client
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 21/816: {involving special video data, e.g 3D video}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

The disclosed embodiments include at least one method. The method includes communicatively coupling a first client device to a platform that distributes live streams over a network to client devices including the first client device. The live streams provide a live broadcast of a live event from viewpoints captured by source devices located at the live event including a second client device. The method further includes receiving an indication of a selection of a first viewpoint from the first client device and communicating a first live stream to the first client device. The first live stream is captured by a first source device and, when rendering by the first client device, causes display of the first viewpoint on the first client device.

## Claims

### Claim 1

A method comprising:
communicatively coupling a first client device to a platform that distributes a plurality of live streams over a network to a plurality of client devices including the first client device, the plurality of live streams providing a live broadcast of a live event from a plurality of viewpoints captured by a plurality of source devices located at the live event including a second client device of the plurality of client devices;
receiving an indication of a selection of a first viewpoint of the plurality of viewpoints from the first client device; and
communicating a first live stream of the plurality of live streams to the first client device, the first live stream being captured by a first source device of the plurality of source devices and, when rendering by the first client device, causes display of the first viewpoint on the first client device.

### Claim 2 (depends on 1)

The method of claim 1, wherein the first client device is remotely located from the live event such that the client device simulates a local experience of the live event.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first client device is located at a first location of the live event and the first viewpoint is from a second location of the live event such that first client device renders a virtual experience of the second location.

### Claim 4 (depends on 1)

The method of claim 1, wherein the first client device is a handheld mobile device and the first source device is a handheld mobile device.

### Claim 5 (depends on 1)

The method of claim 1, wherein the first source device is a stationary device having a camera and microphone and is positioned at a fixed location at the live event.

### Claim 6 (depends on 1)

The method of claim 1, wherein the first source device is the second client device, and the second client device is a mobile device of a performing of the live event.

### Claim 7 (depends on 1)

The method of claim 1, wherein the first client device is located at the live event and the first source device is the second client device, the method further comprising:
hosting a virtual interaction between the first client device and the second client device, the virtual interaction simulating a local interaction at the live event.

### Claim 8 (depends on 1)

The method of claim 1, wherein the first client device is located remotely from the live event and the first source device is the second client device, the method further comprising:
hosting a virtual interaction between the first client device and the second client device, the virtual interaction simulating a local interaction at the live event.

### Claim 9 (depends on 1)

The method of claim 1 further comprising:
communicatively coupling a third client device to the platform over the network, the first client device and the third client device each being remotely located from the live event and remotely located from each other; and
hosting a virtual interaction between the first client device and the third client device, the virtual interaction simulating a local interaction at the live event.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first client device is a source device of the plurality of source devices, and the first source device is the second client device, the method further comprising:
communicating a second viewpoint of the first client device over the network to the second client device such that the first client device and the second client device share their local viewpoints of the live event.

### Claim 11 (depends on 1)

The method of claim 1, wherein the first client device is a second source device located at the live event and the first source device is a stationary device of the plurality of source devices, the method further comprising:
enabling the second client device to selectively display a second viewpoint of the first client device by rendering a second live stream sourced from the first client device.

### Claim 12 (depends on 1)

The method of claim 1, wherein the first source device is a stationary device at a fixed location at the live event, the method further comprising:
receiving an indication of another selection by the first client device of a second viewpoint of the stationary device; and
causing the first client device to terminate the display of the first viewpoint and display the second viewpoint by rendering a second live stream of the stationary device.

### Claim 13 (depends on 1)

The method of claim 1, wherein the first source device is the second client device, the method further comprising:
communicatively coupling a third client device to the platform over the network, the third client device being a second source device;
causing the first client device to subscribe to a second live stream of the third client device and to unsubscribe from the first live stream; and
updating a profile associated with the first client device to reflect the subscription to the second live stream and being unsubscribed from the first live stream.

### Claim 14 (depends on 1)

The method of claim 1, wherein the first client device is located at the live event, the method further comprising:
augmenting the first live stream with augmented reality (AR) content that, when rendered by the first client device, displays an AR viewpoint including the first viewpoint of the live event augmented by the content.

### Claim 15 (depends on 1)

The method of claim 1 further comprising:
hosting the plurality of live streams as a plurality of selectable viewpoints of the live event available to the plurality of client devices.

### Claim 16 (depends on 1)

The method of claim 1 further comprising, prior to connecting the first client device to the platform:
synchronizing at least some of the plurality of live streams relative to a point in time of the live broadcast of the live event;
defining a synchronized group of live streams to include any synchronized live streams and preclude any live streams that are not synchronized to the point in time; and
limiting access by any of the plurality of client devices to the synchronized group of live streams.

### Claim 17 (depends on 1)

The method of claim 1, wherein each live stream includes a plurality of packets grouped into a plurality of scenes of the live event, the method further comprising:
causing the first client device to adopt a second viewpoint by rendering a second live stream of a second source device, the rendering of the second live stream being delayed until a beginning of a next scene of the first live stream.

### Claim 18 (depends on 1)

The method of claim 1, wherein each live stream includes a plurality of packets grouped into a plurality of scenes, the method further comprising:
enabling the first client device to render a second live stream only at a point in time defined relative to one or more scenes of the plurality of scenes.

### Claim 19 (depends on 1)

The method of claim 1, wherein the first client device and the first source device are each located at the live event, the method further comprising:
receiving an indication of a selection of augmented reality (AR) content from the first client device; and
responsive to the indication of the selection of the AR content, augmenting the first live stream with the AR content that, when rendered by the first client device, causes the first client device to display an AR viewpoint with the AR content superimposed on the display of the first viewpoint.

### Claim 20 (depends on 1)

The method of claim 1 further comprising:
implementing an access restriction indicated by the second client device to limit access to a second viewpoint of the second client device to only some of the plurality of client devices.

### Claim 21 (depends on 1)

The method of claim 1 further comprising:
associated a privacy level with each live stream, the privacy level including a public level that grants unrestricted access by each client device and a private level that limits access to only some of the plurality of client devices.

### Claim 22

A server computer system comprising:
a processor; and
a memory including instructions that, when executed by the processor, cause the server computer system to:
interconnect a plurality of client devices over a network, wherein at least some of the plurality of client devices are located at a live event and at least some of the plurality of client devices are remotely located from the live event, and each client device located at the live event is a source of a live stream that, when rendered by a device, causes a display of a viewpoint of the live event;
dynamically update a subscription list to include any of the plurality of client devices that are currently live streaming a viewpoint of the live event and remove any of the plurality of client devices that stopped live streaming a viewpoint of the live event; and
host a subscription service that enables selective access by any of the plurality of client devices to any client device on the subscription list and disables access to any client device removed from the subscription list.

### Claim 23 (depends on 22)

The system of claim 22, wherein the subscription list is a first subscription list, the system further caused to:
dynamically update another subscription list to include any of the plurality of client devices that have previously been sources of live streams to any live event.

### Claim 24 (depends on 22)

The system of claim 22 further caused to:
perform a search function in response to a query for a client device that is currently live streaming a viewpoint of the live event.

### Claim 25

A head mounted display (HMD) device comprising:
a display device;
an orientation sensor;
a processor; and
a memory including instructions that, when executed by the processor, cause the HMD device to:
render a live stream of a plurality of live streams to display a viewpoint of a plurality of viewpoints of a live event on the display device, the plurality of live streams originating at a plurality of source devices located at the live event, the plurality of source devices including a stationary device at a fixed location at the live event and a handheld mobile device;
determine a change in an orientation of the HMD device based on an output of the orientation sensor; and
dynamically track the change in the orientation of the HMD device to seamlessly transition from the display of the viewpoint of the live stream of the stationary device to display another viewpoint of another live stream of the handheld mobile device.
