# US 2021/0176537 A1 · Omnidirectional video streaming

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0176537 A1
- Document ID: US20210176537A1
- Status: Published application
- Kind: A1
- Application number: 16/764,714
- Filed: 2019-08-06
- Published: 2021-06-10
- Earliest claimed: 2018-08-07
- Assignees: Core S.R.L.
- Applicants: Core
- Inventors: Seoyeon Kang; Taekyoung Kim
- Web page: https://patentgrep.com/patent/US20210176537A1

## CPC

- H04N 21/816: {involving special video data, e.g 3D video}
- H04N 19/597: specially adapted for multi-view video sequence encoding
- H04N 21/2393: {involving handling client requests (scheduling or organising the servicing of application requests H04L67/60)}
- H04N 21/437: Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server {(flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60)}
- H04N 21/44218: {Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45)}
- H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
- H04N 21/6587: Control parameters, e.g. trick play commands, viewpoint selection
- H04N 19/162: User input
- H04N 19/164: Feedback from the receiver or from the transmission channel
- H04N 19/46: Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method and system for streaming video is disclosed. The method and system can include sharing and playing an omnidirectional multi-2D-panel video stream wherein field of view data is obtained from a viewer, and the omnidirectional multi-2D-panel video stream is updated when the field of view data indicates a change in a field of view of the viewer.

## Claims

### Claim 1

A method comprising:
rendering, by an omnidirectional multi-2D-panel video stream player system, omnidirectional multi-2D-panel video stream data;
presenting, by the omnidirectional multi-2D-panel video stream player system, the omnidirectional multi-2D-panel video stream data on a display;
obtaining, by the omnidirectional multi-2D-panel video stream player system, field of view (FoV) data of a viewer;
sending, by the omnidirectional multi-2D-panel video stream player system to an omnidirectional multi-2D-panel video stream provider system, the FoV data of the viewer;
receiving, by the omnidirectional multi-2D-panel video stream player system from the omnidirectional multi-2D-panel video stream provider system, modified omnidirectional multi-2D-panel video stream data;
rendering, by the omnidirectional multi-2D-panel video stream player system, the modified omnidirectional multi-2D-panel video stream data;
presenting, by the omnidirectional multi-2D-panel video stream player system, the modified omnidirectional multi-2D-panel video stream data on the display.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
compressing, by the omnidirectional multi-2D-panel video stream provider system, the omnidirectional multi-2D panel video stream data a video codec;
decompressing, by the omnidirectional multi-2D-panel video stream player system, the compressed omnidirectional multi-2D panel video stream data before rendering the omnidirectional multi-2D panel video stream data.

### Claim 3 (depends on 1)

The method of claim 1, further comprising:
receiving, by the omnidirectional multi-2D-panel video stream provider system from the omnidirectional multi-2D-panel video stream player system, a request for omnidirectional multi-2D-panel video stream data;
sending, by the omnidirectional multi-2D-panel video stream provider system to the omnidirectional multi-2D-panel video stream player system, the omnidirectional multi-2D-panel video stream data.

### Claim 4 (depends on 1)

The method of claim 1, further comprising modifying, by the omnidirectional multi-2D-panel video stream provider system, the omnidirectional multi-2D-panel video stream data based on the FoV data of the viewer.

### Claim 5 (depends on 1)

The method of claim 1, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more cameras.

### Claim 6 (depends on 1)

The method of claim 1, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more acceleration and gyro sensors attached to a body portion of the viewer.

### Claim 7 (depends on 1)

The method of claim 1, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more acceleration and gyro sensors located in a head-mount device worn by the viewer.

### Claim 8 (depends on 1)

The method of claim 1, wherein the FoV data include data indicating a current FoV or predicted future FoV of the viewer.

### Claim 9 (depends on 1)

The method of claim 1, wherein the receiving the FoV data comprises receiving the FoV data continuously.

### Claim 10 (depends on 1)

The method of claim 1, wherein the receiving the FoV data comprises receiving the FoV data when an FoV of the viewer has changed or is predicted to change.

### Claim 11

A data processing system comprising a processor adapted to perform:
rendering, by an omnidirectional multi-2D-panel video stream player system, omnidirectional multi-2D-panel video stream data;
presenting, by the omnidirectional multi-2D-panel video stream player system, the omnidirectional multi-2D-panel video stream data on a display;
obtaining, by the omnidirectional multi-2D-panel video stream player system, field of view (FoV) data of a viewer;
sending, by the omnidirectional multi-2D-panel video stream player system to an omnidirectional multi-2D-panel video stream provider system, the FoV data of the viewer;
receiving, by the omnidirectional multi-2D-panel video stream player system from the omnidirectional multi-2D-panel video stream provider system, modified omnidirectional multi-2D-panel video stream data;
rendering, by the omnidirectional multi-2D-panel video stream player system, the modified omnidirectional multi-2D-panel video stream data;
presenting, by the omnidirectional multi-2D-panel video stream player system, the modified omnidirectional multi-2D-panel video stream data on the display.

### Claim 12 (depends on 11)

The data processing system of claim 11, wherein the processor is adapted to perform:
compressing, by the omnidirectional multi-2D-panel video stream provider system, the omnidirectional multi-2D panel video stream data a video codec;
decompressing, by the omnidirectional multi-2D-panel video stream player system, the compressed omnidirectional multi-2D panel video stream data before rendering the omnidirectional multi-2D panel video stream data.

### Claim 13 (depends on 11)

The data processing system of claim 11, wherein the processor is adapted to perform:
receiving, by the omnidirectional multi-2D-panel video stream provider system from the omnidirectional multi-2D-panel video stream player system, a request for omnidirectional multi-2D-panel video stream data;
sending, by the omnidirectional multi-2D-panel video stream provider system to the omnidirectional multi-2D-panel video stream player system, the omnidirectional multi-2D-panel video stream data.

### Claim 14 (depends on 11)

The data processing system of claim 11, wherein the processor is adapted to perform: modifying, by the omnidirectional multi-2D-panel video stream provider system, the omnidirectional multi-2D-panel video stream data based on the FoV data of the viewer.

### Claim 15 (depends on 11)

The data processing system of claim 11, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more cameras.

### Claim 16 (depends on 11)

The data processing system of claim 11, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more acceleration and gyro sensors attached to a body portion of the viewer.

### Claim 17 (depends on 11)

The data processing system of claim 11, wherein the FoV data is obtained by one or more sensors configured to track eye or head movement of the viewer, the one or more sensors including one or more acceleration and gyro sensors located in a head-mount device worn by the viewer.

### Claim 18 (depends on 11)

The data processing system of claim 11, wherein the FoV data include data indicating a current FoV or predicted future FoV of the viewer.

### Claim 19 (depends on 11)

The data processing system of claim 11, wherein the receiving the FoV data comprises receiving the FoV data continuously.

### Claim 20 (depends on 11)

The data processing system of claim 11, wherein the receiving the FoV data comprises receiving the FoV data when an FoV of the viewer has changed or is predicted to change.

### Claim 21

A system comprising:
a means for rendering omnidirectional multi-2D-panel video stream data;
a means for presenting the omnidirectional multi-2D-panel video stream data on a display;
a means for obtaining field of view (FoV) data of a viewer;
a means for sending to an omnidirectional multi-2D-panel video stream provider system the FoV data of the viewer;
a means for receiving from the omnidirectional multi-2D-panel video stream provider system modified omnidirectional multi-2D-panel video stream data;
a means for rendering the modified omnidirectional multi-2D-panel video stream data;
a means for presenting the modified omnidirectional multi-2D-panel video stream data on the display.
