US 2021/0281815 A1 · SYSTEMS AND METHOD FOR GPU BASED VIRTUAL REALITY VIDEO STREAMING SERVER

Abstract

Systems and methods of processing and streaming a virtual reality video using a graphics processing unit (GPU) are provided. A video server is configured to cause a processor to read, from a video data source, source video data including multiple spherical image frame data and store the source video data in a first memory. The video server is further configured to cause the GPU to convert, in response to storing first spherical image frame data in a first frame buffer of a second memory, the first spherical image frame data to first equirectangular image frame data that correspond to a portion of spherical image represented by the first spherical image frame data, encode the converted first equirectangular image frame data and store the encoded first equirectangular image frame data in an encoded frame buffer of the second memory.

Claims20

Dependent claims

A method comprising:

initiating, by one or more processors, storage of a first equirectangular image outputted from a first conversion of a first spherical image associated with a first field of view;
detecting, by the one or more processors, a change from the first field of view to a second field of view before completion of the storage of the first equirectangular image;
and
initiating, by the one or more processors and in response to the detected change, a second conversion of the first spherical image associated with the first field of view into a second equirectangular image associated with the second field of view.

1 more element

A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

initiating storage of a first equirectangular image outputted from a first conversion of a first spherical image associated with a first field of view;
detecting a change from the first field of view to a second field of view before completion of the storage of the first equirectangular image;
and
in response to the detected change, initiating a second conversion of the first spherical image associated with the first field of view into a second equirectangular image associated with the second field of view.

1 more element

A system comprising:

one or more processors;
and
a memory storing instructions that, when executed by at least one processor among the one or more processors, cause the system to perform operations comprising:
initiating storage of a first equirectangular image outputted from a first conversion of a first spherical image associated with a first field of view;
detecting a change from the first field of view to a second field of view before completion of the storage of the first equirectangular image;
and
in response to the detected change, initiating a second conversion of the first spherical image associated with the first field of view into a second equirectangular image associated with the second field of view.

4 more elements

Dependencies are inferred from the claim text.

Facts

Application

17/315,995Filed 10 May 2021

Priority

19 Feb 2016

Published

9 Sep 2021

Term ends

Not estimatedThe source records don’t support an estimate.

Classification28 codes

G06F 3/147
Digital output to display device ; Cooperation and interconnection of the display device with other functional units: using display panels
G06T 1/20
General purpose image data processing: processor architectures; Processor configuration, e.g. pipelining
G06T 19/006
Manipulating three-dimensional [3D] models or images for computer graphics: mixed reality
G09G 5/363
Characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory: graphics controllers

Family

Application62/297,394Us provisional application · filed 19 Feb 2016

Application15/094,336Continuation · filed 8 Apr 2016

Application16/391,486Continuation · filed 23 Apr 2019

Application16/868,974Continuation · filed 7 May 2020

Application17/315,995Continuation

US 10,334,224 B2Related patent

US 10,715,786 B2Related patent

US 10,904,511 B2Related patent

US 11,050,996 B2Related patent

US 11,375,172 B2Related patent

US 2017/0244951 A1Published application