US 12,593,084 B2Granted

Video streaming system and video streaming method

AssigneeVarjo Technologies Oy

InventorsMikko Strandborg, Mikko Ollila

Life of this patent

Estimating the term…

Loading patent…

Abstract

Disclosed is a video streaming system with server(s) and client device(s) that are communicably coupled. The server(s) is configured to: receive HDR video content comprising HDR images; analyse dynamic range and colour characteristics; receive, from client device(s), first metadata indicative of viewing conditions of HDR video content; adjust HDR mastering parameters, based on first metadata and analysis; perform HDR mastering and compress HDR images; send to client device, compressed HDR images and second metadata indicative of adjusted HDR mastering parameters. The client device(s) is configured to receive compressed HDR images and second metadata; decompress compressed HDR images; translate pixel values in decompressed images based on second metadata; receive real-world images from camera(s); compose XR images using decompressed HDR images and real-world images; send to server, first metadata for next HDR video content; and display XR images on display(s) of client device.

Claims13

Dependent claims

A video streaming system comprising:

at least one server;
and
at least one client device that is communicably coupled to the at least one server via a communication interface,
wherein the at least one server is configured to:
receive high dynamic range (HDR) video content comprising a plurality of HDR images;
analyse a dynamic range and colour characteristics of each HDR image amongst the plurality of HDR images;
receive, from the at least one client device, first metadata indicative of viewing conditions of the HDR video content;
adjust HDR mastering parameters for each HDR image, based at least on the dynamic range and the colour characteristics of said HDR image, and on the first metadata;
perform HDR mastering for the plurality of HDR images according to the adjusted HDR mastering parameters, and compress the plurality of HDR images to obtain a plurality of compressed HDR images;
send, to the at least one client device, the plurality of compressed HDR images and second metadata indicative of the adjusted HDR mastering parameters for each compressed HDR image;
and wherein the at least one client device is configured to:
receive, from the at least one server, the plurality of compressed HDR images and the second metadata;
decompress the plurality of compressed HDR images to obtain a plurality of decompressed HDR images;
translate, based on the second metadata, pixel values in the plurality of decompressed HDR images, into colour values that are to be used for displaying such that upon displaying, pixel luminosities would match luminosities in the dynamic range;
receive real-world images captured by at least one camera;
compose a plurality of extended reality (XR) images using at least the plurality of decompressed HDR images and the real-world images;
send, to the at least one server, at least the first metadata to be utilised for a next HDR video content that is to be streamed from the at least one server to the at least one client device;
and
display the plurality of XR images, on at least one display of the at least one client device;
wherein the at least one client device is further configured to:
generate image composition information comprising visibility characteristics of the plurality of decompressed HDR images in the plurality of XR images;
and
send, to the at least one server, the image composition information to be utilised for the next HDR video content,
and wherein the at least one server is further configured to:
receive, from the at least one client device, the image composition information;
and
adjust HDR mastering parameters for at least one next HDR image, based also on the visibility characteristics.

24 more elements

A video streaming method implemented by a video streaming system comprising at least one server and at least one client device that is communicably coupled to the at least one server via a communication interface, wherein the method comprises:

at the at least one server
receiving high dynamic range (HDR) video content comprising a plurality of HDR images;
analysing a dynamic range and colour characteristics of each HDR image amongst the plurality of HDR images;
receiving, from the at least one client device, first metadata indicative of viewing conditions of the HDR video content;
adjusting HDR mastering parameters for each HDR image, based at least on the dynamic range and the colour characteristics of said HDR image, and on the first metadata;
performing HDR mastering for the plurality of HDR images according to the adjusted HDR mastering parameters, and compressing the plurality of HDR images for obtaining a plurality of compressed HDR images;
and
sending, to the at least one client device, the plurality of compressed HDR images and second metadata indicative of the adjusted HDR mastering parameters for each compressed HDR image;
and
at the at least one client device
receiving, from the at least one server, the plurality of compressed HDR images and the second metadata;
decompressing the plurality of compressed HDR images for obtaining a plurality of decompressed HDR images;
translating, based on the second metadata, pixel values in the plurality of decompressed HDR images, into colour values that are to be used for displaying such that upon displaying, pixel luminosities would match luminosities in the dynamic range;
receiving real-world images captured by at least one camera (206);
composing a plurality of extended reality (XR) images using at least the plurality of decompressed HDR images and the real-world images;
sending, to the at least one server, at least the first metadata to be utilised for a next HDR video content that is to be streamed from the at least one server to the at least one client device;
and
displaying the plurality of XR images, on at least one display of the at least one client device;
wherein the method further comprises:
at the at least one client device
generating image composition information comprising visibility characteristics of the plurality of decompressed HDR images in the plurality of XR images;
and
sending, to the at least one server, the image composition information to be utilised for the next HDR video content;
and
at the at least one server
receiving, from the at least one client device, the image composition information;
and
adjusting HDR mastering parameters for at least one next HDR image, based also on the visibility characteristics.

25 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/641,519Filed 22 Apr 2024
Published: US 2025/0330662 A123 Oct 2025
Granted: 31 Mar 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification9 codes

H04N 21/2343
Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs: involving reformatting…
H04N 21/23418
Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs: involving operations for…
H04N 21/23614
Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL…:…
H04N 21/239
Processing of content or additional data; Elementary server operations; Server middleware: interfacing the upstream path of the transmission…