Video compression at scene changes for low latency interactive experience
AssigneeAdeia Guides Inc.
InventorsTao Chen, Christopher Phillips
Life of this patent
Estimating the term…
Abstract
Methods and systems for video compression at scene changes provide an improved, low latency interactive experience in cloud computing environments. Exemplary use cases include all forms of cloud gaming including cloud-enabled interactive sporting events, e-sports, fantasy sports, gaming, and enhancements. Improvements in performance and experience are achieved with at least one of an extreme low latency rate controller, an extreme low latency rate controller method, frame partitioning at scene changes, preventive (relatively early) termination of encoding at scene changes, interactive signaling between a decoder and an encoder, or interactive signaling. Related apparatuses, devices, techniques, and articles are also described.
Claims20
A method for video compression, the method comprising:
- estimating, with a rate controller operatively connected with an encoder, a quantization parameter value of at least a portion of a picture of a variable bitrate input;
- determining an encoded picture size of the picture;
- determining a required bitrate based on the encoded picture size and a frame rate of the encoder;
- determining a capped variable bitrate of the variable bitrate input;
- comparing the required bitrate with the capped variable bitrate;
- based at least in part on determining that the required bitrate exceeds the capped variable bitrate, calculating an adjusted quantization parameter value equal to the quantization parameter value of the at least the portion of the picture plus an interval;
- based at least on determining that the adjusted quantization parameter value is less than or equal to a maximum quantization parameter value supported by the encoder, calculating a new quantization parameter value equal to a ratio multiplied by a sum of the adjusted quantization parameter value and the maximum quantization parameter value supported by the encoder;
- and
- encoding the picture using the new quantization parameter value.
A system for video compression, the system comprising:
- a rate controller operatively connected with an encoder, the rate controller configured to:
- estimate a quantization parameter value of at least a portion of a picture of a variable bitrate input;
- determine an encoded picture size of the picture;
- determine a required bitrate based on the encoded picture size and a frame rate of the encoder;
- determine a capped variable bitrate of the variable bitrate input;
- compare the required bitrate with the capped variable bitrate;
- based at least in part on determining that the required bitrate exceeds the capped variable bitrate, calculate an adjusted quantization parameter value equal to the quantization parameter value of the at least the portion of the picture plus an interval;
- based at least on determining that the adjusted quantization parameter value is less than or equal to a maximum quantization parameter value supported by the encoder, calculate a new quantization parameter value equal to a ratio multiplied by a sum of the adjusted quantization parameter value and the maximum quantization parameter value supported by the encoder;
- and
- encode the picture using the new quantization parameter value.
A non-transitory, computer-readable medium having non-transitory, computer-readable instructions encoded thereon for video compression with a rate controller operatively connected with an encoder, that, when executed:
- estimate, with the rate controller operatively connected with the encoder, a quantization parameter value of at least a portion of a picture of a variable bitrate input;
- determine an encoded picture size of the picture;
- determine a required bitrate based on the encoded picture size and a frame rate of the encoder;
- determine a capped variable bitrate of the variable bitrate input;
- compare the required bitrate with the capped variable bitrate;
- based at least in part on determining that the required bitrate exceeds the capped variable bitrate, calculate an adjusted quantization parameter value equal to the quantization parameter value of the at least the portion of the picture plus an interval;
- based at least on determining that the adjusted quantization parameter value is less than or equal to a maximum quantization parameter value supported by the encoder, calculate a new quantization parameter value equal to a ratio multiplied by a sum of the adjusted quantization parameter value and the maximum quantization parameter value supported by the encoder;
- and
- encode the picture using the new quantization parameter value.
Dependencies are inferred from the claim text.