Methods and apparatus for real-time guided encoding
AssigneeGoPro, Inc.
InventorsVincent Vacquerie, Alexis Lefebvre
Life of this patent
Estimating the term…
Abstract
Systems, apparatus, and methods for real-time guided encoding. In one exemplary embodiment, an image processing pipeline (IPP) is implemented within a system-on-a-chip (SoC) that includes multiple stages, ending with a codec. The codec compresses video obtained from the previous stages into a bitstream for storage within removable media (e.g., an SD card), or transport (over e.g., Wi-Fi, Ethernet, or similar network). While most hardware implementations of real-time encoding allocate bit rate based on a limited look-forward (or look-backward) of the data in the current pipeline stage, the exemplary IPP leverages real-time guidance that was collected during the previous stages of the pipeline.
Claims18
An encoding device, comprising:
- a camera configured to capture at least a first image and a second image;
- an image processing pipeline comprising:
- a first processing element and an encoding element;
- a first non-transitory computer-readable medium comprising a first set of instructions that, when executed by the first processing element, causes the first processing element to:
- perform a first correction to the first image to generate a corrected first image, where the first correction to the first image is based on the second image;
- and
- determine a first encoding parameter based on the first correction;
- and
- a second non-transitory computer-readable medium comprising a second set of instructions that, when executed by the encoding element, causes the encoding element to generate encoded media based on the corrected first image and the first encoding parameter.
A method for guiding an encoder in real-time, comprising:
- receiving a first image and a second image captured by a camera device;
- performing a first correction to the first image to generate a corrected first image, where the first correction to the first image is based on the second image;
- providing data associated with the first correction that causes a processing element to determine a first encoding parameter;
- and
- providing the corrected first image to an encoding element to enable generation of encoded media based on the corrected first image and the first encoding parameter.
An encoding device, comprising:
- a camera configured to capture at least a first image and a second image;
- an image processing pipeline comprising:
- a first processing element and an encoding element;
- a second processing element;
- a first non-transitory computer-readable medium comprising a first set of instructions that, when executed by the first processing element, causes the first processing element to perform a first correction to the first image to generate a corrected first image, where the first correction to the first image is based on the second image;
- a second non-transitory computer-readable medium comprising a second set of instructions that, when executed by the second processing element, causes the encoding device to determine a first encoding parameter based on the first correction;
- and
- a third non-transitory computer-readable medium comprising a third set of instructions that, when executed by the encoding element, causes the encoding element to generate encoded media based on the corrected first image and the first encoding parameter.
Dependencies are inferred from the claim text.