Back to results
US 10,834,392 B2Granted
Method of sensor-assisted rate control
AssigneeSz Dji Technology Co., Ltd.
InventorYannan Wu
Life of this patent
Estimating the term…
Abstract
Methods and systems of determining a quantization step for encoding video based on motion data are provided. Video captured by an image capture device is received. The video comprises a video frame component. Additionally, motion data associated with the video frame component is received. Further, a quantization step for encoding the video frame component is determined based on the motion data.
Claims17
A method of determining a quantization step for encoding video based on sensor data, said method comprising:
- receiving video captured by an image capture device configured on an unmanned aerial vehicle (UAV), the video comprising a video frame component;
- receiving sensor data obtained from one or more sensors configured off-board a gimbal configured on the UAV, the gimbal carrying the image capturing device, the sensor data indicating a degree of movement in motion associated with the video frame component;
- allocating bits to at least one portion of the video frame component based on the sensor data received from the one or more sensors configured off-board the UAV, including:
- in response to the sensor data indicating a first degree of movement, allocating a first amount of bits to the at least one portion of the video frame component;
- and
- in response to the sensor data indicating a second degree of movement, allocating a second amount of bits to the at least one portion of the video frame component, the second amount being more than the first amount, and the second degree being higher than the first degree;
- and
- determining a quantization step for encoding the video frame component according to the degree of movement indicated by the sensor data from the one or more sensors configured off-board the gimbal;
- wherein:
- the video frame component is a first video frame, and the video further includes a second video frame component;
- and
- the method further includes:
- choosing a first quantization step for encoding the first video frame when the first video frame has the degree of movement that exceeds a first threshold degree of movement, and choosing a second quantization step for encoding the second video frame when the second video frame has the degree of movement that falls below a second threshold degree of movement.
10 more elements
A non-transitory computer readable medium containing program instructions for determining a quantization step for encoding video based on sensor data, said computer readable medium comprising:
- program instructions for receiving video captured by an image capture device configured on an unmanned aerial vehicle (UAV), the video comprising a video frame component;
- program instructions for receiving sensor data obtained from one or more sensors configured off-board the UAV, the sensor data indicating a degree of movement in motion associated with the video frame component;
- program instructions for allocating bits to at least one portion of the video frame component based on the sensor data received from the one or more sensors configured off-board a gimbal configured on the UAV and carrying the image capture device, including:
- in response to the sensor data indicating a first degree of movement, allocating a first amount of bits to the at least one portion of the video frame component;
- and
- in response to the sensor data indicating a second degree of movement, allocating a second amount of bits to the at least one portion of the video frame component, the second amount being more than the first amount, and the second degree being higher than the first degree;
- and
- program instructions for determining a quantization step for encoding the video frame component according to the degree of movement indicated by the sensor data from the one or more sensors configured off-board the gimbal the UAV;
- wherein:
- the video frame component is a first video frame, and the video further includes a second video frame component;
- and
- the computer readable medium further comprises program instructions for:
- choosing a first quantization step for encoding the first video frame when the first video frame has the degree of movement that exceeds a first threshold degree of movement, and choosing a second quantization step for encoding the second video frame when the second video frame has the degree of movement that falls below a second threshold degree of movement.
10 more elements
A system for determining a quantization step for encoding video based on sensor data, said system comprising:
- an image capture device configured on an unmanned aerial vehicle (UAV), the image capture device configured to capture a video;
- and
- one or more processors, individually or collectively configured to:
- receive the video captured by the image capture device, the video comprising a video frame component;
- receive sensor data obtained from one or more sensors configured off-board a gimbal configured the UAV and carrying the image capture device, the sensor data indicating a degree of movement in motion associated with the video frame component;
- allocate bits to at least one portion of the video frame component based on sensor data received from the one or more sensors configured off-board the UAV, including:
- in response to the sensor data indicating a first degree of movement, allocating a first amount of bits to the at least one portion of the video frame component;
- and
- in response to the sensor data indicating a second degree of movement, allocating a second amount of bits to the at least one portion of the video frame component, the second amount being more than the first amount, and the second degree being higher than the first degree;
- and
- determine a quantization step for encoding the video frame component according to the degree of movement indicated by the sensor data from the one or more sensors configured off-board the gimbal;
- wherein:
- the video frame component is a first video frame, and the video further includes a second video frame component;
- and
- the processors are further configured to:
- choose a first quantization step for encoding the first video frame when the first video frame has the degree of movement that exceeds a first threshold degree of movement, and choose a second quantization step for encoding the second video frame when the second video frame has the degree of movement that falls below a second threshold degree of movement.
13 more elements
Dependencies are inferred from the claim text.