Method, device, and system for tracking an object in a sequence of video frames
AssigneeAxis AB
InventorsNiclas DANIELSSON, Xing DANIELSSON FAN
Life of this patent
Estimating the term…
Abstract
A method, device, and system track an object in a sequence of video frames by using a tracking filter. In the method, costs are assigned for associating each object detection in a received set of object detections to the tracked object. The cost assigned to an object detection is a measure of deviation between a motion associated with the object detection and both of a first motion of the object estimated by the tracking filter and a second motion of the object indicated by motion vectors from a video encoder which encodes the sequence of video frames.
Claims15
A method for tracking an object in a sequence of video frames, comprising:
- tracking an object in a sequence of video frames by using a tracking filter, wherein the tracking filter estimates a position and a first motion of the object in a current video frame,
- receiving motion vectors from a video encoder which encodes the sequence of video frames, wherein the motion vectors are indicative of a second motion of the object in the current video frame,
- receiving a set of object detections in a subsequent video frame in the sequence, wherein each object detection is associated with a motion that corresponds to a displacement between the estimated position of the object in the current video frame and a position of the object detection in the subsequent video frame,
- assigning, for each object detection, a cost for associating the object detection to the tracked object, wherein the cost includes a measure of deviation between the motion associated with the object detection and both of the first motion in the current video frame estimated by the tracking filter and the second motion in the current video frame indicated by the motion vectors,
- associating one of the object detections to the tracked object based on the costs assigned to the object detections, and
- using the tracking filter to estimate a position and a first motion of the object in the subsequent video frame based on the associated object detection.
A device for tracking an object in a sequence of video frames, comprising circuitry configured to:
- track an object in a sequence of video frames by using a tracking filter, wherein the tracking filter estimates a position and a first motion of the object in a current video frame,
- receive motion vectors from a video encoder which encodes the sequence of video frames, wherein the motion vectors are indicative of a second motion of the object in the current video frame,
- receive a set of object detections in a subsequent video frame in the sequence, wherein each object detection is associated with a motion that corresponds to a displacement between the estimated position of the object in the current video frame and a position of the object detection in the subsequent video frame,
- assign, for each object detection, a cost for associating the object detection to the tracked object, wherein the cost includes a measure of deviation between the motion associated with the object detection and both of the first motion in the current video frame estimated by the tracking filter and the second motion in the current video frame indicated by the motion vectors,
- associate one of the object detections to the object track based on the costs assigned to the object detections, and
- use the tracking filter to estimate a position and a first motion of the object in the subsequent video frame based on the associated object detection.
A non-transitory computer-readable medium comprising computer program code which, when executed by a device with processing capability, causes the device to carry out a method for tracking an object in a sequence of video frames, comprising:
- tracking an object in a sequence of video frames by using a tracking filter, wherein the tracking filter estimates a position and a first motion of the object in a current video frame,
- receiving motion vectors from a video encoder which encodes the sequence of video frames, wherein the motion vectors are indicative of a second motion of the object in the current video frame,
- receiving a set of object detections in a subsequent video frame in the sequence, wherein each object detection is associated with a motion that corresponds to a displacement between the estimated position of the object in the current video frame and a position of the object detection in the subsequent video frame,
- assigning, for each object detection, a cost for associating the object detection to the tracked object, wherein the cost includes a measure of deviation between the motion associated with the object detection and both of the first motion in the current video frame estimated by the tracking filter and the second motion in the current video frame indicated by the motion vectors,
- associating one of the object detections to the tracked object based on the costs assigned to the object detections, and
- using the tracking filter to estimate a position and a first motion of the object in the subsequent video frame based on the associated object detection.
Dependencies are inferred from the claim text.