Method and apparatus for detecting target in video, computing device, and storage medium
AssigneeTencent Technology (Shenzhen) Company Limited
InventorZequn Jie
Life of this patent
Estimating the term…
Abstract
This application discloses a method for detecting a target in a video, performed by a computing device. The method includes applying a target detection operation to a first frame in the video, to determine a first target detection result of the target in the first frame; applying a target tracking operation to a second frame after the first frame in the video, to determine changes of the target between the first frame and the second frame; and determining a second target detection result of the target in the second frame according to the first target detection result and the changes of the target between the first frame and the second frame.
Claims19
A method for detecting a target in a video, performed by a computing device, the method comprising:
- applying a target detection operation to a first frame in the video, to determine a first target detection result of the target in the first frame;
- applying a target tracking operation to a second frame after the first frame in the video, to determine changes of the target between the first frame and the second frame, comprising:
- extracting semantic information of a combination of the first frame and the second frame by using a first neural network;
- outputting, by the first neural network according to the extracted semantic information, at least two output sets indicating changes of candidate targets belonging to at least two preset size intervals between the first frame and the second frame, wherein different output sets correspond to candidate targets belonging to different preset size intervals;
- and
- selecting, from the at least two output sets, an output set corresponding to a preset size interval that matches a size of the target, to determine the changes of the target corresponding to the first target detection result and between the first frame and the second frame;
- and
- determining a second target detection result of the target in the second frame according to the first target detection result and the changes of the target between the first frame and the second frame.
An apparatus for detecting a target in a video, comprising at least one memory and at least one processor, the at least one memory storing instructions, and the instructions, when executed by the at least one processor, causing the at least one processor to:
- apply a target detection operation to a first frame in the video, to determine a first target detection result of the target in the first frame;
- apply a target tracking operation to a second frame after the first frame in the video, to determine changes of the target between the first frame and the second frame, comprising:
- extracting semantic information of a combination of the first frame and the second frame by using a first neural network;
- outputting, by the first neural network according to the extracted semantic information, at least two output sets indicating changes of candidate targets belonging to at least two preset size intervals between the first frame and the second frame, wherein different output sets correspond to candidate targets belonging to different preset size intervals;
- and
- selecting, from the at least two output sets, an output set corresponding to a preset size interval that matches a size of the target, to determine the changes of the target corresponding to the first target detection result and between the first frame and the second frame;
- and
- determine a second target detection result of the target in the second frame according to the first target detection result and the changes of the target between the first frame and the second frame.
A non-transitory computer-readable storage medium, storing instructions, the instructions, when executed by at least one processor, causing the at least one processor to perform:
- applying a target detection operation to a first frame in the video, to determine a first target detection result of the target in the first frame;
- applying a target tracking operation to a second frame after the first frame in the video, to determine changes of the target between the first frame and the second frame, comprising:
- extracting semantic information of a combination of the first frame and the second frame by using a first neural network;
- outputting, by the first neural network according to the extracted semantic information, at least two output sets indicating changes of candidate targets belonging to at least two preset size intervals between the first frame and the second frame, wherein different output sets correspond to candidate targets belonging to different preset size intervals;
- and
- selecting, from the at least two output sets, an output set corresponding to a preset size interval that matches a size of the target, to determine the changes of the target corresponding to the first target detection result and between the first frame and the second frame;
- and
- determining a second target detection result of the target in the second frame according to the first target detection result and the changes of the target between the first frame and the second frame.
Dependencies are inferred from the claim text.