Object segmentation method and apparatus, and electronic device
OwnerWenhua HANinventor
Life of this patent
Estimating the term…
Abstract
An object segmentation method includes: generating and inputting a frame to be identified, a previous frame of the frame to be identified and a reference frame based on a video to be identified into an encoding network to generate a feature map of the frame to be identified, a target object feature map of the reference frame and a target object feature map of the previous frame; generating a first correlation matrix and a second correlation matrix; generating a first correlation feature map and a second correlation feature map; and generating an object segmentation image corresponding to a current frame based on the feature map of the frame to be identified.
Claims22
An object segmentation method, comprising:
- generating a frame to be identified, a previous frame of the frame to be identified and a reference frame based on a video to be identified, wherein the reference frame is a first frame of the video to be identified;
- generating a feature map of the frame to be identified, a target object feature map of the reference frame and a target object feature map of the previous frame by inputting the frame to be identified, the previous frame and the reference frame into an encoding network;
- generating a first correlation matrix and a second correlation matrix based on the feature map of the frame to be identified, the target object feature map of the reference frame and the target object feature map of the previous frame;
- generating a first correlation feature map and a second correlation feature map based on the first correlation matrix, the second correlation matrix, the target object feature map of the reference frame and the target object feature map of the previous frame;
- and
- generating an object segmentation image corresponding to a current frame based on the first correlation feature map, the second correlation feature map and the feature map of the frame to be identified.
9-16. (canceled)
An electronic device, comprising:
- at least one processor;
- and
- a memory communicatively coupled to the at least one processor;
- wherein,
- the memory stores instructions executable by the at least one processor, when the instructions are executed by the at least one processor, the at least one processor is configured to:
- generate a frame to be identified, a previous frame of the frame to be identified and a reference frame based on a video to be identified, wherein the reference frame is a first frame of the video to be identified;
- generate a feature map of the frame to be identified, a target object feature map of the reference frame and a target object feature map of the previous frame by inputting the frame to be identified, the previous frame and the reference frame into an encoding network;
- generate a first correlation matrix and a second correlation matrix based on the feature map of the frame to be identified, the target object feature map of the reference frame and the target object feature map of the previous frame;
- generate a first correlation feature map and a second correlation feature map based on the first correlation matrix, the second correlation matrix, the target object feature map of the reference frame and the target object feature map of the previous frame;
- and
- generate an object segmentation image corresponding to a current frame based on the first correlation feature map, the second correlation feature map and the feature map of the frame to be identified.
A non-transitory computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions are configured to cause a computer to execute an object segmentation method, the method comprising:
- generating a frame to be identified, a previous frame of the frame to be identified and a reference frame based on a video to be identified, wherein the reference frame is a first frame of the video to be identified;
- generating a feature map of the frame to be identified, a target object feature map of the reference frame and a target object feature map of the previous frame by inputting the frame to be identified, the previous frame and the reference frame into an encoding network;
- generating a first correlation matrix and a second correlation matrix based on the feature map of the frame to be identified, the target object feature map of the reference frame and the target object feature map of the previous frame;
- generating a first correlation feature map and a second correlation feature map based on the first correlation matrix, the second correlation matrix, the target object feature map of the reference frame and the target object feature map of the previous frame;
- and
- generating an object segmentation image corresponding to a current frame based on the first correlation feature map, the second correlation feature map and the feature map of the frame to be identified.
(canceled)
Dependencies are inferred from the claim text.