Back to results
US 11,636,796 B2Granted
Subject segmentation for motion control and textured display
AssigneeBlack Sesame Technologies Inc.
InventorsJizhang Shan, Tiecheng Wu, Fangwen Tu, Bo Li, Jin Xu
Life of this patent
Estimating the term…
Abstract
A method of motion control and textured display, comprising, receiving an image, extracting an initial mask of a subject of interest from the image, segmenting the image into the initial mask and a background, determining a color texture of the initial mask, estimating motion of the initial mask to a new mask and merging the new mask and the background into a merged image.
Claims3
A method of motion control and textured display, comprising:
- receiving an initial image;
- extracting an initial mask of a subject of interest from the initial image;
- segmenting the image into the initial mask and a background;
- determining a color texture of the initial mask;
- estimating motion of the initial mask to a new mask;
- merging the new mask and the background into a merged image;
- training the extraction of the initial mask based on a body loss and a component loss;
- at least one of rotating, translating and scaling the initial mask to the new mask;
- determining a minimum mean brightness difference between the initial mask and the new mask;
- determining a minimum mean color difference between the initial mask and the new mask;
- eroding the initial mask to an erosion mask;
- dilating the initial mask to a dilation mask;
- determining a background contour confidence based on the erosion mask and the dilation mask;
- determining a subject contour confidence based on the erosion mask and the dilation mask;
- determining a background color confidence based on the erosion mask and the dilation mask;
- determining a subject color confidence based on the erosion mask and the dilation mask;
- determining a background affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;
- determining a subject affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;
- and
- combining the background affinity and the subject affinity.
17 more elements
A method of motion control and textured display, comprising:
- receiving an in image;
- extracting an initial mask of a subject of interest from the initial image;
- eroding the initial mask to an erosion mask;
- dilating the initial mask to a dilation mask;
- determining a background contour confidence lased on the erosion mask and the dilation mask;
- determining a subject contour confidence based on the erosion mask and the dilation mask;
- determining a background color confidence based on the erosion mask and the dilation mask;
- determining a subject color confidence based on the erosion mask and the dilation mask;
- determining a background affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;
- determining a subject affinity based on the background contour confidence, the subject contour confidence, the background color confidence and the subject color confidence;
- and
- combining the background affinity and the subject affinity.
9 more elements
A method of motion control and textured display, comprising:
- receiving an initial image;
- extracting an initial mask of a subject of interest from the initial image;
- receiving a new image;
- determining an overlapping area of the initial image and the new image;
- determining an offset of the initial mask based on a minimum color difference and a minimum brightness difference within the overlapping area;
- applying the determined offset to the initial mask to form a new mask;
- and
- storing the new mask in a buffer.
5 more elements
Dependencies are inferred from the claim text.