Patch expansion for segmentation network training
AssigneeMatterport, Inc.
InventorsGary Bradski, Prasanna Krishnasamy, Mona Fathollahi, Michael Tetelman
Life of this patent
Estimating the term…
Abstract
Systems and methods for frame and scene segmentation are disclosed herein. One method includes associating a first primary element from a first frame with a background tag, associating a second primary element from the first frame with a subject tag, generating a background texture using the first primary element, generating a foreground texture using the second primary element, and combining the background texture and the foreground texture into a synthesized frame. The method also includes training a segmentation network using the background tag, the foreground tag, and the synthesized frame.
Claims30
A computer-implemented method comprising:
- associating a first primary element from a scene with a background tag;
- associating a second primary element from the scene with a subject tag;
- generating a background texture using the first primary element, wherein the generating the background texture includes:
- defining a first patch of the scene, wherein the patch includes the first primary element;
- and
- expand the first patch to a larger dimension, wherein the larger dimension is larger than an input size of a segmentation network;
- generating a subject texture using the second primary element;
- combining the background texture and the subject texture into a synthesized frame;
- and
- training a segmentation network using the background tag, the subject tag, and the synthesized frame.
A computer-implemented method comprising:
- associating a first primary element from a first frame in a scene with a background tag;
- associating a second primary element from the first frame with a subject tag;
- generating a background texture using the first primary element, the generating of the background texture includes:
- defining a first patch from the first frame, wherein the first patch includes the first primary element;
- and
- expanding the first patch to a larger dimension, wherein the larger dimension is larger than an input size for a segmentation network;
- generating a foreground texture using the second primary element;
- combining the background texture and the foreground texture into a synthesized frame;
- and
- training a segmentation network using the background tag, the subject tag, and the synthesized frame.
A computer-implemented method comprising:
- associating a first primary element from a first frame in a scene with a background;
- associating a second primary element from the first frame with a subject;
- generating a background texture using the first primary element, wherein the generating the background texture includes:
- defining a first patch of the first frame, wherein the patch includes the first primary element;
- and
- expand the first patch to a larger dimension, wherein the larger dimension is larger than an input size of a segmentation network;
- generating a foreground texture using the second primary element;
- combining, in a synthesized frame, the background texture and the foreground texture;
- and
- training a segmentation network using the synthesized frame.
Dependencies are inferred from the claim text.