US 10,102,423 B2 · Object modeling and replacement in a video stream

Abstract

Systems, devices, and methods are presented for segmenting an image of a video stream with a client device by receiving one or more images depicting an object of interest and determining pixels within the one or more images corresponding to the object of interest. The systems, devices, and methods identify a position of a portion of the object of interest and determine a direction for the portion of the object of interest. Based on the direction of the portion of the object of interest, a histogram threshold is dynamically modified for identifying pixels as corresponding to the portion of the object of interest. The portion of the object of interest is replaced with a graphical interface element aligned with the direction of the portion of the object of interest.

Claims20

Dependent claims

A method, comprising:

receiving, by one or more processors, one or more images depicting at least a portion of a hand;
determining pixels within the one or more images corresponding to the portion of the hand in a predetermined portion of a field of view of an image capture device, the portion of the hand having a finger;
based on the pixels corresponding to the portion of the hand, identifying a finger position of the finger;
determining a direction of the finger based on the finger position;
based on the direction of the finger, dynamically modifying a histogram threshold for identifying pixels as corresponding to the portion of the hand;
and
replacing the portion of the hand and the finger with a graphical interface element aligned with the direction of the finger.

4 more elements

A system, comprising:

one or more processors;
and
a processor-readable storage device storing processor-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, by the one or more processors, one or more images depicting at least a portion of a hand;
determining pixels within the one or more images corresponding to the portion of the hand in a predetermined portion of a field of view of an image capture device, the portion of the hand having a finger;
based on the pixels corresponding to the portion of the hand, identifying a finger position of the finger;
determining a direction of the finger based on the finger position;
based on the direction of the finger, dynamically modifying a histogram threshold for identifying pixels as corresponding to the portion of the hand;
and
replacing the portion of the hand and the finger with a graphical interface element aligned with the direction of the finger.

7 more elements

A non-transitory processor-readable storage device storing processor-executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

receiving one or more images depicting at least a portion of a hand;
determining pixels within the one or more images corresponding to the portion of the hand in a predetermined portion of a field of view of an image capture device, the portion of the hand having a finger;
based on the pixels corresponding to the portion of the hand, identifying a finger position of the finger;
determining a direction of the finger based on the finger position;
based on the direction of the finger, dynamically modifying a histogram threshold for identifying pixels as corresponding to the portion of the hand;
and
replacing the portion of the hand and the finger with a graphical interface element aligned with the direction of the finger.

4 more elements

Dependencies are inferred from the claim text.

Object modeling and replacement in a video stream

Life of this patent

Object modeling and replacement in a video stream

Life of this patent

Abstract

Claims20