Eyelid shape estimation using eye pose measurement
AssigneeMagic Leap, Inc.
InventorAdrian Kaehler
Life of this patent
Estimating the term…
Abstract
Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).
Claims18
A method for estimating an eyelid shape mapping model, the method comprising:
- under control of a hardware processor:
- collecting a set of eye images of an eye;
- and
- using the set of eye images to determine an eyelid shape mapping model that specifies a relationship between an eye pose of the eye and an eyelid shape of the eye,
- wherein the eyelid shape mapping model comprises a mapping matrix that associates an eye pose coordinate system with an eyelid shape coordinate system,
- wherein the eyelid shape is described by a set of eyelid shape parameters that specify a functional form for an eyelid boundary at an eyelid that is an upper eyelid of the eye or a lower eyelid of the eye,
- wherein applying the mapping matrix to eye pose parameters in the eye pose coordinate system provides a functional decomposition of each eye pose parameter of the set of eyelid shape parameters expressed as a respective function of the eye pose parameters,
- and wherein the set of eyelid shape parameters include a horizontal shift, a vertical shift, and a curvature of the eyelid.
A method for estimating an eyelid shape from an eye pose, the method comprising:
- under control of a hardware processor:
- determining, as a determined eye pose, an eye pose of an eye in an eye image;
- and
- estimating an eyelid shape of an eyelid of the eye based at least partly on the eye pose, including applying an eyelid shape mapping model to the determined eye pose,
- wherein the eyelid shape mapping model comprises a mapping matrix that associates an eye pose coordinate system with an eyelid shape coordinate system,
- wherein the eyelid shape mapping model specifies a relationship between the eye pose of the eye and the eyelid shape of the eye, and
- wherein the eyelid shape is described by a set of eyelid shape parameters that specify a functional form for an eyelid boundary of the eyelid,
- wherein applying the mapping matrix to eye pose parameters in the eye pose coordinate system provides a functional decomposition of each eyelid shape parameter of the set of eyelid shape parameters expressed as a respective function of the eye pose parameters,
- and wherein the set of eyelid shape parameters include a horizontal shift, a vertical shift, and a curvature of the eyelid.
Dependencies are inferred from the claim text.