Optical method and apparatus for determining three-dimensional changes in facial contours

A method of optically mapping a three-dimensional surface, comprising the steps of:

• a) illuminating the surface through a grid structure to produce a grid representation on the surface, said grid representation having intersection points;
• b) viewing the illuminated surface with a video camera;
• c) producing a video signal in response to said step of viewing;
• d) converting said video signal to digital form;
• e) storing a frame of said digitized video signal in a frame memory;
• f) defining the grid representation on the surface, from said stored video signal, said step of defining including the steps of:
• (i) constructing an imaginary box of m x n pixels around substantially each pixel of said stored video signal;
• (ii) determining the value of light intensity of each pixel in each said imaginary box;
• (iii) averaging the values of light intensity in each said imaginary box to produce a local median intensity value for each box;
• and
• (iv) subtracting the local median intensity value in each body from the pixel about which the body was constructed, to thereby define the grid representation on the surface, from the stored video signal;
• (g) locating coordinates of said intersection points of said grid representation;
• (h) determining curvatures of said grid representation at said located intersection points;
• and
• (i) three-dimensionally reconstructing the surface from said coordinates and curvatures of said intersection points.

A method of optically mapping a three-dimensional surface, comprising the steps of:

• (a) illuminating the surface through a grid structure to produce a grid representation on the surface, said grid representation having intersection points;
• (b) viewing the illuminated surface with a video camera;
• (c) producing a video signal in response to said step of viewing;
• (d) storing a frame of said digitized video signal in a frame memory;
• (f) defining the grid representation on the surface, from said stored video signal;
• (g) locating coordinates of said intersection points of said grid representation, said step of locating coordinates of said intersection points of said grid representation, including the steps of:
• (i) constructing an imaginary box of m x n pixels around substantially each pixel of said grid representation;
• (ii) determining values for each pixel in said imaginary box;
• (iii) defining a pattern of values for an imaginary box of m x n pixels situated around an intersection point;
• (iv) comparing values of the pixels in said constructed imaginary box with the values of the pixels in said defined pattern to determine which pixels are intersection points;
• and
• (v) assigning coordinates to said pixels determined to be intersection points of said grid representation;
• (h) determining curvatures of said grid representation at said located intersection points;
• and
• (i) three-dimensionally reconstructing the surface from said coordinates and curvatures of said intersection points.

A method of optically mapping a three-dimensional surface, comprising the steps of:

• (a) illuminating the surface through a grid structure to produce a grid representation on the surface, said grid representation having intersection points;
• (b) viewing the illuminated surface with a video camera;
• (c) producing a video signal in response to said step of viewing;
• (d) converting said video signal to digital form;
• (e) storing a frame of said digitized video signal in a frame memory;
• (f) defining the grid representation on the surface, from said stored video signal;
• (g) locating coordinates of said intersection points of said grid representation;
• (h) determining curvatures of said grid representation at said located intersection points, said step of determining curvatures of said grid representation of said located intersection points, including the steps of:
• (i) constructing an imaginary box of m x n pixels around each located intersection point of said grid representation;
• and
• (ii) determining the curvatures of each said intersection point from the pixels of said grid representation in the respective imaginary box of m x n pixels by numerically approximately second derivaturs at said intersection point;
• and
• (i) three-dimensionally reconstructing the surface from said coordinates and curvatures of said intersection points.

Apparatus for optically mapping a three-dimensional surface, comprising:

• (a) a grid structure;
• (b) illumination means for illuminating the surface through the grid structure to produce a grid representation on the surface, said grid representation having intersection points;
• video camera means for viewing the illuminated surface sand for producing a video signal in response thereto;
• (d) analog-to-digital converting means for converting said video signal to digital form;
• (e) memory means for storing a frame of said digitized video signal in a frame memory;
• and
• (f) central processing means for
• (i) defining the grid representation on the surface, from said stored video signal,
• (ii) locating coordinates of said intersection points of said grid representation,
• (iii) determining curvatures of said grid representation at said located intersection points, and
• (iv) three-three-dimensionally reconstructing the surface from said coordinates and curvatures of said intersection points.