# US 2015/0146169 A1 · Automatic pupillary distance measurement system and measuring method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2015/0146169 A1
- Document ID: US20150146169A1
- Status: Published application
- Kind: A1
- Application number: 14/553,991
- Filed: 2014-11-25
- Published: 2015-05-28
- Earliest claimed: 2013-11-26
- Assignees: ULSee Inc.
- Applicants: Ulsee Inc.
- Inventors: Zhou Ye; Sheng-Wen Jeng; Ying-Ko Lu; Shih Wei Liu
- Web page: https://patentgrep.com/patent/US20150146169A1

## CPC

- A61B 3/111: {for measuring interpupillary distance}
- A61B 3/0025: {characterised by electronic signal processing, e.g. eye models}
- A61B 3/0033: {characterised by user input arrangements}
- A61B 3/0083: {provided with means for patient positioning}
- A61B 3/14: Arrangements specially adapted for eye photography
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)

## Abstract

Method for automatically measuring pupillary distance includes extracting facial features of face image, a head current center indicator is shown/displayed based on facial feature extraction, elliptical frame and target center indicator are shown, a first distance between head current center indicator and target center indicator is calculated to see if below a threshold range, then allowing head current center indicator, elliptical frame and target center indicator to disappear. Card window based on facial tracking result is shown. Credit card band detection is performed to see if located within card window. Card window then disappear. Elliptical frame of moving head and target elliptical frame are shown. Elliptical frame of the moving head is aligned with the target elliptical frame and maintaining a correct head posture. If elliptical frame of moving head is aligned with target elliptical frame, then allow them to disappear from view, and performing a pupillary distance measurement.

## Claims

### Claim 1

An automatic pupillary distance (PD) measuring method using a camera and an user interface (UI), wherein the measuring method is performed using a processor of an electronic device, comprising:
notifying a user to move his head position to a center of a captured face image;
notifying the user to place a credit card inside a card window;
notifying the user to move his head forward or backward to fit within a target elliptical frame, thereby maintaining a correct head posture; and
obtaining a measurement of a pupil distance of the user.

### Claim 2 (depends on 1)

The automatic PD measuring method as claimed in claim 1, further comprising:
extracting a plurality of facial features of the captured face image of the user;
showing a head current center indicator based on the facial feature extraction results;
showing an elliptical frame and a target center indicator of the entire face image;
calculating a first distance between the head current center indicator and the target center indicator; and
allowing the head current center indicator and the elliptical frame and the target center indicator to disappear from view upon determining that the first distance is below a threshold range,.

### Claim 3 (depends on 2)

The automatic PD measuring method as claimed in claim 2, wherein allowing the head current center indicator and the elliptical frame and the target center indicator to remain in view and obtaining another captured face image upon determining that the first distance is not below a threshold range.

### Claim 4 (depends on 2)

The automatic PD measuring method as claimed in claim 2, wherein the card window is obtained based on a facial tracking result, and the method further comprising of performing a credit card band detection on the credit card and allowing the card window to disappear from view upon determining that the entire credit card is located within the card window.

### Claim 5 (depends on 4)

The automatic PD measuring method as claimed in claim 4, wherein if determining the entire credit card is not located within the card window, then allowing the card window to remain in view and obtaining another captured face image.

### Claim 6 (depends on 4)

The automatic PD measuring method as claimed in claim 4, further comprising:
showing an elliptical frame of a moving head of the user;
showing the target elliptical frame;
aligning the elliptical frame of the moving head thereof with the target elliptical frame by the user moving his or her head forward or backward to fit within the target elliptical frame; and
allowing the elliptical frame of the moving head and the target elliptical frame to disappear from view, respectively, upon determining that the elliptical frame of the moving head is aligned with the target elliptical frame.

### Claim 7 (depends on 6)

The automatic PD measuring method as claimed in claim 6, wherein allowing the elliptical frame of the moving head and the target elliptical frame to remain in view, and to obtaining another captured face image upon determining that the elliptical frame is not aligned with the target elliptical frame.

### Claim 8 (depends on 2)

The automatic PD measuring method as claimed in claim 2,
wherein the first distance between the head current center indicator and the target center indicator is expressed as an equation:
Ds=|Cc−Tc|,
wherein Ds represents the first distance, Cc represents the head current center indicator, and Tc represents the target center indicator (Tc).

### Claim 9

A method for automatically measuring pupillary distance, wherein the method is performed using a processor of an electronic device, comprising:
extracting a plurality of facial features of a face image of a user;
showing a head current center indicator, an elliptical frame and a target center indicator;
calculating a first distance between the head current center indicator and the target center indicator;
allowing the head current center indicator, the elliptical frame and the target center indicator to disappear from view upon determining that the first distance is below a threshold range;
showing a card window and performing a credit card band detection;
showing the elliptical frame of a moving head of the user and the target elliptical frame;
notifying the user to align the elliptical frame with the target elliptical frame and to maintain a correct head posture;
allowing the elliptical frame and the target elliptical frame to disappear from view upon determining that the elliptical frame is aligned with the target elliptical frame; and
performing a pupillary distance (PD) measurement.

### Claim 10 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, after the step of performing the credit card band detection, further comprising:
allowing the card window to disappear from view upon determining that the entire credit card is located within the card window.

### Claim 11 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, wherein the head current center indicator is displayed based on the facial feature extraction results.

### Claim 12 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, wherein the card window is displayed based on a facial tracking result.

### Claim 13 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, wherein the credit card band detection is performed by:
identifying a vertical position of the black band of the credit card;
extracting left and right edges of the black band;
saving as a current band; and
checking to see if the current band corner points are all located inside the card window.

### Claim 14 (depends on 13)

The method for automatically measuring pupillary distance of claim 13, wherein the vertical position of the black band of the credit card is identified near center to make a reversed gray vertical profile as a V-profile and taking a maximum width band beyond average gray (Avg) as a V-band, the near center of the V-band is to make an H-profile, and two maximum edges are extracted at the left and right sides of the H-profile as being a H-band.

### Claim 15 (depends on 14)

The method for automatically measuring pupillary distance of claim 14, wherein the target center indicator indicates a location of a target center, the target center and the target elliptical frame are obtained by:
determining a width and a height of the target elliptical frame;
determining the target center by checking to see if the head is within a measurable range to set the target center as an image center;
guiding the user to move his head forward or backward;
calculating a center difference (sy) between a facial tracking shape and the target elliptical frame in pixels, wherein a current facial tracking shape center is (curr_face_shape.cx, curr_face_shape.cy), where
Center.x=curr_face_shape.cx;
Center.y=curr_face_shape.cy−sy.

### Claim 16 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, wherein the head current center indicator (Cc) is expressed in (Ccx, Ccy), and calculated based on 66 facial tracking points:
Cc
x
=
Pt


1
x
+
Pt


2
x
+
…


Pt


66
x
66
Cc
y
=
Pt


1
y
+
Pt


2
y
+
…


Pt


66
y
66
wherein Pt1 to Pt66 represents each of the 66 facial tracking points.

### Claim 17 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, wherein a location of the card window with respect to the corresponding facial features is determined by:
calculating an inner distance (Di) between the left and right eye inner point and an outer distance (Do) between the left and right eye outer point;
determining the eye's maximum x-values (max_x) and minimum x_value (min_x) of coordinate points, the eye's maximum y-values (max_y) and minimum y_value (min_y) of coordinate points, respectively.
determining a location value of the card window by performing steps of:
calculating a card window width by a first equation:
card window width=Do+0.6*Di [1]
calculating a card window height by a second equation:
card window height=(max—y−min—y)+3.0*Di [2]
wherein a plurality of card window start coordinates, card.x and card.y, are expressed in a third and fourth equations, respectively:
card.x=p36.x−0.3*Di, [3]
card.y=p30.y+0.4*Di [4]
where the feature point p30 is at located at the nose tip of the user.

### Claim 18 (depends on 9)

The method for automatically measuring pupillary distance of claim 9, further comprising:
showing the PD measurement after extracting the pupils' locations based on eyes region captured by facial tracking, and scanning that eye region to find the place which has the largest reversed gray level, the pupil's location are (pl.x, pl.y) and (pr.x, pry) for the left pupil and the right pupil, respectively; an image length between pupils (plen) is defined as the distance between points pl and pr;
extracting edge features of two sides of the black band of the credit card based on curr_band's corner points to find (cl.x, cl.y) and (cr.x, cry) by finding the image length (clen) to be defined as the distance between points cl and cr;
calculating the papillary distance (PD) by setting a credit card standard width (cwidth) to be 85.6 mm, and defining an image resolution (Tres) in a fifth equation:
image resolution (Tres)=cwidth/clen (in units of mm/pixel) [5]
and defining pupillary distance (PD) in a sixth equation:
PD=plen×Ires [6]

### Claim 19

An automatic papillary distance (PD) measurement system, comprising:
an electronic device having a LCD display screen and a front-facing camera,
wherein the electronic device is configured to perform a papillary distance (PD) measurement using the front-facing camera and an user interface (UI), comprising the steps of:
obtaining a face image of the user from the front-facing camera and extracting a plurality of facial features of the face image of an user;
displaying a head current center indicator, an elliptical frame and a target center indicator of the entire face image of the user;
calculating a first distance between the head current center indicator and the target center indicator;
allowing the head current center indicator, the elliptical frame and the target center indicator to disappear from view, respectively upon determining that the first distance is below a threshold range;
displaying a card window and performing a credit card band detection, and allowing the card window to disappear from view upon determining that the entire credit card is located within the card window;
displaying the elliptical frame of a moving head of the user and the target elliptical frame, respectively;
notifying the user to align the elliptical frame with the target elliptical frame and maintaining a correct head posture;
allowing the elliptical frame and the target elliptical frame to disappear from view upon determining that the elliptical frame is aligned with the target elliptical frame; and
performing the papillary distance (PD) measurement.

### Claim 20 (depends on 19)

The automatic papillary distance (PD) measurement system of claim 19, wherein the papillary distance (PD) measurement is displayed; the head current center indicator is displayed based on the facial feature extraction results, the card window is displayed based on a facial tracking result; the electronic device is a stand-alone electronic kiosk, a mobile smartphone, a computer, a laptop, or a tablet PC.
