# US 10,121,178 B2 · Three-dimensional eyeglasses modeling from two-dimensional images

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,121,178 B2
- Document ID: US10121178B2
- Status: Granted
- Kind: B2
- Application number: 14/738,861
- Filed: 2015-06-13
- Published: 2015-12-17
- Granted: 2018-11-06
- Earliest claimed: 2014-06-13
- Assignees: eBay Inc.
- Applicants: Ebay Inc.
- Inventors: Itay Adler; Dan Sincai
- Web page: https://patentgrep.com/patent/US10121178B2

## CPC

- G06Q 30/0621: {by configuring or customising goods or services}
- G06T 7/13: Edge detection
- G06T 7/40: Analysis of texture (depth or shape recovery from texture G06T7/529)
- G06T 7/55: from multiple images
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06T 2210/16: Cloth
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

There are provided systems and method for three-dimensional (3D) eyeglasses modeling from two-dimensional (2D) images. A service provider, such as a payment provider, may access 2D images of a pair of eyeglasses, such as images from a front perspective and a side perspective of the eyeglasses. The contours of the eyeglasses may be extracted, such as the contours of the main features (e.g., the bridge, lens aperture, side and ear frame sections, and other important features). The contours may be processed to determine a curve that best fits the features. Additional features may be extracted, such as color, design, writing (e.g., a brand name on the frame), hinges, or other sub-feature of the frame. Utilizing this information, a 3D model of the pair of eyeglasses may be constructed by scaling the size of the lens curves, bridge, and/or arms and applying a texture.

## Claims

### Claim 1

A system, comprising:
at least one processor; and
a memory coupled to the at least one processor and storing instructions that, when executed by the at least one processor, perform a method, comprising:
accessing at least two two-dimensional (2D) images of a pair of eyeglasses;
extracting a first contour of the pair of eyeglasses from a first image of the at least two 2D images and a second contour of the pair of eyeglasses from a second image of the at least two 2D images, wherein the first contour and the second contour define shape features of the pair of eyeglasses;
determining, based at least in part, on a meeting place between the first contour and the second contour, locations for hinges of the pair of eyeglasses;
determining, using at least one of the two 2D images, one or more visual features of the pair of eyeglasses;
generating a three-dimensional (3D) model of the pair of eyeglasses using the first contour, the second contour, the visual features, the shape features and the determined location of the hinges, the 3D model including one or more arms extending from the determined location of the hinges; and
providing the generated 3D model of the pair of eyeglasses on a user interface of a display device.

### Claim 2 (depends on 1)

The system of claim 1, wherein the contours are extracted using Canny edge detection.

### Claim 3 (depends on 1)

The system of claim 1, further comprising instructions for:
creating a texture file using the determined visual features of the pair of eyeglasses; and
using the texture file in the 3D model.

### Claim 4 (depends on 3)

The system of claim 3, wherein the texture file includes additional information of the pair of eyeglasses.

### Claim 5 (depends on 4)

The system of claim 4, wherein the additional information comprises at least one of a material of the pair of eyeglasses, brand information of the pair of eyeglasses, weight of the pair of eyeglasses, and lens information for the pair of eyeglasses.

### Claim 6 (depends on 1)

The system of claim 1, wherein the visual features comprises one or more of color, surface quality, surface properties, logos, shading, and lens.

### Claim 7 (depends on 1)

The system of claim 1, wherein first contour at least one of the first contour and the second contour define curves of a lenses frame.

### Claim 8 (depends on 1)

The system of claim 1, further comprising instructions for generating at least one of a front and lenses of the pair of eyeglasses using at least one of the first contour and the second contour.

### Claim 9 (depends on 1)

The system of claim 1, further comprising instructions for cleaning up at least one of the first contour and the second contour to extract a best curve.

### Claim 10

A method, comprising:
receiving, at least two two-dimensional (2D) images of a pair of eyeglasses, wherein the pair of eyeglasses is offered for sale by a merchant;
extracting a first set of contours of the pair of eyeglasses from a first image of the at least two 2D images and a second set of contours of the pair of eyeglasses from a second image of the at least two 2D images, wherein the first set of contours and the second set of contours define a plurality of shape features of the pair of eyeglasses;
determining, based at least in part, on a meeting place between the first set of contours and the second set of contours, locations for hinges of the pair of eyeglasses using the contours;
determining, using at least one of the two 2D images, one or more visual features of the pair of eyeglasses;
generating a three-dimensional (3D) model of the pair of eyeglasses using the first set of contours, the second set of contours, the visual features and the determined location of the hinges, the 3D model including one or more arms extending from the determined location of the hinges;
automatically altering one or more of a size of the one or more arms and adjusting an angle of the one or more arms; and
communicating the 3D model to the merchant for display.

### Claim 11 (depends on 10)

The method of claim 10, wherein the shape features comprise one or more of a frame of the pair of eyeglasses and a front of the pair of eyeglasses.

### Claim 12 (depends on 11)

The method of claim 11, further comprising superimposing the 3D model of the pair of eyeglasses on an image.

### Claim 13 (depends on 10)

The method of claim 10, wherein the one or more arms of the 3D model are configured to fit at least a portion of an individual in an image.

### Claim 14 (depends on 10)

The method of claim 10, wherein at least one of the first set of contours and the second set of contours are extracted using Canny edge detection.

### Claim 15 (depends on 10)

The method of claim 10, wherein a location of the hinges may be adjusted based, at least in part, on received input.

### Claim 16 (depends on 10)

The method of claim 10, further comprising determining a nose bridge feature of the pair of eyeglasses using the first set of contours and the second set of contours.

### Claim 17

A non-transitory computer-readable storage medium comprising instructions that, when executed by a processing unit, cause the computer system to perform a method, comprising:
receiving a selection of at least two two-dimensional (2D) images of a pair of eyeglasses displayed on a computing device;
extracting a first set of contours of the pair of eyeglasses from a first image of the at least two 2D images and a second set of contours of the pair of eyeglasses from a second image of the at least two 2D images;
determining locations for the hinges of the pair of eyeglasses using a meeting place between the first set of contours and the second set of contours;
determining parameters of a nose bridge features of the pair of eyeglasses using the first set of contours and the second set of contours;
determining parameters of one or more arms for the pair of eyeglasses using one or more of the first set of contours and the second set of contours;
generating a three-dimensional (3D) model of the pair of eyeglasses using the first set of contours, the second set of contours, the one or more arms and the nose bridge feature; and
providing the generated 3D model of the pair of eyeglasses on a user interface of a display device.

### Claim 18 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, further comprising instructions for providing the 3D model on an image on the user interface of the display device.

### Claim 19 (depends on 17)

The non-transitory computer-readable storage medium of claim 17, further comprising automatically adjusting one or more of the parameters of the one or more arms.

### Claim 20 (depends on 1)

The system of claim 1, further comprising instructions for automatically adjusting an angle of the one or more arms as the one or more arms extend from the determined location of the hinges.
