# US 2016/0252346 A1 · Determining three-dimensional information from projections or placement of two-dimensional patterns

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0252346 A1
- Document ID: US20160252346A1
- Status: Published application
- Kind: A1
- Application number: 14/442,707
- Filed: 2015-05-12
- Published: 2016-09-01
- Earliest claimed: 2014-05-27
- Assignees: Bourbaki 13, Inc.
- Applicants: Bourbaki 13, Inc.
- Inventors: Robert Bismuth; William D. Orner; Jacob Rapoport; Amit Rohatgi
- Web page: https://patentgrep.com/patent/US20160252346A1

## CPC

- G01B 11/254: {Projection of a pattern, viewing through a pattern, e.g. moiré}
- A41H 1/02: Devices for taking measurements on the human body
- A41H 3/04: Making patterns by modelling on the human body
- A61B 5/1075: {for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer (A61B8/0858 takes precedence)}
- A61B 5/1077: {Measuring of profiles}
- A61B 5/1079: {using optical or photographic means}
- G01B 11/2513: {with several lines being projected in more than one direction, e.g. grids, patterns}
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/55: from multiple images
- H04N 23/63: by using electronic viewfinders
- H04N 23/64: {Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image}
- A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers}
- A61B 2503/40: Animals
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- A41H: APPLIANCES OR METHODS FOR MAKING CLOTHES, e.g. FOR DRESS-MAKING OR FOR TAILORING, NOT OTHERWISE PROVIDED FOR
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Embodiments of a shape measurement system and related methods are disclosed. In some embodiments, the system places a two-dimensional initial pattern, which can be implemented as a standalone molding or can be attached to a light source or printed on an outfit, onto a surface of a three-dimensional object. The system captures a transformed version of the initial pattern in two dimensions that is distorted due to the varying depth of the surface. The system then analyzes the transformed pattern and derives three-dimensional information regarding the target object. The analysis, which can incorporate a calibration process, can rely on the projection nature of the light source, the isomorphism/non-isomorphism of the initial pattern, and other factors.

## Claims

### Claim 1

A method of measuring a three-dimensional (3D) target object using two-dimensional (2D) patterns, comprising:
selecting an initial two-dimensional pattern;
laying the initial pattern on a 3D target object for viewing from a viewpoint to obtain a 2D transformed pattern;
computing first depth information regarding the target object based on the transformed pattern;
identifying a region of the target object that is hidden from the viewpoint or has a complexity above a predetermined threshold, based on the transformed pattern and first depth information; and
computing second depth information different from the first depth information regarding the region of the target object.

### Claim 2 (depends on 1)

The method of claim 1,
wherein the initial pattern is implemented by a standalone molding,
the laying comprising:
selecting a light source; and
positioning the light source, the molding, and the target object such that light illuminated from the light source shines through the molding before forming the transformed pattern on a surface of the target object.

### Claim 3 (depends on 1)

The method of claim 1,
wherein the initial pattern is printed on an outfit made of a fabric that stretches and conforms to track a surface of an object in the outfit,
the laying comprising:
placing the target object in the outfit so that as the fabric stretches and conforms, the initial pattern stretches into the transformed pattern.

### Claim 4 (depends on 3)

The method of claim 3, further comprising:
selecting a 2D calibration pattern;
laying the calibration pattern on a flat portion of surface of the target object for view from the viewpoint to obtain a 2D stretch pattern; and
computing a stretch of the stretch pattern from the calibration pattern,
wherein the first depth information is computed based on the stretch.

### Claim 5 (depends on 3)

The method of claim 3, further comprising
wherein the laying includes obtaining multiple 2D transformed patterns corresponding to the target object at multiple positions over a period of time,
wherein computing first depth information, identifying a region of the target object, and computing second depth information is performed for each of the multiple transformed patterns, and
wherein the first and second depth information is used to track a movement of the target object.

### Claim 6 (depends on 1)

The method of claim 1, wherein computing first depth information comprises: selecting a first portion of the initial pattern;
determining a second portion of the transformed pattern corresponding to the first portion; and
calculating specific depth information for a region of the target object corresponding to the second portion based on an area of the first portion, an area of the second portion, a length or diameter of the first portion, a curvature of the second portion, or a centroid of the second portion.

### Claim 7 (depends on 6)

The method of claim 6, further comprising
capturing a portion of the first transformed pattern into an image with a camera, wherein computing first depth information includes extracting the transformed pattern from the image, and
wherein calculating specific depth information is further based on the distance between the target object to a lens of the camera.

### Claim 8 (depends on 1)

The method of claim 1, wherein the identifying comprises:
selecting a first portion of the initial pattern;
determining a second portion of the transformed pattern that corresponds to the first portion;
computing a similarity score for the first portion and the second portion; and
when the similar score is below a predetermined threshold, determining whether the second portion indicates a depth discontinuity in the target object based on the first depth information.

### Claim 9 (depends on 8)

The method of claim 8, wherein the similar score is computed based on an area of the first portion and an area of the second portion.

### Claim 10 (depends on 8)

The method of claim 8, further comprising,
when the second portion indicates a depth discontinuity, certifying a presence of a hidden region near the region of the target object corresponding to the second portion,
wherein computing the second depth information includes assigning specific depth information that corrects the depth discontinuity to the hidden region.

### Claim 11 (depends on 1)

The method of claim 1,
when the second portion indicates no depth discontinuity, identifying a region of the target object corresponding to the second portion as a high-complexity region;
selecting a 2D second initial pattern for the region different from the first initial pattern; and
laying the second initial pattern on the target object to obtain a 2D second transformed pattern,
wherein the second depth information is computed based on the second transformed pattern.

### Claim 12 (depends on 11)

The method of claim 11, wherein the second initial pattern is selected based on the transformation pattern or is laid for viewing from a second viewpoint.

### Claim 13 (depends on 1)

The method of claim 1, wherein the initial pattern is isomorphic, repeating a configuration of lines, curves, or dots, or is an isomorphic repetition of non-isomorphic patterns.

### Claim 14 (depends on 1)

The method of claim 1, further comprising creating sizing information regarding the target object with respect to a wearable piece available in multiple sizes.

### Claim 15 (depends on 1)

The method of claim 1, wherein the target object is inanimate.

### Claim at position 16

-23. (canceled)
