# US 2019/0295319 A1 · Systems and methods for generating a refined 3d model using radar and optical camera data

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0295319 A1
- Document ID: US20190295319A1
- Status: Published application
- Kind: A1
- Application number: 16/353,016
- Filed: 2019-03-14
- Published: 2019-09-26
- Earliest claimed: 2018-03-23
- Assignees: Bodidata, Inc.
- Applicants: Bodidata, Inc.
- Inventors: Hoa V. Pham; Quan H. Hua; Albert Charpentier; Michael Boylan; Leslie Young Harvill; Long H. Nguyen; Tuoc V. Luong
- Web page: https://patentgrep.com/patent/US20190295319A1

## CPC

- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/60: Analysis of geometric attributes
- G06T 15/005: {General purpose rendering architectures}
- G06T 17/00: Three-dimensional [3D] modelling for computer graphics
- G06V 30/142: using hand-held instruments; Constructional details of the instruments
- G06V 30/228: of three-dimensional [3D] handwriting, e.g. writing in the air
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30196: Human being; Person
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Systems and methods for generating a refined 3D model. The methods comprise: constructing a subject point cloud using at least optical camera data acquired by scanning a subject; using radar depth data to modify the subject point cloud to represent an occluded portion of the subject's real surface; generating a plurality of reference point clouds using (1) a first 3D model of a plurality of 3D models that represents an object belonging to a general object class or category to which the subject belongs and (2) a plurality of different setting vectors; identifying a first reference point cloud from the plurality of reference point clouds that is a best fit for the subject point cloud; obtaining a setting vector associated with the first reference point cloud; and transforming the first 3D model into the refined 3D model using the setting vector.

## Claims

### Claim 1

A method for generating a refined 3D model, comprising:
constructing, by the processing device, a subject point cloud using at least optical camera data acquired by scanning a subject;
using, by the processing device, radar depth data to modify the subject point cloud to represent an occluded portion of the subject's real surface;
generating, by the processing device, a plurality of reference point clouds using (1) a first 3D model of a plurality of 3D models that represents an object belonging to a general object class or category to which the subject belongs and (2) a plurality of different setting vectors;
identifying, by the processing device, a first reference point cloud from the plurality of reference point clouds that is a best fit for the subject point cloud;
obtaining a setting vector associated with the first reference point cloud; and
transforming the first 3D model into the refined 3D model using the setting vector.

### Claim 2 (depends on 1)

The method according to claim 1, further comprising adding at least one physical feature to the subject's real surface to the first 3D model for facilitating an improved creation of the subject point cloud.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the processing device comprises at least one of a handheld scanner device and a computer remote from the handheld scanner device.

### Claim 4 (depends on 1)

The method according to claim 1, further comprising obtaining a 3D surface model from the refined 3D model.

### Claim 5 (depends on 4)

The method according to claim 4, further comprising synthesizing the subject's appearance by morphing the 3D surface model in accordance with at least one of the optical camera data of the subject point cloud and radar depth data.

### Claim 6 (depends on 5)

The method according to claim 5, further comprising outputting the synthesized subject's appearance from the processing device.

### Claim 7 (depends on 1)

The method according to claim 1, further comprising obtaining physical measurement results for given characteristics of the subject using the setting vector.

### Claim 8 (depends on 7)

The method according to claim 7, further comprising generating refined metrics by refining the obtained physical measurement results using radar data associated with labeled regions of the refined 3D model.

### Claim 9 (depends on 8)

The method according to claim 8, further comprising identifying at least one garment which fits on the subject based on the refined metrics.

### Claim 10 (depends on 9)

The method according to claim 9, further comprising outputting information identifying the at least one garment.

### Claim 11 (depends on 7)

The method according to claim 7, further comprising generating refined metrics by refining the obtained physical measurement results based on geometries of labeled regions of the refined 3D model.

### Claim 12 (depends on 11)

The method according to claim 11, further comprising identifying at least one garment which fits on the subject based on the refined metrics.

### Claim 13 (depends on 12)

The method according to claim 12, further comprising outputting information identifying the identified at least one garment.

### Claim 14

A system, comprising:
a processor; and
a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for generating a refined 3D model, wherein the programming instructions comprise instructions to:
construct a subject point cloud using at least optical camera data acquired by scanning a subject;
using radar depth data to modify the subject point cloud to represent an occluded portion of the subject's real surface;
generate a plurality of reference point clouds using (1) a first 3D model of a plurality of 3D models that represents an object belonging to a general object class or category to which the subject belongs and (2) a plurality of different setting vectors;
identify a first reference point cloud from the plurality of reference point clouds that is a best fit for the subject point cloud;
obtain a setting vector associated with the first reference point cloud; and
transform the first 3D model into the refined 3D model using the setting vector.

### Claim 15 (depends on 14)

The system according to claim 14, further comprising adding at least one physical feature to the subject's real surface to the first 3D model for facilitating an improved creation of the subject point cloud.

### Claim 16 (depends on 14)

The system according to claim 14, wherein the processor and non-transitory computer-readable storage medium are disposed in at least one of a handheld scanner device and a computer remote from the handheld scanner device.

### Claim 17 (depends on 14)

The system according to claim 14, wherein the programming instructions further comprise instructions to obtain a 3D surface model from the refined 3D model.

### Claim 18 (depends on 17)

The system according to claim 17, wherein the programming instructions further comprise instructions to synthesize the subject's appearance by morphing the 3D surface model in accordance with at least one of the optical camera data of the subject point cloud and radar data.

### Claim 19 (depends on 18)

The system according to claim 18, wherein the programming instructions further comprise instructions to output the synthesized subject's appearance from the processing device.

### Claim 20 (depends on 14)

The system according to claim 14, wherein the programming instructions further comprise instructions to obtain physical measurement results for given characteristics of the subject using the setting vector.

### Claim 21 (depends on 20)

The system according to claim 20, wherein the programming instructions further comprise instructions to generate refined metrics by refining the obtained physical measurement results for given characteristics using radar data associated with labeled regions of the refined 3D model.

### Claim 22 (depends on 21)

The system according to claim 21, wherein the programming instructions further comprise instructions to identify at least one garment which fits on the subject based on the refined metrics.

### Claim 23 (depends on 22)

The system according to claim 22, wherein the programming instructions further comprise instructions to output information identifying the at least one garment.

### Claim 24 (depends on 20)

The system according to claim 20, wherein the programming instructions further comprise instructions to generate refined metrics by refining the obtained physical measurement results based on geometries of labeled regions of the refined 3D model.

### Claim 25 (depends on 24)

The system according to claim 24, wherein the programming instructions further comprise instructions to generate refined metrics by refining obtained physical measurement results for given characteristics using radar data associated with labeled regions of the refined 3D model.

### Claim 26 (depends on 25)

The system according to claim 25, wherein the programming instructions further comprise instructions to identify at least one garment which fits on the subject based on the refined metrics.

### Claim 27 (depends on 26)

The system according to claim 26, wherein the programming instructions further comprise instructions to output information identifying the at least one garment.
