# US 2013/0329013 A1 · Hand held dimension capture apparatus, system and method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0329013 A1
- Document ID: US20130329013A1
- Status: Published application
- Kind: A1
- Application number: 13/965,947
- Filed: 2013-08-13
- Published: 2013-12-12
- Earliest claimed: 2012-05-11
- Assignees: Proiam, LLC
- Applicants: Proiam, LLC
- Inventors: Eric Metois; Mike Murphy; Mark Durbin
- Web page: https://patentgrep.com/patent/US20130329013A1

## CPC

- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- G01B 11/00: Measuring arrangements characterised by the use of optical techniques
- G01B 11/24: for measuring contours or curvatures
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS

## Abstract

A method of determining dimension information indicative of the dimensions of an object is disclosed, the method including: receiving a depth image of the object; and processing the depth information. The processing may include: determining a region of interest (ROI) in the image corresponding to a corner of the object; generating local normal information indicative of local normals corresponding to points in the image; generating, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with sides of the object; and determining the dimension information based at least in part on the object face information.

## Claims

### Claim 1

A method of determining dimension information indicative of the dimensions of an object, the method comprising:
receiving a depth image of the object; and
processing the depth information, the processing comprising:
determining a region of interest (ROI) in the image corresponding to a corner of the object;
generating local normal information indicative of local normals corresponding to points in the image;
generating, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with faces of the object; and
determining the dimension information based at least in part on the object face information.

### Claim 2 (depends on 1)

The method of claim 1, wherein the object is substantially cuboid in shape, and wherein the dimension information comprises information indicative of the length, width, and height of the cuboid.

### Claim 3 (depends on 2)

The method of claim 2, wherein generating object face information comprises:
estimating the location of the corner of the object based on the ROI; and
identifying, based on the local normal information, object points in the image corresponding to points located in planes passing through the ROI based on the local normal information.

### Claim 4 (depends on 3)

The method of claim 3, wherein the identifying object points comprises identifying points in the image corresponding to points located in planes passing within a threshold distance from the location of the corner.

### Claim 5 (depends on 3)

The method of claim 3, wherein generating object face information further comprises:
generating segmentation information indicative of a distribution of the object points; and
estimating the location of the faces of the object based on the segmentation information.

### Claim 6 (depends on 5)

The method of claim 5, wherein estimating the location of the faces of the object based on the segmentation information comprises:
determining an orthogonal triplet of axes based on the segmentation information.

### Claim 7 (depends on 6)

The method of claim 6, wherein determining the dimension information based at least in part on the object face information comprises:
projecting each of the object points onto one of the three axes; and
determining the dimension information based on the projection.

### Claim 8 (depends on 1)

The method of claim 1, further comprising obtaining the depth image.

### Claim 9 (depends on 1)

The method of claim 1, further comprising obtaining the depth image using a device that is not fixed in location relative to the object.

### Claim 10 (depends on 9)

The method of claim 9, wherein the device is a hand held device.

### Claim 11 (depends on 10)

The method of claim 10 wherein the device comprises an infrared 3D camera.

### Claim 12

(canceled)

### Claim 13 (depends on 1)

The method of claim 1, wherein processing the depth information is carried out on a computer processor.

### Claim 14 (depends on 1)

The method of any claim 1, further comprising:
prior to generating the local normal information, applying a low pass spatial filter to the depth image.

### Claim 15

An apparatus for determining dimension information indicative of the dimensions of an object, the apparatus comprising:
a processor configured to
receive a depth image of the object; and
process the depth information;
wherein the processor is configured to:
determine a region of interest (ROI) in the image corresponding to a corner of the object; and
generate local normal information indicative of local normals corresponding to points in the image;
generate, based at least in part on the ROI and the local normal information, object face information indicative of an association of points in the image with faces of the object; and
determine the dimension information based at least in part on the object face information.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the object is substantially cuboid in shape, and wherein the dimension information comprises information indicative of the length, width, and height of the cuboid.

### Claim 17 (depends on 16)

The apparatus of claim 16, wherein the processor comprises a segmentation module configured to generate object face information, the segmentation module configured to:
estimate the location of the corner of the object based on the ROI; and
identify, based on the local normal information, object points in the image corresponding to points located in planes passing through the ROI based on the local normal information.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein the segmentation module is configured to:
identify object points by identifying points in the image corresponding to points located in planes passing within a threshold distance from the location of the corner.

### Claim 19 (depends on 18)

The apparatus of claim 18, wherein the segmentation module is configured to:
generate segmentation information indicative of a distribution of the object points; and
estimate the location of the faces of the object based on the segmentation information.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the processor comprises an orthogonal triplet selection module configured to estimate the location of the faces of the object based on the segmentation information by determining an orthogonal triplet of axes based on the segmentation information.

### Claim 21 (depends on 20)

The apparatus of claim 20, wherein the processor comprises a dimensioning module configure to determine the dimension information based at least in part on the object face information by:
projecting each of the object points onto one of the three axes; and
determining the dimension information based on the projection.

### Claim 22 (depends on 15)

The apparatus of claim 15, further comprising a sensor configured to generate the depth image of the object and transmit the image to the processor.

### Claim 23 (depends on 22)

The apparatus of claim 22, wherein the sensor is not fixed in location relative to the object.

### Claim 24 (depends on 23)

The apparatus of claim 23, comprising a hand held device comprising the sensor.

### Claim 25 (depends on 24)

The apparatus of claim 24, wherein the hand held device comprises the processor.

### Claim 26 (depends on 24)

The apparatus of claim 24, wherein the processor is located remotely from the hand held device.

### Claim 27 (depends on 22)

The apparatus of claim 22, wherein the sensor comprises an infrared 3D camera.

### Claim 28 (depends on 15)

The apparatus of claim 15, further comprising an output module for outputting the dimension information.

### Claim 29 (depends on 15)

The apparatus of claim 15, further comprising a filter module configured to apply a low pass spatial filter to the image.

### Claim 30 (depends on 15)

The apparatus of claim 15, comprising a handle unit comprising a sensor configured to generate the depth image of the object and transmit the image to the processor; and wherein the processor is incorporated in a computing device mounted on the handle unit.

### Claim 31

(canceled)

### Claim 32 (depends on 30)

The apparatus of claim 30, wherein the computing device is detachably mounted on the handle unit.

### Claim at position 33

33-35. (canceled)
