# US 2006/0066614 A1 · Method and system for providing a volumetric representation of a three-dimensional object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0066614 A1
- Document ID: US20060066614A1
- Status: Published application
- Kind: A1
- Application number: 11/238,119
- Filed: 2005-09-28
- Published: 2006-03-30
- Earliest claimed: 2004-09-28
- Assignees: British Broadcasting Corporation
- Inventors: Oliver Grau
- Web page: https://patentgrep.com/patent/US20060066614A1

## CPC

- G06T 17/20: Finite element generation, e.g. wire-frame surface description, {tesselation}
- G06T 7/564: from contours
- G06T 17/005: {Tree description, e.g. octree, quadtree}
- G06V 10/10: Image acquisition (document image scanning and transmission H04N1/00; control of digital cameras H04N23/60)
- G06V 20/64: Three-dimensional [3D] objects
- G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition}
- G06T 2207/20016: Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A method of providing a volumetric representation of a three dimensional object includes defining a plurality of voxels in a three dimensional space, categorizing voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value, and assigning to at least some voxels a value intermediate between the first and second binary values.

## Claims

### Claim 1

A method of providing a volumetric representation of a three dimensional object, comprising:
defining a plurality of voxels in a three dimensional space,
categorizing voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value, and
assigning to at least some voxels a value intermediate to the first and second binary values.

### Claim 2 (depends on 1)

The method of claim 1, wherein the intermediate value is based on an estimate the ratio of foreground to background contained within the voxel

### Claim 3 (depends on 2)

The method of claim 2, wherein the estimate is derived by dividing the voxel into volume fractions, assigning volume fractions as background or foreground, and forming a fractional sum.

### Claim 4 (depends on 2)

The method of claim 2, wherein the estimate is derived by projecting the voxel onto the silhouette image, assigning areas of the projection as foreground or background, and taking an area ratio.

### Claim 5 (depends on 1)

The method of claim 1, wherein voxels are defined by a recursive division algorithm.

### Claim 6 (depends on 5)

The method of claim 5, wherein the dividing into volume fractions comprises performing one or more additional stages of the recursive division algorithm.

### Claim 7 (depends on 1)

The method of claim 1, wherein the intermediate values are used by a marching cubes algorithm to produce a 3D surface.

### Claim 8

A method of providing a volumetric representation of a three dimensional object, in which a three dimensional space is comprised of a plurality of voxels, and wherein voxels are categorized as foreground or background according to at least one silhouette image of the object, the method comprising:
subsampling the at least one silhouette image, and
comparing a projection of at least one voxel with the sub-sampled image to categorize the voxel.

### Claim 9 (depends on 8)

The method of claim 8, further comprising, for at least one silhouette image, storing a plurality of equivalent images at different resolutions.

### Claim 10 (depends on 9)

The method of claim 9, wherein for each projection, an image from the plurality of equivalent images is selected for comparison.

### Claim 11 (depends on 10)

The method of claim 10, wherein one of the plurality of equivalent images is selected according to the size of the voxel.

### Claim 12 (depends on 8)

The method of claim 8, wherein subsampling maintains the aspect ratio of the at least one silhouette image.

### Claim 13 (depends on 8)

The method of claim 8, wherein subsampling is by a factor of 2.

### Claim 14

A method of providing a volumetric representation of a three dimensional object as the intersection of generalized cones of at least one silhouette image of that object, the method comprising
deriving one or more geometry parameters in dependence on the geometry of the intersections of the generalized cones, and
selectively removing volume from the representation in dependence on the geometry parameters.

### Claim 15 (depends on 14)

The method of claim 14, wherein the one or more geometry parameters includes the length of the intersection.

### Claim 16 (depends on 14)

The method of claim 14, wherein the one or more geometry parameters includes the distance of that volume from the intersection.

### Claim 17 (depends on 14)

The method of claim 14, wherein the one or more geometry parameters includes the angle of intersection.

### Claim 18 (depends on 14)

The method of claim 14, further comprising selecting a set of surface points on the representation in dependence on distance to the nearest intersection, fitting a spline function to the set of points, and removing volume based on the spline function.

### Claim 19

A method of providing a volumetric representation of a three dimensional object, in which a three dimensional space is comprised of a plurality of voxels, and wherein voxels are categorized as foreground or background according to at least one silhouette image of the object, the method comprising:
representing the object over a period of time as a 4D model defining a hyper-surface, and
applying a smoothing operator to the 4D hyper-surface.

### Claim 20 (depends on 19)

The method of claim 19, wherein the 4D model reduces the variation with time of a 3D parameter of the object.

### Claim 21 (depends on 19)

The method of claim 19, wherein the 4D model reduces the variation with time of the volume of the object.

### Claim 22

A computer software product for providing a volumetric representation of a three-dimensional object the product comprising a computer readable medium in which program instructions are stored, the instructions, when read by a computer, causing the computer to
define a plurality of voxels in a three dimensional space,
categorize voxels as foreground or background according to at least one silhouette image of the object, foreground voxels being assigned a first binary value, and background voxels being assigned a second binary value, and
assign to at least some voxels a value intermediate the first and second binary values
