# US 2024/0110781 A1 · Generation of one or more edges of luminosity to form three-dimensional models of objects

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0110781 A1
- Document ID: US20240110781A1
- Status: Published application
- Kind: A1
- Application number: 18/505,878
- Filed: 2023-11-09
- Published: 2024-04-04
- Earliest claimed: 2019-09-20
- Assignees: VISIE Inc.
- Applicants: VISIE Inc.
- Inventors: Aaron Charles Bernstein; Jeffrey A. Levine; Patrick C. Edwards
- Web page: https://patentgrep.com/patent/US20240110781A1

## CPC

- A61B 1/00167: {Details of optical fibre bundles, e.g. shape or fibre distribution}
- G01B 11/2433: {for measuring outlines by shadow casting}
- A61B 1/000095: {for image enhancement}
- A61B 1/00172: {with means for scanning}
- A61B 1/00194: {adapted for three-dimensional imaging}
- A61B 1/0605: {for spatially modulated illumination}
- A61B 1/0646: {with illumination filters}
- A61B 1/07: using light-conductive means, e.g. optical fibres
- A61B 34/10: Computer-aided planning, simulation or modelling of surgical operations
- A61B 34/20: Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B 90/10: for stereotaxic surgery, e.g. frame-based stereotaxis
- A61B 90/20: Surgical microscopes characterised by non-optical aspects
- A61B 90/30: Devices for illuminating a surgical field, the devices having an interrelation with other surgical devices or with a surgical procedure
- A61B 90/36: {Image-producing devices or illumination devices not otherwise provided for}
- A61B 90/37: {Surgical systems with images on a monitor during operation}
- F21K 9/00: Light sources using semiconductor devices as light-generating elements, e.g. using light-emitting diodes [LED] or lasers
- F21V 1/08: adjustable
- F21V 1/10: Rotating shades
- F21V 7/005: {with an elongated shape to cooperate with linear light sources}
- F21V 11/12: of slot type
- G01B 11/25: by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50})
- G01B 11/2518: {Projection by scanning of the object}
- G01B 11/2527: {with phase change by in-plane movement of the patern}
- G06T 15/60: Shadow generation
- A61B 34/30: Surgical robots
- A61B 2034/105: {Modelling of the patient, e.g. for ligaments or bones}
- A61B 2034/2048: {using an accelerometer or inertia sensor}
- A61B 2034/2051: {Electromagnetic tracking systems}
- A61B 2034/2055: {Optical tracking systems}
- A61B 2090/306: {using optical fibres}
- A61B 2090/309: {using white LEDs}
- A61B 2090/365: {augmented reality, i.e. correlating a live optical image with another image}
- A61B 2090/367: {creating a 3D dataset from 2D images using position information}
- A61B 2090/372: {Details of monitor hardware}
- A61B 2090/373: {using light, e.g. by using optical scanners}
- A61B 2090/374: {NMR or MRI}
- A61B 2090/3762: {using computed tomography systems [CT]}
- A61B 2090/502: {Headgear, e.g. helmet, spectacles}
- B64U 2101/30: for imaging, photography or videography
- F21Y 2103/00: Elongate light sources, e.g. fluorescent tubes
- G06T 2215/12: Shadow map, environment map
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- F21K: NON-ELECTRIC LIGHT SOURCES USING LUMINESCENCE; LIGHT SOURCES USING ELECTROCHEMILUMINESCENCE; LIGHT SOURCES USING CHARGES OF COMBUSTIBLE MATERIAL; LIGHT SOURCES USING SEMICONDUCTOR DEVICES AS LIGHT-GENERATING ELEMENTS; LIGHT SOURCES NOT OTHERWISE PROVIDED FOR
- F21V: FUNCTIONAL FEATURES OR DETAILS OF LIGHTING DEVICES OR SYSTEMS THEREOF; STRUCTURAL COMBINATIONS OF LIGHTING DEVICES WITH OTHER ARTICLES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B64U: UNMANNED AERIAL VEHICLES [UAV]; EQUIPMENT THEREFOR
- F21Y: INDEXING SCHEME ASSOCIATED WITH SUBCLASSES F21K, F21L, F21S and F21V, RELATING TO THE FORM OR THE KIND OF THE LIGHT SOURCES OR OF THE COLOUR OF THE LIGHT EMITTED

## Abstract

Disclosed herein are various embodiments related generally to computer vision, graphics, image scanning, shadow casters, shadow caster scanners, and image processing as well as associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to form at least three-dimensional models or images of objects and environments.

## Claims

### Claim 1

An apparatus for generating one or more edges of luminosity to form three-dimensional models of an object, said apparatus comprising:
one or more light sources;
one or more shadow casters, said one or more shadow casters comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
one or more actuators, said actuators being capable of moving said one or more shadow casters;
one or more image capture devices;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity on said object;
wherein said one or more actuators move said one or more shadow casters in order to sweep said one or more edges of luminosity across said object;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said object and record said images into said memory;
wherein said processor forms a three-dimensional data representation from recorded said images; and
wherein said processor generates said three-dimensional model of said object using said three-dimensional data representation.

### Claim 2

An apparatus for generating one or more edges of luminosity to form three-dimensional models of an object, said apparatus comprising:
one or more light sources;
one or more shadow casters, said one or more shadow casters comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
one or more actuators, said actuators being capable of moving said one or more light sources;
one or more image capture devices;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity on said object;
wherein said one or more actuators move said one or more light sources in order to sweep said one or more edges of luminosity across said object;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said object and record said images into said memory;
wherein said processor forms a three-dimensional data representation from recorded said images; and
wherein said processor generates said three-dimensional model of said object using said three-dimensional data representation.

### Claim 3

An apparatus for generating one or more edges of luminosity to form three-dimensional models of an object, said apparatus comprising:
one or more light sources;
one or more shadow casters, said one or more shadow casters comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
one or more image capture devices;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity;
wherein said object moves through said one or more edges of luminosity in order to sweep said one or more edges of luminosity across said object;
wherein said one or more image capture devices detect the motion of said object moving through said one or more edges of luminosity and records said motion into said memory;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said object moving through said one or more edges of luminosity and record said images into said memory;
wherein said processor calculates the velocity of said object moving through said one or more edges of luminosity from recorded said motion;
wherein said processor forms a three-dimensional data representation from recorded said images and calculated said velocity; and
wherein said processor generates said three-dimensional model of said object using said three-dimensional data representation.

### Claim 4

An apparatus for generating one or more edges of luminosity to form three-dimensional models of the surroundings of an object, said apparatus comprising:
one or more light sources, said one or more light sources being mounted on said object;
one or more shadow casters, said one or more shadow casters being mounted on said object and comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
one or more actuators, said actuators being capable of moving said one or more shadow casters;
one or more image capture devices, said one or more image capture devices being mounted on said object;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity on said surroundings of said object;
wherein said one or more actuators move said one or more shadow casters in order to sweep said one or more edges of luminosity across said surroundings of said object;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said surroundings of said object and record said images into said memory;
wherein said processor forms a three-dimensional data representation from recorded said images;
wherein said processor generates said three-dimensional model of said surroundings of said object using said three-dimensional data representation; and
wherein said three-dimensional model is stored in said memory.

### Claim 5

An apparatus for generating one or more edges of luminosity to form three-dimensional models of the surroundings of an object, said apparatus comprising:
one or more light sources, said one or more light sources being mounted on said object;
one or more shadow casters, said one or more shadow casters being mounted on said object and comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
one or more image capture devices, said one or more image capture devices being mounted on said object;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity on said surroundings of said object;
wherein said object moves through said surroundings of said object in order to sweep said one or more edges of luminosity across said surroundings of said object;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said surroundings of said object and record said images into said memory;
wherein said processor forms a three-dimensional data representation from recorded said images;
wherein said processor generates said three-dimensional model of said surroundings of said object using said three-dimensional data representation; and
wherein said three-dimensional model is stored in said memory.

### Claim 6

An apparatus for generating one or more edges of luminosity to form three-dimensional models of an object, said apparatus comprising:
one or more light sources;
one or more image capture devices;
a memory stored in non-transitory computer-readable medium; and
a processor, said processor comprising:
said computer-readable medium;
one or more shadow casters, said one or more shadow casters comprising:
a transparent liquid crystal matrix, said transparent liquid crystal matrix being controllable by said processor and being capable of generating opaque regions, said opaque regions comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
wherein said one or more light sources illuminate said one or more shadow casters to project sharp shadows of known geometry, which form said one or more edges of luminosity on said object;
wherein said processor generates a series of said opaque regions on said transparent liquid crystal matrix, which simulates movement of said one or more shadow casters, in order to sweep said one or more edges of luminosity across said object;
wherein said one or more image capture devices capture images of said one or more edges of luminosity on said object and record said images into said memory;
wherein said processor forms a three-dimensional data representation from recorded said images; and
wherein said processor generates said three-dimensional model of said object using said three-dimensional data representation.

### Claim 7 (depends on 1, 2, 3, 4, 5, 6)

The apparatus as in any one of claims 1-6, wherein said one or more light sources are discrete or continuous.

### Claim 8 (depends on 1, 2, 3, 4, 5, 6)

The apparatus as in any one of claims 1-6, wherein said one or more light sources are linear.

### Claim 9 (depends on 1, 2, 3, 4, 5, 6)

The apparatus as in any one of claims 1-6, wherein said one or more light sources comprise one or more arrays of lights.

### Claim 10 (depends on 1, 2, 6)

The apparatus as in any one of claims 1-2 and 6, wherein said shape of said one or more shadow casters is based on said object.

### Claim 11 (depends on 1, 2, 4, 5)

The apparatus as in any one of claims 1-2 and 4-5, wherein said one or more shadow casters further comprise configurable shapes.

### Claim 12 (depends on 1, 2, 3, 4, 5)

The apparatus as in any one of claims 1-5, wherein said one or more shadow casters further comprise configurable opacity.

### Claim 13 (depends on 1, 2, 3, 4, 5, 6)

The apparatus as in any one of claims 1-6, wherein said one or more shadow casters further comprise color filters.

### Claim 14 (depends on 1, 4)

The apparatus as in one claim 1 or 4, wherein said one or more actuators rotate said one or more shadow casters.

### Claim 15 (depends on 1, 2, 3, 6)

The apparatus as in any one of claims 1-3 and 6, said apparatus further comprising an augmented reality headset, wherein said three-dimensional model is displayed in said augmented reality headset.

### Claim 16 (depends on 2)

The apparatus of claim 2, wherein said one or more actuators rotate said one or more light sources.

### Claim 17 (depends on 3)

The apparatus of claim 3, wherein said apparatus is installed in a room, said room comprising:
a ceiling, said apparatus being mounted on said ceiling.

### Claim 18 (depends on 3)

The apparatus of claim 3, wherein said apparatus is installed in a room, said room comprising:
a ceiling, said apparatus and said one or more light sources being mounted on said ceiling.

### Claim 19 (depends on 4, 5)

The apparatus as in any one of claim 4 or 5, said apparatus further comprising:
an augmented reality headset;
wherein said three-dimensional model is displayed in said augmented reality headset and overlaid on said surroundings of said object.

### Claim 20 (depends on 4, 5)

The apparatus as in any one of claim 4 or 5, wherein said object is an augmented reality headset and said three-dimensional model is displayed in said augmented reality headset and overlaid on said surroundings of said augmented reality headset.

### Claim 21 (depends on 4, 5)

The apparatus as in any one of claim 4 or 5, wherein said object is a vehicle.

### Claim 22 (depends on 4, 5)

The apparatus as in any one of claim 4 or 5, wherein said object is a robot.

### Claim 23 (depends on 4, 5)

The apparatus as in any one of claim 4 or 5, wherein said apparatus and said object are submersible.

### Claim 24 (depends on 1, 2, 3, 4, 5)

The apparatus as in any one of claims 1-5, wherein said one or more light sources are linear, and wherein said edge, which shares said plane with said one or more light sources, is parallel to said one or more light sources.

### Claim 25 (depends on 1, 2, 3, 6)

The apparatus as in any one of claims 1-3 and 6, said apparatus further comprising a display, wherein said three-dimensional model is displayed on said display.

### Claim 26 (depends on 1, 2, 3, 4, 5)

The apparatus as in any one of claims 1-5, wherein said one or more shadow casters further comprise a transparent liquid crystal matrix, said transparent liquid crystal matrix being capable of generating opaque regions.

### Claim 27 (depends on 1, 2, 3, 4, 5)

The apparatus as in any one of claims 1-5, wherein said one or more shadow casters further comprise periodic opacity variation.

### Claim 28 (depends on 6)

The apparatus of claim 6, wherein said opaque regions of said transparent liquid crystal matrix further comprise regions of varying opacity.

### Claim 29 (depends on 1, 2, 3, 4, 5, 6)

The apparatus as in any one of claims 1-6, wherein said one or more shadow casters further comprise a pattern.

### Claim 30

A method for generating one or more edges of luminosity to form three-dimensional models of an object, said method comprising:
providing one or more light sources;
providing one or more shadow casting elements, said one or more shadow casting elements comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity on said object using said one or more light sources and said one or more shadow casting elements;
moving said one or more shadow casting elements in order to move said one or more edges of luminosity across said object;
capturing images of said one or more edges of luminosity on said object;
forming a three-dimensional data representation from captured said images; and
generating said three-dimensional model of said object using said three-dimensional data representation.

### Claim 31

A method for generating one or more edges of luminosity to form three-dimensional models of an object, said method comprising:
providing one or more light sources;
providing one or more shadow casting elements, said one or more shadow casting elements comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity on said object using said one or more light sources and said one or more shadow casting elements;
moving said one or more light sources in order to move said one or more edges of luminosity across said object;
capturing images of said one or more edges of luminosity on said object;
forming a three-dimensional data representation from captured said images; and
generating said three-dimensional model of said object using said three-dimensional data representation.

### Claim 32

A method for generating one or more edges of luminosity to form three-dimensional models of an object, said method comprising:
providing one or more light sources;
providing one or more shadow casting elements, said one or more shadow casting elements comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity using said one or more light sources and said one or more shadow casting elements;
moving said object through said one or more edges of luminosity;
detecting the velocity of said object moving through said one or more edges of luminosity;
capturing images of said one or more edges of luminosity on said object moving through said one or more edges of luminosity;
forming a three-dimensional data representation from detected said velocity and captured said images; and
generating said three-dimensional model of said object using said three-dimensional data representation.

### Claim 33

A method for generating one or more edges of luminosity to form three-dimensional models of the surroundings of an object, said method comprising:
providing one or more light sources, said one or more light sources being mounted on said object;
providing one or more shadow casting elements, said one or more shadow casting elements being mounted on said object and comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity on said surroundings of said object using said one or more light sources and said one or more shadow casting elements;
moving said one or more shadow casting elements in order to move said one or more edges of luminosity across said surroundings of said object;
capturing images of said one or more edges of luminosity on said surroundings of said object;
forming a three-dimensional data representation from captured said images;
generating said three-dimensional model of said surroundings of said object using said three-dimensional data representation; and
storing said three-dimensional model in non-transitory computer-readable medium.

### Claim 34

A method for generating one or more edges of luminosity to form three-dimensional models of the surroundings of an object, said method comprising:
providing one or more light sources, said one or more light sources being mounted on said object;
providing one or more shadow casting elements, said one or more shadow casting elements being mounted on said object and comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity on said surroundings of said object using said one or more light sources and said one or more shadow casting elements;
moving said object in order to move said one or more edges of luminosity across said surroundings of said object;
capturing images of said one or more edges of luminosity on said surroundings of said object;
forming a three-dimensional data representation from captured said images;
generating said three-dimensional model of said surroundings of said object using said three-dimensional data representation; and
storing said three-dimensional model in non-transitory computer-readable medium.

### Claim 35

A method for generating one or more edges of luminosity to form three-dimensional models of an object, said method comprising:
providing one or more light sources;
providing one or more shadow casting elements, said one or more shadow casting elements comprising:
a transparent liquid crystal matrix, said transparent liquid crystal matrix being capable of generating opaque regions, said opaque regions comprising:
a shape with at least one edge, said edge being contained within a plane, which contains said one or more light sources;
projecting sharp shadows of known geometry to form said one or more edges of luminosity on said object using said one or more light sources and said one or more shadow casting elements;
generating a series of said opaque regions on said transparent liquid crystal matrix, which simulates movement of said one or more shadow casting elements, in order to move said one or more edges of luminosity across said object;
capturing images of said one or more edges of luminosity on said object;
forming a three-dimensional data representation from captured said images; and
generating said three-dimensional model of said object using said three-dimensional data representation.

### Claim 36 (depends on 30, 31, 32, 33, 34, 35)

The method as in any one of claims 30-35, wherein said one or more light sources are discrete or continuous.

### Claim 37 (depends on 30, 31, 32, 33, 34, 35)

The method as in any one of claims 30-35, wherein said one or more light sources are linear.

### Claim 38 (depends on 30, 31, 32, 33, 34, 35)

The method as in any one of claims 30-35, wherein said one or more light sources comprise one or more arrays of lights.

### Claim 39 (depends on 30, 31, 35)

The method as in any one of claims 30-31 and 35, wherein said shape of said one or more shadow casting elements is based on said object.

### Claim 40 (depends on 30, 31, 33, 34)

The method as in any one of claims 30-31 and 33-34, wherein said one or more shadow casting elements comprise configurable shapes.

### Claim 41 (depends on 30, 31, 32, 33, 34)

The method as in any one of claims 30-34, wherein said one or more shadow casting elements further comprise configurable opacity.

### Claim 42 (depends on 30, 31, 32, 33, 34, 35)

The method as in any one of claims 30-35, wherein said one or more shadow casting elements further comprise color filters.

### Claim 43 (depends on 30, 31, 33)

The method as in any one of claims 30-31 and 33, wherein moving said one or more shadow casting elements comprises rotation.

### Claim 44 (depends on 32)

The method of claim 32, wherein said object moves through a room, said room comprising:
a ceiling, said one or more shadow casting elements being mounted on said ceiling.

### Claim 45 (depends on 32)

The method of claim 32, wherein said object moves through a room, said room comprising:
a ceiling, said one or more shadow casting elements and said one or more light sources being mounted on said ceiling.

### Claim 46 (depends on 33)

The method of claim 33, wherein said object is an augmented reality headset, said method furthering comprising:
displaying said three-dimensional model in said augmented reality headset overlaid on said surroundings of said augmented reality headset.

### Claim 47 (depends on 34)

The method of claim 34, wherein said object is an augmented reality headset, said method furthering comprising:
displaying said three-dimensional model in said augmented reality headset overlaid on said surroundings of said augmented reality headset.

### Claim 48 (depends on 30, 31, 32, 33, 34)

The method as in any one of claims 30-34, wherein said one or more light sources are linear, and wherein said edge, which shares said plane with said one or more light sources, is parallel to said one or more light sources.

### Claim 49 (depends on 30, 31, 32, 35)

The method as in any one of claims 30-32 and 35, said method further comprising displaying said three-dimensional model.

### Claim 50 (depends on 30, 31, 32, 33, 34)

The method as in any one of claims 30-34, wherein said one or more shadow casting elements further comprise a transparent liquid crystal matrix, said transparent liquid crystal matrix being capable of generating opaque regions.

### Claim 51 (depends on 30, 31, 32, 33, 34)

The method as in any one of claims 30-34, wherein said one or more shadow casting elements further comprise periodic opacity variation.

### Claim 52 (depends on 35)

The method of claim 35, wherein said opaque regions of said transparent liquid crystal matrix further comprise regions of varying opacity.

### Claim 53 (depends on 30, 31, 32, 33, 34, 35)

The method as in any one of claims 30-35, wherein said one or more shadow casting elements further comprise a pattern.
