# US 2001/0024512 A1 · Optical body tracker

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2001/0024512 A1
- Document ID: US20010024512A1
- Status: Published application
- Kind: A1
- Application number: 09/791,123
- Filed: 2001-02-22
- Published: 2001-09-27
- Earliest claimed: 1999-08-10
- Assignees: Cybernet Systems Corporation
- Inventors: Nestor Yoronka; Charles J. Jacobus
- Web page: https://patentgrep.com/patent/US20010024512A1

## CPC

- G06V 40/20: Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16)
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- A63F 2300/1087: comprising photodetecting means, e.g. a camera
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR

## Abstract

An optical system tracks the motion of objects, including the human body or portions thereof using a plurality of three-dimensional active markers based upon triangulation from data read via multiple linear CCDs through cylindrical lenses. Each marker is lit in sequence so that it is in sync with a frame capture using the imaging system positioned and oriented so as to provide a basis for computing three-dimensional location. In the preferred embodiment, the imaging system detects an infrared signal which is sent out by the tag controller as part of the tag/marker illumination sequence at the beginning of the first tag position capture time. The controller then traverses through the tags in time sync with each imaging system frame capture cycle. Thus, only one unique tag will be lit during each image capture of the cameras, thereby simplifying identification. Using linear CCD sensors, the frame time (i.e. point acquisition time) is very short, allowing very many markers to be sampled and located sequentially in real time.

## Claims

### Claim 1

A system for tracking the movements of an animate or inanimate body, comprising:
a plurality of optical tags supported at different positions on the body;
a tag controller supported on the body to activate the optical tags in an on/off illumination sequence; and
a position sensor disposed remotely from the body, including:
a plurality of cameras, each outputting electrical signals corresponding to the location of the optical tags;
processing circuitry for receiving the signals from the cameras and determining the positions of the tags in three-dimensional space utilizing triangulation techniques; and
sychronization circuitry coordinating the operation of the tag controller and position sensor so that only one tag is imaged per camera exposure.

### Claim 2 (depends on 1)

The system of claim 1, wherein the synchronization circuitry includes an optical signal generated by one of the tags.

### Claim 3 (depends on 1)

The system of claim 1, wherein:
the cameras are linear cameras, each defining an imaging axis, and
at least two of the axes are orthogonal.

### Claim 4 (depends on 1)

The system of claim 1, wherein:
the optical tags are infrared light-emitting diodes (LEDs); and
the cameras are sensitive to the infrared emissions of the LEDs.

### Claim 5 (depends on 1)

The system of claim 1, further including parallel processing circuitry operative to activate all of the cameras on a simultaneous basis.

### Claim 6 (depends on 1)

The system of claim 1, wherein:
the tags are placed on a person; and
the movements are communicated to a recognition system operative to determine one or more gestures of the person.

### Claim 7

A system for tracking the movements of an animate or inanimate body, comprising:
a plurality of optical tags supported at different positions on the body;
a tag controller supported on the body to activate the optical tags in an on/off illumination sequence; and
a position sensor disposed remotely from the body, including:
a plurality of cameras, each outputting electrical signals corresponding to the location of the optical tags;
parallel processing circuitry operative to activate all of the cameras on a simultaneous basis to determine the position of each tag in three-dimensional space utilizing triangulation techniques.

### Claim 8 (depends on 7)

The system of claim 7, further including synchronization circuitry for coordinating the operation of the tag controller and position sensor so that only one tag is imaged per simultaneous camera exposure.

### Claim 9 (depends on 8)

The system of claim 8, wherein the synchronization circuitry includes an optical signal generated by one of the tags.

### Claim 10 (depends on 7)

The system of claim 7, wherein:
the cameras are linear cameras, each defining an imaging axis, and
at least two of the axes are orthogonal.

### Claim 11 (depends on 7)

The system of claim 7, wherein:
the optical tags are infrared light-emitting diodes (LEDs); and
the cameras are sensitive to the infrared emissions of the LEDs.

### Claim 12 (depends on 7)

The system of claim 7, wherein:
the tags are placed on a person; and
the movements are communicated to a recognition system operative to determine one or more gestures of the person.

### Claim 13

A system for visually analyzing a gesture made by a human or machine, comprising:
a) an optical tracking subsystem, including:
a plurality of optical tags supported at different positions on the human or machine,
a tag controller to activate the optical tags in an on/off illumination sequence, and
a remotely disposed position sensor including a plurality of cameras and processing circuitry outputting image data including position and velocity information associated with the gesture in accordance with the location of the optical tags in three-dimensional space;
b) an identification module operative to identify the gesture based upon the image data output by the sensor module; and
c) a transformation module operative to generate a command based upon the gesture identified by the identification module.

### Claim 14 (depends on 13)

The interface of claim 13, further including a system response module operative to apply to the command from the transformation module to a device to be controlled.

### Claim 15 (depends on 14)

The interface of claim 14, wherein the device is a virtual-reality simulator.

### Claim 16 (depends on 14)

The interface of claim 14, wherein the device is a self-service machine.

### Claim 17 (depends on 14)

The interface of claim 14, wherein the device forms part of a robot.

### Claim 18 (depends on 14)

The interface of claim 14, wherein the device forms part of a commercial appliance.
