# US 2012/0253201 A1 · System and methods for monitoring and assessing mobility

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0253201 A1
- Document ID: US20120253201A1
- Status: Published application
- Kind: A1
- Application number: 13/432,516
- Filed: 2012-03-28
- Published: 2012-10-04
- Earliest claimed: 2011-03-29
- Assignees: Kaliber Imaging Inc.
- Inventors: Ralph R. Reinhold
- Web page: https://patentgrep.com/patent/US20120253201A1

## CPC

- A61B 5/1113: {Local tracking of patients, e.g. in a hospital or private home}
- A61B 5/1128: {using image analysis (A61B5/1127 takes precedence)}
- G16H 20/30: relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
- G16H 40/67: for remote operation
- G16H 50/30: for calculating health indices; for individual health risk assessment
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/25: using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system and methods are provided relating generally to physical activity and more specifically to tools for monitoring and assessing physical activity by capturing images of a subject's movement including range of motion, gait, balance and activities of daily living at different time periods and comparing those images to stored data.

## Claims

### Claim 1

A three-dimensional imaging apparatus for analyzing motion of a subject, comprising:
one or more structured infrared light projectors for projecting near-infrared structured light onto a subject;
a plurality of near-infrared cameras for detecting reflected structured light and capturing motion of the subject, the cameras and the one or more structured infrared light projectors operatively coupled to the subject; and
a processor, operatively coupled to the structured light projector and the cameras, the processor programmed to convert the reflected structured light into 3D motion data of the subject.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein each of the structured light projector includes:
an integrating sphere having a pinhole;
two or more infrared light emitting diodes projecting inside the integrating sphere, the light emitting diodes operating in a simultaneously flashing pulsed mode in synchronization with exposure times of the plurality of cameras; and
a film pattern located between the pinhole and the subject to produce the structured light as a structured light pattern projected onto the subject.

### Claim 3 (depends on 1)

The apparatus of claim 1, further comprising a display device, coupled to the processor, for visually presenting the motion data.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising a camera bar, wherein the plurality of cameras and the structured light projector are mounted on the camera bar.

### Claim 5 (depends on 1)

The apparatus of claim 1, further comprising a color camera operatively coupled to the plurality of near infrared cameras and the subject.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein:
the structured light pattern produces illuminated spots onto the subject; the spots being aligned in a two-dimensional plane with the centroids of the spots being equally spaced along both axes of the two-dimensional plane; and
further comprising means for autonomously rotating the apparatus to hold the subject's trunk at the center of a field of view.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the processor is further configured to compare the motion data of the subject to stored prior motion data of the subject and representative normal motion data to determine a level of mobility of the subject, and is further programmed to include stored data of rehabilitation and strengthening exercises.

### Claim 8 (depends on 7)

The apparatus of claim 7, wherein the processor is programmed to generate a conclusion as to a proposed means for rehabilitating or strengthening the subject from the stored data of rehabilitation and strengthening exercises to compensate for an observed deficiency between the motion data of the subject and the stored prior motion data of the subject and representative normal motion data.

### Claim 9 (depends on 7)

The apparatus of claim 7, wherein the processor is programmed to generate a conclusion as to whether the subject may function independently or requires assistance.

### Claim 10 (depends on 1)

The apparatus of claim 1, further comprising means for creating a shadowing avatar from an individual mesh model, the avatar comprising either the subject's prior performance or a ghost figure representing the normal range for the subject's age.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the infrared cameras are rotated 90 degrees to function in a portrait-style mode.

### Claim 12 (depends on 6)

The apparatus of claim 6, wherein the spots are individually identifiable by two near-infrared cameras, to generate a three-dimensional point cloud, and map the point cloud onto a mesh model.

### Claim 13 (depends on 2)

The apparatus of claim 2, wherein the film size is increased up to 54 mm.

### Claim 14 (depends on 2)

The apparatus of claim 2, further comprising means for adjusting the distance from the pin hole to the film to give an angle such that it projects a grid of spots at the subject's centroid.

### Claim 15

A method for analyzing a subject's motion, comprising:
projecting structured light onto a subject to generate structured light images of the subject's motion;
recording a plurality of structured light images via a plurality of near-infrared cameras as data sets;
processing the data sets to generate 3D images of the subject's motion; and
comparing the 3D images to stored prior motion data of the subject and representative normal motion data to detect deficiencies in the subject's motion.

### Claim 16 (depends on 15)

The method of claim 15, further comprising generating rehabilitative exercises targeted to compensate for observed deficiencies in the subject's motion.

### Claim 17 (depends on 15)

The method of claim 15, further comprising transmitting the results to a physician for diagnosis.

### Claim 18 (depends on 15)

The method as in claim 15, further comprising:
tracking the motion of the subject automatically, the tracking comprising maintaining the trunk of the subject at the center of a field of view;
processing the data from the plurality of cameras and the structured light projector to produce a three-dimensional point cloud; and
mapping the three dimensional point cloud onto a mesh outline of the subject.

### Claim 19

A system for generating three-dimensional images of motion of a subject, comprising:
a stand component having a base member and a support member extending from the base member;
a camera bar connected to the support member and distally opposed from the base member;
a plurality of near-infrared cameras mounted on the camera bar;
a structured near-infrared light projector mounted on the camera bar, the structured near-infrared light projector operatively coupled to the subject and producing structured light onto a subject and coupled to the motion of the subject;
a processor programmed to communicate with the plurality of cameras and the structured light projector and programmed to convert the structured light into 3D motion data of the subject; the processor further configured to compare the motion data of the subject to stored prior motion data of the subject and representative normal motion data to determine a level of mobility of the subject.
